2024-04-17T15:20:16.679 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T15:20:16.680 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437 --owner scheduled_suriarte@teuthology --verbose --name suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} -- /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/orig.config.yaml 2024-04-17T15:20:16.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:20:16.799 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437 branch: rgw-update-boost-redis description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7660437' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rgw-update-boost-redis ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rgw-update-boost-redis sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c owner: scheduled_suriarte@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c sleep_before_teardown: 0 suite: rgw suite_branch: rgw-update-boost-redis suite_path: /home/teuthworker/src/github.com_samarahu_ceph_5bf3b3a9b161d70b9aa7806055bdae202e03111c/qa suite_relpath: qa suite_repo: https://github.com/samarahu/ceph.git suite_sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOUEALxH9IKQVeHxGeRU2BApbWMK5NqFjSUQqxGCmdrRWh6eQmZnTNpFj7eaXt1Bdz1lOfdzlZUkI9pUvXja29k= smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbVCOemABmPc/8qEmqtPLsyonnPsA96SEBP9Bm2/q/J1VqHo9wX37dxX+gCDq7g6423kzR7Fjnv2LbA2I13q/4= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-17_14:05:14 tube: smithi user: suriarte verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-17T15:20:16.799 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_samarahu_ceph_5bf3b3a9b161d70b9aa7806055bdae202e03111c/qa; will attempt to use it 2024-04-17T15:20:16.800 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_samarahu_ceph_5bf3b3a9b161d70b9aa7806055bdae202e03111c/qa/tasks 2024-04-17T15:20:16.800 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-17T15:20:16.801 INFO:teuthology.task.internal:Checking packages... 2024-04-17T15:20:16.825 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '5bf3b3a9b161d70b9aa7806055bdae202e03111c' 2024-04-17T15:20:16.826 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-17T15:20:16.826 INFO:teuthology.packaging:ref: None 2024-04-17T15:20:16.826 INFO:teuthology.packaging:tag: None 2024-04-17T15:20:16.826 INFO:teuthology.packaging:branch: rgw-update-boost-redis 2024-04-17T15:20:16.826 INFO:teuthology.packaging:sha1: 5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-17T15:20:16.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rgw-update-boost-redis 2024-04-17T15:20:16.980 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:20:16.982 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-17T15:20:16.988 INFO:teuthology.task.internal:no buildpackages task found 2024-04-17T15:20:16.988 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-17T15:20:17.032 INFO:teuthology.task.internal:Saving configuration 2024-04-17T15:20:17.057 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-17T15:20:17.063 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T15:20:17.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 15:10:40.269089', 'locked_by': 'scheduled_suriarte@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIORAj730F+eAUBLTyIQ2Sxxb5FwFg4thqdCoZeB62/Ho'} 2024-04-17T15:20:17.114 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 15:10:40.271140', 'locked_by': 'scheduled_suriarte@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN2qL/UkFnPQj+pHD97QWLhV5k3gjYAf4dIHAu32yVZ0'} 2024-04-17T15:20:17.114 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-17T15:20:17.120 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-17T15:20:17.121 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-17T15:20:17.121 INFO:teuthology.run_tasks:Running task console_log... 2024-04-17T15:20:17.216 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f82a0ecd280>, signals=[15]) 2024-04-17T15:20:17.217 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-17T15:20:17.222 INFO:teuthology.task.internal:Opening connections... 2024-04-17T15:20:17.222 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:20:17.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:20:17.307 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:20:17.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:20:17.386 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-17T15:20:17.392 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-04-17T15:20:17.397 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-04-17T15:20:17.398 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-04-17T15:20:17.446 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T15:20:17.446 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2024-04-17T15:20:17.446 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04" 2024-04-17T15:20:17.446 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T15:20:17.446 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy 2024-04-17T15:20:17.446 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2024-04-17T15:20:17.446 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2024-04-17T15:20:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T15:20:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T15:20:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T15:20:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T15:20:17.447 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy 2024-04-17T15:20:17.447 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-04-17T15:20:17.468 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-04-17T15:20:17.474 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-04-17T15:20:17.474 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-04-17T15:20:17.526 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T15:20:17.526 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2024-04-17T15:20:17.526 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="22.04" 2024-04-17T15:20:17.526 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T15:20:17.526 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=jammy 2024-04-17T15:20:17.526 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2024-04-17T15:20:17.527 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2024-04-17T15:20:17.527 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T15:20:17.527 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T15:20:17.527 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T15:20:17.527 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T15:20:17.527 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=jammy 2024-04-17T15:20:17.527 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-04-17T15:20:17.550 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-17T15:20:17.559 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-17T15:20:17.564 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-17T15:20:17.564 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-04-17T15:20:17.566 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-04-17T15:20:17.572 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-17T15:20:17.578 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-17T15:20:17.578 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-04-17T15:20:17.611 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-04-17T15:20:17.627 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-17T15:20:17.680 INFO:teuthology.run_tasks:Running task kernel... 2024-04-17T15:20:17.695 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-17T15:20:17.695 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-17T15:20:17.696 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T15:20:17.696 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T15:20:17.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:20:17.701 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-04-17T15:20:17.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:20:17.702 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-04-17T15:20:17.747 INFO:teuthology.orchestra.run.smithi044.stdout:5.15.0-56-generic 2024-04-17T15:20:17.747 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.15.0-56-generic 2024-04-17T15:20:17.747 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get clean 2024-04-17T15:20:17.750 INFO:teuthology.orchestra.run.smithi063.stdout:5.15.0-56-generic 2024-04-17T15:20:17.750 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.15.0-56-generic 2024-04-17T15:20:17.750 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2024-04-17T15:20:17.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2024-04-17T15:20:17.880 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-04-17T15:20:18.145 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T15:20:18.145 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-17T15:20:18.179 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T15:20:18.181 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-17T15:20:18.204 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-17T15:20:18.236 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-17T15:20:18.570 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-17T15:20:18.570 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-17T15:20:18.599 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-17T15:20:18.602 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-17T15:20:18.710 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-17T15:20:18.737 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-17T15:20:18.895 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-17T15:20:18.992 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-17T15:20:19.010 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-17T15:20:19.014 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-17T15:20:19.019 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-17T15:20:19.020 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-17T15:20:19.021 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-17T15:20:19.043 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-17T15:20:19.053 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-17T15:20:19.061 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-17T15:20:19.068 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-17T15:20:19.069 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,702 kB] 2024-04-17T15:20:19.073 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-17T15:20:19.074 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-17T15:20:19.076 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-17T15:20:19.082 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-17T15:20:19.097 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-17T15:20:19.098 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,702 kB] 2024-04-17T15:20:19.113 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-17T15:20:19.156 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-17T15:20:19.158 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.7 kB] 2024-04-17T15:20:19.172 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.7 kB] 2024-04-17T15:20:19.173 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-17T15:20:19.173 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-17T15:20:19.174 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [286 kB] 2024-04-17T15:20:19.179 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-17T15:20:19.187 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-17T15:20:19.199 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [286 kB] 2024-04-17T15:20:19.199 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-17T15:20:19.200 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-17T15:20:19.205 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-17T15:20:19.210 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-17T15:20:19.344 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,075 kB] 2024-04-17T15:20:19.361 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-17T15:20:19.369 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-17T15:20:19.389 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-17T15:20:19.769 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-17T15:20:19.774 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-17T15:20:19.786 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-17T15:20:19.789 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-17T15:20:19.789 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-17T15:20:19.792 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-17T15:20:19.792 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-17T15:20:19.806 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-17T15:20:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-17T15:20:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-17T15:20:19.948 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,075 kB] 2024-04-17T15:20:19.981 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-17T15:20:20.018 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-17T15:20:20.032 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-17T15:20:20.033 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.7 kB] 2024-04-17T15:20:20.035 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-17T15:20:20.036 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.1 kB] 2024-04-17T15:20:20.037 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-17T15:20:20.037 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-17T15:20:20.059 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-17T15:20:20.063 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-17T15:20:20.067 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-17T15:20:20.079 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-17T15:20:20.080 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-17T15:20:20.081 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.7 kB] 2024-04-17T15:20:20.085 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.1 kB] 2024-04-17T15:20:20.086 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-17T15:20:20.086 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-17T15:20:20.090 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-17T15:20:20.095 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-17T15:20:20.231 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-17T15:20:20.260 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-17T15:20:20.313 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-17T15:20:20.342 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-17T15:20:20.421 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-17T15:20:20.452 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-17T15:20:20.479 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-17T15:20:20.508 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-17T15:20:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-17T15:20:20.542 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-17T15:20:25.087 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 12.9 MB in 3s (4,980 kB/s) 2024-04-17T15:20:25.128 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 12.9 MB in 3s (4,998 kB/s) 2024-04-17T15:20:26.457 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T15:20:26.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-17T15:20:26.509 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-04-17T15:20:26.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-17T15:20:26.538 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T15:20:26.591 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-04-17T15:20:26.725 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-17T15:20:26.725 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-17T15:20:26.791 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-04-17T15:20:26.793 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-04-17T15:20:26.885 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T15:20:26.885 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T15:20:26.885 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T15:20:26.886 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T15:20:26.886 INFO:teuthology.orchestra.run.smithi044.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-17T15:20:26.886 INFO:teuthology.orchestra.run.smithi044.stdout: python2.7-minimal 2024-04-17T15:20:26.886 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T15:20:26.887 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-04-17T15:20:26.887 INFO:teuthology.orchestra.run.smithi044.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-17T15:20:26.887 INFO:teuthology.orchestra.run.smithi044.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-17T15:20:26.887 INFO:teuthology.orchestra.run.smithi044.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-17T15:20:26.888 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-04-17T15:20:26.888 INFO:teuthology.orchestra.run.smithi044.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-17T15:20:26.888 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-04-17T15:20:26.889 INFO:teuthology.orchestra.run.smithi044.stdout: thermald 2024-04-17T15:20:26.941 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-04-17T15:20:26.941 INFO:teuthology.orchestra.run.smithi044.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-17T15:20:26.941 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-17T15:20:26.942 INFO:teuthology.orchestra.run.smithi044.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-17T15:20:26.943 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-04-17T15:20:26.943 INFO:teuthology.orchestra.run.smithi044.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-17T15:20:26.972 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T15:20:26.972 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T15:20:26.972 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T15:20:26.973 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T15:20:26.973 INFO:teuthology.orchestra.run.smithi063.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-17T15:20:26.973 INFO:teuthology.orchestra.run.smithi063.stdout: python2.7-minimal 2024-04-17T15:20:26.973 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T15:20:26.975 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-04-17T15:20:26.975 INFO:teuthology.orchestra.run.smithi063.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-17T15:20:26.975 INFO:teuthology.orchestra.run.smithi063.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-17T15:20:26.975 INFO:teuthology.orchestra.run.smithi063.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-17T15:20:26.976 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-04-17T15:20:26.976 INFO:teuthology.orchestra.run.smithi063.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-17T15:20:26.976 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2024-04-17T15:20:26.976 INFO:teuthology.orchestra.run.smithi063.stdout: thermald 2024-04-17T15:20:27.021 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-04-17T15:20:27.021 INFO:teuthology.orchestra.run.smithi063.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-17T15:20:27.021 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-17T15:20:27.021 INFO:teuthology.orchestra.run.smithi063.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-17T15:20:27.022 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2024-04-17T15:20:27.023 INFO:teuthology.orchestra.run.smithi063.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-17T15:20:27.125 INFO:teuthology.orchestra.run.smithi044.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-17T15:20:27.125 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 113 MB of archives. 2024-04-17T15:20:27.125 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-17T15:20:27.125 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-17T15:20:27.204 INFO:teuthology.orchestra.run.smithi063.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-17T15:20:27.204 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 113 MB of archives. 2024-04-17T15:20:27.204 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-17T15:20:27.205 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-17T15:20:28.558 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-17T15:20:28.657 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-17T15:20:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-17T15:20:29.010 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-17T15:20:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-17T15:20:31.157 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-17T15:20:31.158 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-17T15:20:31.251 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-17T15:20:31.251 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-17T15:20:31.251 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-17T15:20:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-17T15:20:31.675 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-17T15:20:31.682 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-17T15:20:31.763 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-17T15:20:32.108 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 113 MB in 5s (24.0 MB/s) 2024-04-17T15:20:32.159 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 113 MB in 5s (24.0 MB/s) 2024-04-17T15:20:32.282 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-17T15:20:32.350 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-17T15:20:34.270 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-17T15:20:34.275 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T15:20:34.343 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-17T15:20:34.347 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T15:20:34.362 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:36.738 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-17T15:20:36.760 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T15:20:36.852 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:36.983 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-17T15:20:37.006 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T15:20:37.077 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:37.341 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-17T15:20:37.362 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T15:20:37.399 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:37.561 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-17T15:20:37.582 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T15:20:37.622 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:43.533 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T15:20:43.652 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T15:20:43.930 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T15:20:43.959 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T15:20:44.046 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T15:20:44.087 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T15:20:44.370 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T15:20:44.391 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-17T15:20:44.402 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-17T15:20:44.440 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-17T15:20:44.507 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T15:20:44.810 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-17T15:20:44.833 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-17T15:20:44.877 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-17T15:20:50.048 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-17T15:20:50.085 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T15:20:50.123 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:50.726 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-17T15:20:50.748 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T15:20:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:52.737 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T15:20:52.859 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T15:20:53.184 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-17T15:20:53.280 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:53.633 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-17T15:20:54.044 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T15:20:54.230 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:54.427 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T15:20:54.802 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-17T15:20:54.923 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:55.066 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-17T15:20:55.186 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:55.586 INFO:teuthology.orchestra.run.smithi044.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-17T15:20:55.586 INFO:teuthology.orchestra.run.smithi044.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-17T15:20:55.586 INFO:teuthology.orchestra.run.smithi044.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-17T15:20:55.586 INFO:teuthology.orchestra.run.smithi044.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-17T15:20:55.762 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:56.527 INFO:teuthology.orchestra.run.smithi063.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-17T15:20:56.527 INFO:teuthology.orchestra.run.smithi063.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-17T15:20:56.527 INFO:teuthology.orchestra.run.smithi063.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-17T15:20:56.527 INFO:teuthology.orchestra.run.smithi063.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-17T15:20:56.696 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:57.189 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:58.138 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:58.590 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-17T15:20:58.783 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-17T15:20:58.910 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:20:58.972 INFO:teuthology.orchestra.run.smithi044.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-17T15:20:58.972 INFO:teuthology.orchestra.run.smithi044.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-17T15:21:00.199 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-17T15:21:00.350 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-17T15:21:00.460 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T15:21:00.513 INFO:teuthology.orchestra.run.smithi063.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-17T15:21:00.514 INFO:teuthology.orchestra.run.smithi063.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-17T15:21:13.518 INFO:teuthology.orchestra.run.smithi044.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-17T15:21:13.518 INFO:teuthology.orchestra.run.smithi044.stdout:Sourcing file `/etc/default/grub' 2024-04-17T15:21:13.522 INFO:teuthology.orchestra.run.smithi044.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T15:21:13.551 INFO:teuthology.orchestra.run.smithi044.stdout:Generating grub configuration file ... 2024-04-17T15:21:13.830 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-17T15:21:13.846 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-17T15:21:14.148 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T15:21:14.155 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T15:21:14.222 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T15:21:14.228 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T15:21:14.396 INFO:teuthology.orchestra.run.smithi044.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T15:21:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T15:21:14.397 INFO:teuthology.orchestra.run.smithi044.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T15:21:14.446 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-04-17T15:21:14.917 DEBUG:teuthology.orchestra.run.smithi044:> dpkg -s linux-image-generic 2024-04-17T15:21:14.942 INFO:teuthology.orchestra.run.smithi044.stdout:Package: linux-image-generic 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Status: install ok installed 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Priority: optional 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Section: kernel 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Installed-Size: 21 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Maintainer: Ubuntu Kernel Team 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: amd64 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Source: linux-meta 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Version: 5.15.0.102.99 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Recommends: thermald 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout:Description: Generic Linux kernel image 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: This package will always depend on the latest generic kernel image 2024-04-17T15:21:14.943 INFO:teuthology.orchestra.run.smithi044.stdout: available. 2024-04-17T15:21:14.944 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-17T15:21:14.944 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-17T15:21:14.944 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-17T15:21:14.944 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-17T15:21:14.944 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2024-04-17T15:21:14.944 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get clean 2024-04-17T15:21:15.087 INFO:teuthology.orchestra.run.smithi063.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-17T15:21:15.087 INFO:teuthology.orchestra.run.smithi063.stdout:Sourcing file `/etc/default/grub' 2024-04-17T15:21:15.110 INFO:teuthology.orchestra.run.smithi063.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T15:21:15.129 INFO:teuthology.orchestra.run.smithi063.stdout:Generating grub configuration file ... 2024-04-17T15:21:15.143 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-04-17T15:21:15.283 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T15:21:15.397 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T15:21:15.472 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-17T15:21:15.488 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-17T15:21:15.500 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T15:21:15.559 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T15:21:15.882 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T15:21:15.888 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T15:21:15.961 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T15:21:15.967 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T15:21:16.141 INFO:teuthology.orchestra.run.smithi063.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T15:21:16.141 INFO:teuthology.orchestra.run.smithi063.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T15:21:16.142 INFO:teuthology.orchestra.run.smithi063.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T15:21:16.176 INFO:teuthology.orchestra.run.smithi063.stdout:done 2024-04-17T15:21:16.666 DEBUG:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 21 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.15.0.102.99 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-17T15:21:16.690 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-17T15:21:16.691 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2024-04-17T15:21:16.691 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2024-04-17T15:21:16.691 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2024-04-17T15:21:16.691 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2024-04-17T15:21:16.691 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-17T15:21:16.691 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-17T15:21:16.691 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-17T15:21:16.691 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-17T15:21:16.691 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-04-17T15:21:16.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2024-04-17T15:21:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T15:21:16.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-17T15:21:16.794 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T15:21:16.899 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2024-04-17T15:21:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-17T15:21:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-17T15:21:17.087 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T15:21:17.152 INFO:teuthology.orchestra.run.smithi044.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-17T15:21:17.152 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T15:21:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T15:21:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T15:21:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T15:21:17.152 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T15:21:17.153 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T15:21:17.153 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T15:21:17.153 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T15:21:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-17T15:21:17.195 DEBUG:teuthology.orchestra.run.smithi044:> dpkg -s linux-image-generic 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Package: linux-image-generic 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Status: install ok installed 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Priority: optional 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Section: kernel 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Installed-Size: 21 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Maintainer: Ubuntu Kernel Team 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: amd64 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Source: linux-meta 2024-04-17T15:21:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:Version: 5.15.0.102.99 2024-04-17T15:21:17.211 INFO:teuthology.orchestra.run.smithi044.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-17T15:21:17.211 INFO:teuthology.orchestra.run.smithi044.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-17T15:21:17.211 INFO:teuthology.orchestra.run.smithi044.stdout:Recommends: thermald 2024-04-17T15:21:17.211 INFO:teuthology.orchestra.run.smithi044.stdout:Description: Generic Linux kernel image 2024-04-17T15:21:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: This package will always depend on the latest generic kernel image 2024-04-17T15:21:17.211 INFO:teuthology.orchestra.run.smithi044.stdout: available. 2024-04-17T15:21:17.212 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-04-17T15:21:17.233 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T15:21:17.257 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.ay0Tu3Hm3L 2024-04-17T15:21:17.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ay0Tu3Hm3L 2024-04-17T15:21:17.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.ay0Tu3Hm3L 2024-04-17T15:21:17.315 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T15:21:17.444 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.ay0Tu3Hm3L is 10KB 2024-04-17T15:21:17.457 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.ay0Tu3Hm3L 2024-04-17T15:21:17.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-17T15:21:17.521 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:21:17.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-17T15:21:17.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-17T15:21:17.597 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-17T15:21:17.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo update-grub 2024-04-17T15:21:18.499 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-04-17T15:21:18.517 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-17T15:21:18.570 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-04-17T15:21:18.751 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-04-17T15:21:18.752 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-04-17T15:21:18.914 INFO:teuthology.orchestra.run.smithi063.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-17T15:21:18.915 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T15:21:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T15:21:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T15:21:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T15:21:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T15:21:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T15:21:18.917 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T15:21:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub' 2024-04-17T15:21:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T15:21:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-04-17T15:21:18.954 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-17T15:21:18.956 DEBUG:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2024-04-17T15:21:19.010 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2024-04-17T15:21:19.011 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2024-04-17T15:21:19.011 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2024-04-17T15:21:19.011 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2024-04-17T15:21:19.011 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 21 2024-04-17T15:21:19.011 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2024-04-17T15:21:19.011 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2024-04-17T15:21:19.012 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2024-04-17T15:21:19.012 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.15.0.102.99 2024-04-17T15:21:19.012 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-17T15:21:19.012 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-17T15:21:19.012 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2024-04-17T15:21:19.012 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2024-04-17T15:21:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2024-04-17T15:21:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2024-04-17T15:21:19.012 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-04-17T15:21:19.059 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.613goN1PYA 2024-04-17T15:21:19.059 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub/grub.cfg /tmp/tmp.613goN1PYA 2024-04-17T15:21:19.113 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-17T15:21:19.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.613goN1PYA 2024-04-17T15:21:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-17T15:21:19.230 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.613goN1PYA is 10KB 2024-04-17T15:21:19.243 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.613goN1PYA 2024-04-17T15:21:19.250 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-17T15:21:19.306 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:21:19.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-17T15:21:19.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-17T15:21:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T15:21:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T15:21:19.383 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-17T15:21:19.384 DEBUG:teuthology.orchestra.run.smithi063:> sudo update-grub 2024-04-17T15:21:19.384 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T15:21:19.389 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T15:21:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T15:21:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T15:21:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T15:21:19.540 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-04-17T15:21:19.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-04-17T15:21:20.612 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub' 2024-04-17T15:21:20.614 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T15:21:20.615 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-04-17T15:21:21.054 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-17T15:21:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-17T15:21:21.337 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T15:21:21.343 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T15:21:21.385 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T15:21:21.391 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T15:21:21.512 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T15:21:21.512 INFO:teuthology.orchestra.run.smithi063.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T15:21:21.512 INFO:teuthology.orchestra.run.smithi063.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T15:21:21.536 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-04-17T15:21:21.538 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-04-17T15:21:49.586 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-17T15:21:49.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T15:21:49.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:21:51.586 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-17T15:21:51.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-17T15:21:51.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:22:08.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-17T15:22:17.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T15:22:17.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:22:26.211 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-17T15:22:35.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-17T15:22:35.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:23:07.668 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-04-17T15:23:08.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-17T15:23:08.621 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-102-generic"... 2024-04-17T15:23:08.621 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-04-17T15:23:08.667 INFO:teuthology.orchestra.run.smithi063.stdout:5.15.0-102-generic 2024-04-17T15:23:08.667 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-17T15:23:08.667 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T15:23:08.667 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-17T15:23:09.668 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-17T15:23:09.668 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T15:23:09.860 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2024-04-17T15:23:09.897 DEBUG:teuthology.parallel:result is None 2024-04-17T15:23:17.041 DEBUG:teuthology.orchestra.remote:timed out 2024-04-17T15:23:29.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T15:23:29.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:23:29.247 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-04-17T15:23:29.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T15:23:29.815 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-17T15:23:29.816 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-04-17T15:23:29.862 INFO:teuthology.orchestra.run.smithi044.stdout:5.15.0-102-generic 2024-04-17T15:23:29.862 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-17T15:23:29.862 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T15:23:29.862 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-17T15:23:30.863 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-17T15:23:30.863 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T15:23:30.945 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2024-04-17T15:23:30.967 DEBUG:teuthology.parallel:result is None 2024-04-17T15:23:30.967 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-17T15:23:30.977 INFO:teuthology.task.internal:Creating test directory... 2024-04-17T15:23:30.977 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T15:23:30.980 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T15:23:30.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-17T15:23:31.038 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-17T15:23:31.094 INFO:teuthology.task.internal:Creating archive directory... 2024-04-17T15:23:31.094 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T15:23:31.096 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T15:23:31.116 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-17T15:23:31.147 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-17T15:23:31.147 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T15:23:31.155 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T15:23:31.176 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T15:23:31.184 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T15:23:31.198 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T15:23:31.208 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T15:23:31.209 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-17T15:23:31.219 INFO:teuthology.task.internal:Configuring sudo... 2024-04-17T15:23:31.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T15:23:31.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T15:23:31.264 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-17T15:23:31.279 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-17T15:23:31.280 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T15:23:31.290 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T15:23:31.310 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T15:23:31.342 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T15:23:31.394 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:23:31.394 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T15:23:31.457 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T15:23:31.462 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T15:23:31.511 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:23:31.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T15:23:31.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-04-17T15:23:31.583 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-04-17T15:23:31.654 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-17T15:23:31.662 INFO:teuthology.task.internal:Starting timer... 2024-04-17T15:23:31.662 INFO:teuthology.run_tasks:Running task pcp... 2024-04-17T15:23:31.729 INFO:teuthology.run_tasks:Running task selinux... 2024-04-17T15:23:31.767 DEBUG:teuthology.task.selinux:Excluding smithi044: OS 'ubuntu' does not support SELinux 2024-04-17T15:23:31.767 DEBUG:teuthology.task.selinux:Excluding smithi063: OS 'ubuntu' does not support SELinux 2024-04-17T15:23:31.767 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-17T15:23:31.768 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-17T15:23:31.768 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-17T15:23:31.768 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-17T15:23:31.841 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-17T15:23:31.860 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-17T15:23:31.861 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi063.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-17T15:31:02.448 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi063.front.sepia.ceph.com')] 2024-04-17T15:31:02.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T15:31:02.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:31:02.532 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-04-17T15:31:02.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-17T15:31:02.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-17T15:31:02.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T15:31:02.687 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-04-17T15:31:02.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-17T15:31:02.763 INFO:teuthology.run_tasks:Running task clock... 2024-04-17T15:31:02.774 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-17T15:31:02.774 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T15:31:02.775 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T15:31:02.777 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T15:31:02.778 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T15:31:02.804 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T15:31:02.804 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Command line: ntpd -gq 2024-04-17T15:31:02.804 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: ---------------------------------------------------- 2024-04-17T15:31:02.804 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T15:31:02.804 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T15:31:02.804 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: corporation. Support and training for ntp-4 are 2024-04-17T15:31:02.804 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: available at https://www.nwtime.org/support 2024-04-17T15:31:02.804 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: ---------------------------------------------------- 2024-04-17T15:31:02.805 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: proto: precision = 0.045 usec (-24) 2024-04-17T15:31:02.805 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: basedate set to 2022-02-04 2024-04-17T15:31:02.805 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: gps base set to 2022-02-06 (week 2196) 2024-04-17T15:31:02.805 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T15:31:02.806 INFO:teuthology.orchestra.run.smithi044.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T15:31:02.806 INFO:teuthology.orchestra.run.smithi044.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T15:31:02.807 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T15:31:02.807 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T15:31:02.807 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T15:31:02.807 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T15:31:02.807 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Listen normally on 3 ens1f0 172.21.15.44:123 2024-04-17T15:31:02.807 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Listen normally on 4 lo [::1]:123 2024-04-17T15:31:02.807 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1572%4]:123 2024-04-17T15:31:02.807 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:02 ntpd[17109]: Listening on routing socket on fd #22 for interface updates 2024-04-17T15:31:02.836 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T15:31:02.836 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Command line: ntpd -gq 2024-04-17T15:31:02.836 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: ---------------------------------------------------- 2024-04-17T15:31:02.836 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T15:31:02.836 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T15:31:02.836 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: corporation. Support and training for ntp-4 are 2024-04-17T15:31:02.836 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: available at https://www.nwtime.org/support 2024-04-17T15:31:02.836 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: ---------------------------------------------------- 2024-04-17T15:31:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: proto: precision = 0.061 usec (-24) 2024-04-17T15:31:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: basedate set to 2022-02-04 2024-04-17T15:31:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: gps base set to 2022-02-06 (week 2196) 2024-04-17T15:31:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T15:31:02.838 INFO:teuthology.orchestra.run.smithi063.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T15:31:02.838 INFO:teuthology.orchestra.run.smithi063.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T15:31:02.839 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T15:31:02.839 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T15:31:02.839 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T15:31:02.839 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T15:31:02.839 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Listen normally on 3 enp3s0f1 172.21.15.63:123 2024-04-17T15:31:02.839 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Listen normally on 4 lo [::1]:123 2024-04-17T15:31:02.839 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8d7%5]:123 2024-04-17T15:31:02.839 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:02 ntpd[17213]: Listening on routing socket on fd #22 for interface updates 2024-04-17T15:31:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:03 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:03 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:03 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:03 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:03 ntpd[17109]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:03 ntpd[17109]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:03 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:03.836 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:03 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:05.804 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:05 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:05 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:05 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:05 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:05 ntpd[17109]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:05 ntpd[17109]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:05.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:05 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:06.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:06.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:06.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:06.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:06 ntpd[17109]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:07.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:07 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:07.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:07 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:07.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:07 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:07.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:07 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:07.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:07 ntpd[17109]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:07.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:07 ntpd[17109]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:07.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:07.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:07.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:07.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:07.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:07 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:08.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:08.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:08.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:08.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:08 ntpd[17109]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:09.804 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:09 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:09.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:09 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:09.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:09 ntpd[17109]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:09.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:09 ntpd[17109]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:09.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:09 ntpd[17109]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:09.805 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:09 ntpd[17109]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:09.805 INFO:teuthology.orchestra.run.smithi044.stdout:17 Apr 15:31:09 ntpd[17109]: ntpd: time slew +0.001362 s 2024-04-17T15:31:09.805 INFO:teuthology.orchestra.run.smithi044.stdout:ntpd: time slew +0.001362s 2024-04-17T15:31:09.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:09 ntpd[17109]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T15:31:09.806 INFO:teuthology.orchestra.run.smithi044.stderr:17 Apr 15:31:09 ntpd[17109]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T15:31:09.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:09.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:09.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:09.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:09.839 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:09 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:09.861 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T15:31:09.861 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-04-17T15:31:09.861 INFO:teuthology.orchestra.run.smithi044.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T15:31:09.862 INFO:teuthology.orchestra.run.smithi044.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T15:31:09.862 INFO:teuthology.orchestra.run.smithi044.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T15:31:09.862 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T15:31:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T15:31:11.838 INFO:teuthology.orchestra.run.smithi063.stdout:17 Apr 15:31:11 ntpd[17213]: ntpd: time slew +0.002009 s 2024-04-17T15:31:11.838 INFO:teuthology.orchestra.run.smithi063.stdout:ntpd: time slew +0.002009s 2024-04-17T15:31:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T15:31:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:17 Apr 15:31:11 ntpd[17213]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T15:31:11.887 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T15:31:11.887 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2024-04-17T15:31:11.887 INFO:teuthology.orchestra.run.smithi063.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T15:31:11.887 INFO:teuthology.orchestra.run.smithi063.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T15:31:11.887 INFO:teuthology.orchestra.run.smithi063.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T15:31:11.887 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T15:31:11.887 INFO:teuthology.run_tasks:Running task install... 2024-04-17T15:31:11.896 DEBUG:teuthology.task.install:project ceph 2024-04-17T15:31:11.896 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}} 2024-04-17T15:31:11.896 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'} 2024-04-17T15:31:11.896 INFO:teuthology.task.install:Using flavor: default 2024-04-17T15:31:11.902 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-17T15:31:11.902 INFO:teuthology.task.install:extra packages: [] 2024-04-17T15:31:11.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-key list | grep Ceph 2024-04-17T15:31:11.903 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-key list | grep Ceph 2024-04-17T15:31:11.972 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T15:31:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T15:31:12.006 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T15:31:12.006 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T15:31:12.007 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-17T15:31:12.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-17T15:31:12.018 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T15:31:12.018 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T15:31:12.019 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-17T15:31:12.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-17T15:31:12.148 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default/ 2024-04-17T15:31:12.148 INFO:teuthology.task.install.deb:Package version is 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:31:12.178 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default/ 2024-04-17T15:31:12.178 INFO:teuthology.task.install.deb:Package version is 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:31:12.429 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:31:12.429 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T15:31:12.443 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-04-17T15:31:12.477 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:31:12.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T15:31:12.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2024-04-17T15:31:12.642 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T15:31:12.731 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T15:31:12.789 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T15:31:12.789 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T15:31:12.814 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T15:31:12.861 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T15:31:12.894 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T15:31:12.908 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T15:31:12.943 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T15:31:12.979 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T15:31:12.981 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T15:31:13.051 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T15:31:13.074 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T15:31:13.126 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T15:31:13.172 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T15:31:13.273 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2024-04-17T15:31:13.288 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2024-04-17T15:31:13.382 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T15:31:13.389 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 29.2 kB in 1s (42.1 kB/s) 2024-04-17T15:31:13.485 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 29.2 kB in 1s (34.8 kB/s) 2024-04-17T15:31:14.364 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-04-17T15:31:14.381 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3101-g5bf3b3a9-1jammy cephadm=19.0.0-3101-g5bf3b3a9-1jammy ceph-mds=19.0.0-3101-g5bf3b3a9-1jammy ceph-mgr=19.0.0-3101-g5bf3b3a9-1jammy ceph-common=19.0.0-3101-g5bf3b3a9-1jammy ceph-fuse=19.0.0-3101-g5bf3b3a9-1jammy ceph-test=19.0.0-3101-g5bf3b3a9-1jammy ceph-volume=19.0.0-3101-g5bf3b3a9-1jammy radosgw=19.0.0-3101-g5bf3b3a9-1jammy python3-rados=19.0.0-3101-g5bf3b3a9-1jammy python3-rgw=19.0.0-3101-g5bf3b3a9-1jammy python3-cephfs=19.0.0-3101-g5bf3b3a9-1jammy python3-rbd=19.0.0-3101-g5bf3b3a9-1jammy libcephfs2=19.0.0-3101-g5bf3b3a9-1jammy libcephfs-dev=19.0.0-3101-g5bf3b3a9-1jammy librados2=19.0.0-3101-g5bf3b3a9-1jammy librbd1=19.0.0-3101-g5bf3b3a9-1jammy rbd-fuse=19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:31:14.446 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-04-17T15:31:14.465 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T15:31:14.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3101-g5bf3b3a9-1jammy cephadm=19.0.0-3101-g5bf3b3a9-1jammy ceph-mds=19.0.0-3101-g5bf3b3a9-1jammy ceph-mgr=19.0.0-3101-g5bf3b3a9-1jammy ceph-common=19.0.0-3101-g5bf3b3a9-1jammy ceph-fuse=19.0.0-3101-g5bf3b3a9-1jammy ceph-test=19.0.0-3101-g5bf3b3a9-1jammy ceph-volume=19.0.0-3101-g5bf3b3a9-1jammy radosgw=19.0.0-3101-g5bf3b3a9-1jammy python3-rados=19.0.0-3101-g5bf3b3a9-1jammy python3-rgw=19.0.0-3101-g5bf3b3a9-1jammy python3-cephfs=19.0.0-3101-g5bf3b3a9-1jammy python3-rbd=19.0.0-3101-g5bf3b3a9-1jammy libcephfs2=19.0.0-3101-g5bf3b3a9-1jammy libcephfs-dev=19.0.0-3101-g5bf3b3a9-1jammy librados2=19.0.0-3101-g5bf3b3a9-1jammy librbd1=19.0.0-3101-g5bf3b3a9-1jammy rbd-fuse=19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:31:14.532 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-17T15:31:14.646 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-04-17T15:31:14.646 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-04-17T15:31:14.711 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-17T15:31:14.712 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-17T15:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T15:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T15:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T15:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T15:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T15:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T15:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T15:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-04-17T15:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T15:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T15:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T15:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T15:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet zip 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T15:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T15:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T15:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T15:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T15:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2024-04-17T15:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: btrfs-tools 2024-04-17T15:31:14.889 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T15:31:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T15:31:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T15:31:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T15:31:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T15:31:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T15:31:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T15:31:14.890 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-04-17T15:31:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T15:31:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T15:31:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T15:31:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-17T15:31:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet zip 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T15:31:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T15:31:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T15:31:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T15:31:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T15:31:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T15:31:14.894 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-04-17T15:31:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: btrfs-tools 2024-04-17T15:31:14.961 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-04-17T15:31:14.961 INFO:teuthology.orchestra.run.smithi063.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-17T15:31:14.961 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-17T15:31:14.961 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-17T15:31:14.961 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-17T15:31:14.961 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-17T15:31:14.961 INFO:teuthology.orchestra.run.smithi063.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-17T15:31:14.962 INFO:teuthology.orchestra.run.smithi063.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-17T15:31:14.963 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-17T15:31:14.964 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-17T15:31:14.964 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-17T15:31:14.964 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-17T15:31:14.964 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-17T15:31:14.964 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-17T15:31:14.964 INFO:teuthology.orchestra.run.smithi063.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-17T15:31:14.996 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-04-17T15:31:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-17T15:31:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-17T15:31:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-17T15:31:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-17T15:31:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-17T15:31:14.996 INFO:teuthology.orchestra.run.smithi044.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-17T15:31:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-17T15:31:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-17T15:31:14.997 INFO:teuthology.orchestra.run.smithi044.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-17T15:31:14.998 INFO:teuthology.orchestra.run.smithi044.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-17T15:31:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-17T15:31:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-17T15:31:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-17T15:31:14.999 INFO:teuthology.orchestra.run.smithi044.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-17T15:31:15.089 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-17T15:31:15.090 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 181 MB of archives. 2024-04-17T15:31:15.090 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-17T15:31:15.090 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T15:31:15.135 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-17T15:31:15.135 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 181 MB of archives. 2024-04-17T15:31:15.135 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-17T15:31:15.135 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T15:31:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [3,554 kB] 2024-04-17T15:31:15.335 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T15:31:15.345 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T15:31:15.385 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T15:31:15.390 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T15:31:15.390 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T15:31:15.427 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T15:31:15.497 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [3,554 kB] 2024-04-17T15:31:15.509 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T15:31:15.516 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T15:31:15.533 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T15:31:15.541 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T15:31:15.542 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T15:31:15.543 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T15:31:15.557 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T15:31:15.561 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T15:31:15.564 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T15:31:15.567 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T15:31:15.568 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T15:31:15.575 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T15:31:15.592 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T15:31:15.599 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T15:31:15.600 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T15:31:15.602 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T15:31:15.613 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T15:31:15.616 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T15:31:15.621 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T15:31:15.621 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T15:31:15.624 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T15:31:15.624 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T15:31:15.625 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T15:31:15.625 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T15:31:15.627 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T15:31:15.627 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T15:31:15.628 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T15:31:15.629 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T15:31:15.631 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T15:31:15.655 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T15:31:15.658 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T15:31:15.662 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T15:31:15.666 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T15:31:15.669 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T15:31:15.670 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T15:31:15.672 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T15:31:15.673 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T15:31:15.674 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T15:31:15.679 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T15:31:15.680 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T15:31:15.681 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T15:31:15.682 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T15:31:15.683 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T15:31:15.701 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T15:31:15.703 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T15:31:15.705 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T15:31:15.706 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T15:31:15.707 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T15:31:15.707 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T15:31:15.727 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T15:31:15.730 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T15:31:15.731 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T15:31:15.732 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T15:31:15.743 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T15:31:15.743 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T15:31:15.744 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T15:31:15.744 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T15:31:15.745 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T15:31:15.745 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T15:31:15.745 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T15:31:15.748 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T15:31:15.750 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T15:31:15.752 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T15:31:15.774 INFO:teuthology.orchestra.run.smithi063.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T15:31:15.775 INFO:teuthology.orchestra.run.smithi063.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T15:31:15.776 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T15:31:15.777 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T15:31:15.778 INFO:teuthology.orchestra.run.smithi063.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T15:31:15.779 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T15:31:15.779 INFO:teuthology.orchestra.run.smithi063.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T15:31:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T15:31:15.780 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T15:31:15.802 INFO:teuthology.orchestra.run.smithi063.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T15:31:15.803 INFO:teuthology.orchestra.run.smithi063.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T15:31:15.804 INFO:teuthology.orchestra.run.smithi063.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T15:31:15.807 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T15:31:15.808 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T15:31:15.809 INFO:teuthology.orchestra.run.smithi063.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T15:31:15.809 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T15:31:15.823 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T15:31:15.824 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T15:31:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T15:31:15.861 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T15:31:15.864 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T15:31:15.868 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T15:31:15.869 INFO:teuthology.orchestra.run.smithi044.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T15:31:15.911 INFO:teuthology.orchestra.run.smithi063.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T15:31:15.912 INFO:teuthology.orchestra.run.smithi063.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T15:31:15.915 INFO:teuthology.orchestra.run.smithi063.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T15:31:15.915 INFO:teuthology.orchestra.run.smithi063.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T15:31:15.916 INFO:teuthology.orchestra.run.smithi044.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T15:31:15.917 INFO:teuthology.orchestra.run.smithi063.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T15:31:15.918 INFO:teuthology.orchestra.run.smithi044.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T15:31:15.923 INFO:teuthology.orchestra.run.smithi044.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T15:31:15.924 INFO:teuthology.orchestra.run.smithi044.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T15:31:15.925 INFO:teuthology.orchestra.run.smithi044.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T15:31:15.969 INFO:teuthology.orchestra.run.smithi044.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T15:31:16.016 INFO:teuthology.orchestra.run.smithi063.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T15:31:16.019 INFO:teuthology.orchestra.run.smithi063.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T15:31:16.019 INFO:teuthology.orchestra.run.smithi063.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T15:31:16.054 INFO:teuthology.orchestra.run.smithi063.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T15:31:16.054 INFO:teuthology.orchestra.run.smithi063.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T15:31:16.061 INFO:teuthology.orchestra.run.smithi063.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T15:31:16.061 INFO:teuthology.orchestra.run.smithi063.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T15:31:16.062 INFO:teuthology.orchestra.run.smithi063.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T15:31:16.063 INFO:teuthology.orchestra.run.smithi063.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T15:31:16.076 INFO:teuthology.orchestra.run.smithi063.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T15:31:16.077 INFO:teuthology.orchestra.run.smithi063.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T15:31:16.084 INFO:teuthology.orchestra.run.smithi063.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T15:31:16.108 INFO:teuthology.orchestra.run.smithi063.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T15:31:16.111 INFO:teuthology.orchestra.run.smithi063.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T15:31:16.112 INFO:teuthology.orchestra.run.smithi063.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T15:31:16.119 INFO:teuthology.orchestra.run.smithi044.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T15:31:16.120 INFO:teuthology.orchestra.run.smithi063.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T15:31:16.121 INFO:teuthology.orchestra.run.smithi044.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T15:31:16.123 INFO:teuthology.orchestra.run.smithi044.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T15:31:16.123 INFO:teuthology.orchestra.run.smithi044.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T15:31:16.125 INFO:teuthology.orchestra.run.smithi044.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T15:31:16.125 INFO:teuthology.orchestra.run.smithi063.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T15:31:16.127 INFO:teuthology.orchestra.run.smithi063.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T15:31:16.128 INFO:teuthology.orchestra.run.smithi063.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T15:31:16.153 INFO:teuthology.orchestra.run.smithi044.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T15:31:16.156 INFO:teuthology.orchestra.run.smithi044.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T15:31:16.157 INFO:teuthology.orchestra.run.smithi063.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T15:31:16.157 INFO:teuthology.orchestra.run.smithi044.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T15:31:16.158 INFO:teuthology.orchestra.run.smithi063.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T15:31:16.164 INFO:teuthology.orchestra.run.smithi063.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T15:31:16.192 INFO:teuthology.orchestra.run.smithi044.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T15:31:16.193 INFO:teuthology.orchestra.run.smithi044.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T15:31:16.196 INFO:teuthology.orchestra.run.smithi063.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T15:31:16.198 INFO:teuthology.orchestra.run.smithi063.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T15:31:16.198 INFO:teuthology.orchestra.run.smithi063.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T15:31:16.202 INFO:teuthology.orchestra.run.smithi063.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T15:31:16.203 INFO:teuthology.orchestra.run.smithi063.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T15:31:16.214 INFO:teuthology.orchestra.run.smithi044.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T15:31:16.215 INFO:teuthology.orchestra.run.smithi044.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T15:31:16.216 INFO:teuthology.orchestra.run.smithi044.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T15:31:16.217 INFO:teuthology.orchestra.run.smithi044.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T15:31:16.217 INFO:teuthology.orchestra.run.smithi044.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T15:31:16.218 INFO:teuthology.orchestra.run.smithi044.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T15:31:16.219 INFO:teuthology.orchestra.run.smithi063.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T15:31:16.220 INFO:teuthology.orchestra.run.smithi063.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T15:31:16.224 INFO:teuthology.orchestra.run.smithi044.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T15:31:16.230 INFO:teuthology.orchestra.run.smithi063.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T15:31:16.234 INFO:teuthology.orchestra.run.smithi063.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T15:31:16.236 INFO:teuthology.orchestra.run.smithi063.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T15:31:16.258 INFO:teuthology.orchestra.run.smithi044.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T15:31:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T15:31:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T15:31:16.287 INFO:teuthology.orchestra.run.smithi044.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T15:31:16.292 INFO:teuthology.orchestra.run.smithi044.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T15:31:16.293 INFO:teuthology.orchestra.run.smithi044.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T15:31:16.295 INFO:teuthology.orchestra.run.smithi044.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T15:31:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T15:31:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T15:31:16.309 INFO:teuthology.orchestra.run.smithi044.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T15:31:16.324 INFO:teuthology.orchestra.run.smithi044.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T15:31:16.325 INFO:teuthology.orchestra.run.smithi044.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T15:31:16.326 INFO:teuthology.orchestra.run.smithi044.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T15:31:16.357 INFO:teuthology.orchestra.run.smithi044.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T15:31:16.358 INFO:teuthology.orchestra.run.smithi044.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T15:31:16.371 INFO:teuthology.orchestra.run.smithi044.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T15:31:16.371 INFO:teuthology.orchestra.run.smithi044.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T15:31:16.372 INFO:teuthology.orchestra.run.smithi044.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T15:31:16.376 INFO:teuthology.orchestra.run.smithi044.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T15:31:16.377 INFO:teuthology.orchestra.run.smithi044.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T15:31:16.577 INFO:teuthology.orchestra.run.smithi044.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3101-g5bf3b3a9-1jammy [3,224 kB] 2024-04-17T15:31:17.173 INFO:teuthology.orchestra.run.smithi044.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [712 kB] 2024-04-17T15:31:17.262 INFO:teuthology.orchestra.run.smithi044.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3101-g5bf3b3a9-1jammy [356 kB] 2024-04-17T15:31:17.336 INFO:teuthology.orchestra.run.smithi044.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3101-g5bf3b3a9-1jammy [32.8 kB] 2024-04-17T15:31:17.337 INFO:teuthology.orchestra.run.smithi044.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3101-g5bf3b3a9-1jammy [180 kB] 2024-04-17T15:31:17.344 INFO:teuthology.orchestra.run.smithi044.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3101-g5bf3b3a9-1jammy [66.9 kB] 2024-04-17T15:31:17.348 INFO:teuthology.orchestra.run.smithi044.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3101-g5bf3b3a9-1jammy [330 kB] 2024-04-17T15:31:17.416 INFO:teuthology.orchestra.run.smithi044.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [6,895 kB] 2024-04-17T15:31:18.100 INFO:teuthology.orchestra.run.smithi063.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3101-g5bf3b3a9-1jammy [3,224 kB] 2024-04-17T15:31:18.194 INFO:teuthology.orchestra.run.smithi044.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3101-g5bf3b3a9-1jammy [112 kB] 2024-04-17T15:31:18.197 INFO:teuthology.orchestra.run.smithi044.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3101-g5bf3b3a9-1jammy [466 kB] 2024-04-17T15:31:18.206 INFO:teuthology.orchestra.run.smithi044.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3101-g5bf3b3a9-1jammy [25.8 MB] 2024-04-17T15:31:20.260 INFO:teuthology.orchestra.run.smithi044.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3101-g5bf3b3a9-1jammy [5,092 kB] 2024-04-17T15:31:20.553 INFO:teuthology.orchestra.run.smithi044.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3101-g5bf3b3a9-1jammy [244 kB] 2024-04-17T15:31:20.609 INFO:teuthology.orchestra.run.smithi044.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3101-g5bf3b3a9-1jammy [124 kB] 2024-04-17T15:31:20.612 INFO:teuthology.orchestra.run.smithi044.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3101-g5bf3b3a9-1jammy [1,525 kB] 2024-04-17T15:31:20.689 INFO:teuthology.orchestra.run.smithi044.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3101-g5bf3b3a9-1jammy [6,258 kB] 2024-04-17T15:31:21.112 INFO:teuthology.orchestra.run.smithi044.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3101-g5bf3b3a9-1jammy [22.8 MB] 2024-04-17T15:31:21.568 INFO:teuthology.orchestra.run.smithi063.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [712 kB] 2024-04-17T15:31:22.301 INFO:teuthology.orchestra.run.smithi044.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3101-g5bf3b3a9-1jammy [14.0 kB] 2024-04-17T15:31:22.301 INFO:teuthology.orchestra.run.smithi044.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3101-g5bf3b3a9-1jammy [870 kB] 2024-04-17T15:31:22.319 INFO:teuthology.orchestra.run.smithi044.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3101-g5bf3b3a9-1jammy [2,437 kB] 2024-04-17T15:31:22.325 INFO:teuthology.orchestra.run.smithi063.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3101-g5bf3b3a9-1jammy [356 kB] 2024-04-17T15:31:22.364 INFO:teuthology.orchestra.run.smithi044.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3101-g5bf3b3a9-1jammy [791 kB] 2024-04-17T15:31:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3101-g5bf3b3a9-1jammy [148 kB] 2024-04-17T15:31:22.395 INFO:teuthology.orchestra.run.smithi044.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3101-g5bf3b3a9-1jammy [2,304 kB] 2024-04-17T15:31:22.481 INFO:teuthology.orchestra.run.smithi044.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3101-g5bf3b3a9-1jammy [8,625 kB] 2024-04-17T15:31:22.642 INFO:teuthology.orchestra.run.smithi063.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3101-g5bf3b3a9-1jammy [32.8 kB] 2024-04-17T15:31:22.683 INFO:teuthology.orchestra.run.smithi063.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3101-g5bf3b3a9-1jammy [180 kB] 2024-04-17T15:31:22.795 INFO:teuthology.orchestra.run.smithi044.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3101-g5bf3b3a9-1jammy [14.2 kB] 2024-04-17T15:31:22.796 INFO:teuthology.orchestra.run.smithi044.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3101-g5bf3b3a9-1jammy [51.6 MB] 2024-04-17T15:31:22.900 INFO:teuthology.orchestra.run.smithi063.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3101-g5bf3b3a9-1jammy [66.9 kB] 2024-04-17T15:31:22.960 INFO:teuthology.orchestra.run.smithi063.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3101-g5bf3b3a9-1jammy [330 kB] 2024-04-17T15:31:23.268 INFO:teuthology.orchestra.run.smithi063.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3101-g5bf3b3a9-1jammy [6,895 kB] 2024-04-17T15:31:24.892 INFO:teuthology.orchestra.run.smithi044.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3101-g5bf3b3a9-1jammy [124 kB] 2024-04-17T15:31:24.895 INFO:teuthology.orchestra.run.smithi044.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3101-g5bf3b3a9-1jammy [38.9 kB] 2024-04-17T15:31:24.896 INFO:teuthology.orchestra.run.smithi044.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3101-g5bf3b3a9-1jammy [13.6 MB] 2024-04-17T15:31:25.261 INFO:teuthology.orchestra.run.smithi044.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3101-g5bf3b3a9-1jammy [91.4 kB] 2024-04-17T15:31:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 181 MB in 10s (17.7 MB/s) 2024-04-17T15:31:26.242 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T15:31:26.347 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-17T15:31:26.352 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T15:31:26.440 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T15:31:26.786 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T15:31:26.813 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T15:31:26.852 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T15:31:27.172 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T15:31:27.198 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T15:31:27.230 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T15:31:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T15:31:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T15:31:27.750 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:31:28.170 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T15:31:28.197 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T15:31:28.237 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:31:28.540 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T15:31:28.567 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T15:31:28.598 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:31:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T15:31:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T15:31:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T15:31:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librados2. 2024-04-17T15:31:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../007-librados2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:29.412 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librados2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:29.848 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librbd1. 2024-04-17T15:31:29.875 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../008-librbd1_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librbd1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:30.343 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T15:31:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:30.409 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rados. 2024-04-17T15:31:30.748 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rados (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:31.115 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T15:31:31.142 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:31:31.307 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-argparse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:31.550 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T15:31:31.567 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:31.600 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cephfs (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:31.903 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T15:31:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:31:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T15:31:32.333 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T15:31:32.373 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T15:31:32.693 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T15:31:32.720 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T15:31:32.759 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T15:31:32.995 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T15:31:33.011 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:33.045 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rbd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:33.381 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T15:31:33.408 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T15:31:33.448 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T15:31:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T15:31:33.753 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T15:31:33.792 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T15:31:34.098 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T15:31:34.111 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T15:31:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T15:31:34.440 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua5.1. 2024-04-17T15:31:34.456 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T15:31:34.490 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T15:31:34.810 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-any. 2024-04-17T15:31:34.837 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-17T15:31:34.876 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T15:31:35.146 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package zip. 2024-04-17T15:31:35.161 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-17T15:31:35.204 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T15:31:35.499 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package unzip. 2024-04-17T15:31:35.514 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T15:31:35.557 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T15:31:35.619 INFO:teuthology.orchestra.run.smithi063.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3101-g5bf3b3a9-1jammy [112 kB] 2024-04-17T15:31:35.925 INFO:teuthology.orchestra.run.smithi063.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3101-g5bf3b3a9-1jammy [466 kB] 2024-04-17T15:31:35.945 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package luarocks. 2024-04-17T15:31:35.971 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T15:31:36.011 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T15:31:36.561 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librgw2. 2024-04-17T15:31:36.587 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../025-librgw2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:36.627 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librgw2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:37.015 INFO:teuthology.orchestra.run.smithi063.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3101-g5bf3b3a9-1jammy [25.8 MB] 2024-04-17T15:31:37.196 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T15:31:37.212 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:37.246 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:37.515 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T15:31:37.531 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T15:31:37.566 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T15:31:37.902 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T15:31:37.929 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:37.968 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libradosstriper1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:38.397 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-common. 2024-04-17T15:31:38.424 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:38.463 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:39.811 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-base. 2024-04-17T15:31:39.837 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:39.878 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-base (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:40.473 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T15:31:40.500 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T15:31:40.531 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T15:31:40.818 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T15:31:40.845 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T15:31:40.884 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T15:31:41.212 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T15:31:41.239 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T15:31:41.279 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T15:31:41.590 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T15:31:41.617 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T15:31:41.656 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T15:31:41.935 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T15:31:41.961 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T15:31:41.993 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T15:31:42.254 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T15:31:42.281 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T15:31:42.321 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T15:31:42.623 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-portend. 2024-04-17T15:31:42.651 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-17T15:31:42.690 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T15:31:43.001 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T15:31:43.028 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T15:31:43.068 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T15:31:43.304 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T15:31:43.331 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T15:31:43.362 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T15:31:43.716 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T15:31:43.743 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T15:31:43.782 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T15:31:44.044 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T15:31:44.060 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T15:31:44.094 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T15:31:44.397 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T15:31:44.424 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T15:31:44.463 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T15:31:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-mako. 2024-04-17T15:31:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T15:31:44.841 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T15:31:45.136 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T15:31:45.163 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T15:31:45.194 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T15:31:45.472 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T15:31:45.499 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T15:31:45.539 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T15:31:45.808 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webob. 2024-04-17T15:31:45.824 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T15:31:45.867 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T15:31:46.162 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T15:31:46.189 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T15:31:46.223 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T15:31:46.481 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T15:31:46.508 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T15:31:46.547 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T15:31:47.034 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-paste. 2024-04-17T15:31:47.061 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T15:31:47.101 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T15:31:47.412 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T15:31:47.428 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T15:31:47.470 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T15:31:47.748 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T15:31:47.775 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T15:31:47.814 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T15:31:48.084 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T15:31:48.100 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T15:31:48.143 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T15:31:48.454 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T15:31:48.481 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T15:31:48.520 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T15:31:48.925 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T15:31:48.953 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T15:31:48.992 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T15:31:49.328 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-idna. 2024-04-17T15:31:49.355 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-17T15:31:49.394 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T15:31:49.673 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T15:31:49.700 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T15:31:49.731 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T15:31:50.000 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests. 2024-04-17T15:31:50.017 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T15:31:50.061 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T15:31:50.347 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T15:31:50.363 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T15:31:50.397 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T15:31:50.700 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T15:31:50.715 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:31:50.758 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:51.188 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T15:31:51.216 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:51.254 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:51.532 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T15:31:51.560 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T15:31:51.590 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T15:31:51.860 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T15:31:51.887 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T15:31:51.926 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T15:31:52.272 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T15:31:52.299 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:52.338 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:52.758 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T15:31:52.785 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:52.824 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mon (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:53.345 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T15:31:53.372 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:53.411 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-osd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:54.498 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph. 2024-04-17T15:31:54.514 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../066-ceph_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:54.556 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:54.859 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T15:31:54.886 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:54.925 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:55.295 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T15:31:55.323 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:55.362 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mds (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:55.765 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephadm. 2024-04-17T15:31:55.792 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../069-cephadm_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:31:55.831 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:56.117 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T15:31:56.144 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T15:31:56.184 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T15:31:56.554 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T15:31:56.581 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T15:31:56.621 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T15:31:57.875 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-babel. 2024-04-17T15:31:57.903 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T15:31:57.942 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T15:31:58.312 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T15:31:58.339 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T15:31:58.378 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T15:31:58.731 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T15:31:58.758 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:31:58.797 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:31:59.120 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T15:31:59.147 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T15:31:59.184 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T15:31:59.470 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-routes. 2024-04-17T15:31:59.498 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T15:31:59.537 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T15:31:59.899 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T15:31:59.926 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:31:59.965 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:01.137 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T15:32:01.153 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T15:32:01.195 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T15:32:01.707 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T15:32:01.734 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T15:32:01.773 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T15:32:02.219 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T15:32:02.235 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T15:32:02.268 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T15:32:02.555 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T15:32:02.583 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T15:32:02.621 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T15:32:03.380 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T15:32:03.408 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:32:03.575 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:04.544 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T15:32:04.572 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T15:32:04.611 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T15:32:04.889 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T15:32:04.916 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T15:32:04.955 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T15:32:05.275 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T15:32:05.303 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T15:32:05.342 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T15:32:05.662 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T15:32:05.689 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-17T15:32:05.736 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T15:32:06.057 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T15:32:06.073 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T15:32:06.115 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T15:32:06.435 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T15:32:06.462 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T15:32:06.501 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T15:32:06.771 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T15:32:06.799 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T15:32:06.829 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T15:32:07.158 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T15:32:07.185 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T15:32:07.224 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T15:32:08.247 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T15:32:08.275 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:32:08.313 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:08.583 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T15:32:08.610 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T15:32:08.641 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T15:32:08.977 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T15:32:09.005 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T15:32:09.044 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T15:32:09.288 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package jq. 2024-04-17T15:32:09.304 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T15:32:09.346 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T15:32:09.591 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package socat. 2024-04-17T15:32:09.607 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T15:32:09.640 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T15:32:09.922 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T15:32:09.947 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T15:32:09.977 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T15:32:10.323 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-test. 2024-04-17T15:32:10.351 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:32:10.389 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-test (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:12.669 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T15:32:12.686 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:32:12.727 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-volume (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:13.006 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T15:32:13.023 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:32:13.064 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs-dev (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:13.394 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T15:32:13.420 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T15:32:13.458 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T15:32:13.771 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T15:32:13.788 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T15:32:13.830 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T15:32:14.225 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T15:32:14.254 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T15:32:14.291 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T15:32:14.714 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package pkg-config. 2024-04-17T15:32:14.742 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T15:32:14.780 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T15:32:15.041 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T15:32:15.058 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T15:32:15.099 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T15:32:15.553 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T15:32:15.581 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T15:32:15.619 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T15:32:15.881 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T15:32:15.909 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T15:32:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T15:32:16.234 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T15:32:16.250 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T15:32:16.283 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T15:32:16.570 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T15:32:16.598 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T15:32:16.636 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T15:32:16.973 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-py. 2024-04-17T15:32:17.001 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-17T15:32:17.039 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T15:32:17.318 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T15:32:17.343 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T15:32:17.384 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T15:32:17.872 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T15:32:17.900 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T15:32:17.938 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T15:32:18.249 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-toml. 2024-04-17T15:32:18.278 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-17T15:32:18.524 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T15:32:18.794 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T15:32:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T15:32:18.851 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T15:32:19.205 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T15:32:19.234 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T15:32:19.272 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T15:32:19.549 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T15:32:19.566 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T15:32:19.607 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T15:32:19.710 INFO:teuthology.orchestra.run.smithi063.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3101-g5bf3b3a9-1jammy [5,092 kB] 2024-04-17T15:32:20.328 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package radosgw. 2024-04-17T15:32:20.356 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../116-radosgw_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:32:20.394 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking radosgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:21.215 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T15:32:21.243 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:32:21.281 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking rbd-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:21.619 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T15:32:21.928 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T15:32:22.037 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T15:32:22.289 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T15:32:22.606 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T15:32:23.018 INFO:teuthology.orchestra.run.smithi044.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T15:32:23.081 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:23.589 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user cephadm....done 2024-04-17T15:32:23.737 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T15:32:24.030 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T15:32:24.289 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T15:32:24.416 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T15:32:24.675 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T15:32:24.942 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T15:32:25.060 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T15:32:25.354 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T15:32:25.723 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T15:32:25.991 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T15:32:26.267 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T15:32:26.493 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T15:32:26.753 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T15:32:27.012 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T15:32:27.272 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-argparse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T15:32:27.783 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T15:32:27.933 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T15:32:28.043 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T15:32:28.285 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T15:32:28.624 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T15:32:28.676 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T15:32:28.739 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T15:32:28.865 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T15:32:29.233 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T15:32:29.359 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T15:32:29.635 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T15:32:29.894 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T15:32:30.179 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T15:32:30.305 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T15:32:31.032 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T15:32:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T15:32:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T15:32:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T15:32:31.836 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T15:32:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T15:32:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T15:32:32.851 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T15:32:33.136 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T15:32:33.462 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T15:32:33.722 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T15:32:33.848 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:34.157 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T15:32:34.483 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T15:32:35.673 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T15:32:35.958 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:32:36.092 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T15:32:36.360 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T15:32:36.486 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T15:32:36.612 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T15:32:36.914 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T15:32:36.988 INFO:teuthology.orchestra.run.smithi063.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3101-g5bf3b3a9-1jammy [244 kB] 2024-04-17T15:32:37.181 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T15:32:37.223 INFO:teuthology.orchestra.run.smithi063.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3101-g5bf3b3a9-1jammy [124 kB] 2024-04-17T15:32:37.328 INFO:teuthology.orchestra.run.smithi063.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3101-g5bf3b3a9-1jammy [1,525 kB] 2024-04-17T15:32:37.441 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:32:37.559 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T15:32:37.844 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T15:32:38.095 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T15:32:38.338 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T15:32:38.597 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T15:32:38.718 INFO:teuthology.orchestra.run.smithi063.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3101-g5bf3b3a9-1jammy [6,258 kB] 2024-04-17T15:32:38.857 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T15:32:39.133 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T15:32:39.259 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T15:32:39.560 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T15:32:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T15:32:39.987 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T15:32:40.288 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T15:32:40.548 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T15:32:40.683 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T15:32:40.808 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T15:32:40.897 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T15:32:41.135 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T15:32:41.261 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T15:32:41.654 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T15:32:41.922 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T15:32:42.057 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T15:32:42.325 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:32:42.451 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T15:32:42.768 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T15:32:43.095 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T15:32:43.204 INFO:teuthology.orchestra.run.smithi063.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3101-g5bf3b3a9-1jammy [22.8 MB] 2024-04-17T15:32:43.388 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T15:32:43.514 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T15:32:43.790 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T15:32:44.108 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T15:32:44.470 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T15:32:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T15:32:45.123 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T15:32:45.467 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T15:32:45.568 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librados2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:45.694 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:45.820 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T15:32:46.156 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:46.283 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libradosstriper1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:46.400 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T15:32:46.694 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librbd1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:46.819 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-modules-core (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:46.946 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:47.164 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T15:32:47.164 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T15:32:47.639 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs-dev (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:47.765 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rados (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:47.891 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librgw2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:48.017 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T15:32:49.355 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rbd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:49.481 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up rbd-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:49.607 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:49.741 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cephfs (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:49.859 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:50.419 INFO:teuthology.orchestra.run.smithi044.stdout:Adding group ceph....done 2024-04-17T15:32:50.805 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user ceph....done 2024-04-17T15:32:50.947 INFO:teuthology.orchestra.run.smithi044.stdout:Setting system user ceph properties....done 2024-04-17T15:32:50.960 INFO:teuthology.orchestra.run.smithi044.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T15:32:51.113 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T15:32:51.443 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T15:32:51.886 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-test (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:52.013 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up radosgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:52.502 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T15:32:52.502 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T15:32:52.977 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-base (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:53.457 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T15:32:53.960 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mds (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:54.192 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T15:32:54.192 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T15:32:54.805 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:55.040 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T15:32:55.040 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T15:32:55.481 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-osd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:55.766 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T15:32:55.766 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T15:32:56.250 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:56.376 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:56.510 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mon (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:56.713 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T15:32:56.713 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T15:32:57.209 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:57.354 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:57.480 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-dashboard (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:57.631 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-volume (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:32:57.993 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T15:32:58.093 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T15:32:58.271 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T15:32:59.005 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T15:32:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T15:32:59.671 DEBUG:teuthology.parallel:result is None 2024-04-17T15:33:05.089 INFO:teuthology.orchestra.run.smithi063.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3101-g5bf3b3a9-1jammy [14.0 kB] 2024-04-17T15:33:05.089 INFO:teuthology.orchestra.run.smithi063.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3101-g5bf3b3a9-1jammy [870 kB] 2024-04-17T15:33:05.493 INFO:teuthology.orchestra.run.smithi063.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3101-g5bf3b3a9-1jammy [2,437 kB] 2024-04-17T15:33:07.435 INFO:teuthology.orchestra.run.smithi063.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3101-g5bf3b3a9-1jammy [791 kB] 2024-04-17T15:33:08.832 INFO:teuthology.orchestra.run.smithi063.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3101-g5bf3b3a9-1jammy [148 kB] 2024-04-17T15:33:09.059 INFO:teuthology.orchestra.run.smithi063.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3101-g5bf3b3a9-1jammy [2,304 kB] 2024-04-17T15:33:12.219 INFO:teuthology.orchestra.run.smithi063.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3101-g5bf3b3a9-1jammy [8,625 kB] 2024-04-17T15:33:19.076 INFO:teuthology.orchestra.run.smithi063.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3101-g5bf3b3a9-1jammy [14.2 kB] 2024-04-17T15:33:19.082 INFO:teuthology.orchestra.run.smithi063.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3101-g5bf3b3a9-1jammy [51.6 MB] 2024-04-17T15:33:54.627 INFO:teuthology.orchestra.run.smithi063.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3101-g5bf3b3a9-1jammy [124 kB] 2024-04-17T15:33:54.728 INFO:teuthology.orchestra.run.smithi063.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3101-g5bf3b3a9-1jammy [38.9 kB] 2024-04-17T15:33:54.769 INFO:teuthology.orchestra.run.smithi063.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3101-g5bf3b3a9-1jammy [13.6 MB] 2024-04-17T15:34:16.202 INFO:teuthology.orchestra.run.smithi063.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/rgw-update-boost-redis/5bf3b3a9b161d70b9aa7806055bdae202e03111c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3101-g5bf3b3a9-1jammy [91.4 kB] 2024-04-17T15:34:16.893 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 181 MB in 3min 1s (999 kB/s) 2024-04-17T15:34:17.057 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T15:34:17.159 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-17T15:34:17.165 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T15:34:17.264 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T15:34:17.584 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T15:34:17.610 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T15:34:17.650 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T15:34:18.128 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T15:34:18.155 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T15:34:18.195 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T15:34:18.757 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T15:34:18.784 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T15:34:18.832 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:34:19.235 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T15:34:19.262 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T15:34:19.302 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:34:19.671 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T15:34:19.698 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T15:34:19.738 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:34:20.058 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T15:34:20.085 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T15:34:20.124 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T15:34:20.444 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librados2. 2024-04-17T15:34:20.471 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../007-librados2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librados2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:20.972 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librbd1. 2024-04-17T15:34:20.998 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../008-librbd1_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:21.038 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librbd1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:21.441 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T15:34:21.457 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:21.500 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:21.802 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rados. 2024-04-17T15:34:21.829 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:21.869 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rados (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:22.197 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T15:34:22.223 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:34:22.263 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-argparse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:22.491 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T15:34:22.506 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:22.541 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cephfs (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:22.836 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T15:34:22.862 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:34:22.902 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:23.213 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T15:34:23.240 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T15:34:23.280 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T15:34:23.608 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T15:34:23.634 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T15:34:23.674 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T15:34:23.935 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T15:34:23.953 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:23.993 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rbd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:24.338 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T15:34:24.365 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T15:34:24.404 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T15:34:24.701 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T15:34:24.717 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T15:34:24.759 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T15:34:25.079 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T15:34:25.105 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T15:34:25.145 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T15:34:25.473 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua5.1. 2024-04-17T15:34:25.500 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T15:34:25.540 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T15:34:25.860 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-any. 2024-04-17T15:34:25.875 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-17T15:34:25.918 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T15:34:26.128 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package zip. 2024-04-17T15:34:26.144 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-17T15:34:26.178 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T15:34:26.490 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package unzip. 2024-04-17T15:34:26.517 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T15:34:26.556 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T15:34:26.960 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package luarocks. 2024-04-17T15:34:26.987 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T15:34:27.026 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T15:34:27.409 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librgw2. 2024-04-17T15:34:27.436 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../025-librgw2_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:27.475 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librgw2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:27.986 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T15:34:28.002 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:28.036 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:28.364 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T15:34:28.390 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T15:34:28.430 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T15:34:28.741 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T15:34:28.768 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:28.816 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libradosstriper1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:29.211 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-common. 2024-04-17T15:34:29.239 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:29.278 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:30.833 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-base. 2024-04-17T15:34:30.860 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:30.917 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-base (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:31.520 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T15:34:31.547 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T15:34:31.595 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T15:34:31.964 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T15:34:31.991 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T15:34:32.039 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T15:34:32.417 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T15:34:32.444 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T15:34:32.484 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T15:34:32.787 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T15:34:32.814 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T15:34:32.853 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T15:34:33.206 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T15:34:33.233 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T15:34:33.281 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T15:34:33.659 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T15:34:33.686 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T15:34:33.734 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T15:34:34.061 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-portend. 2024-04-17T15:34:34.088 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-17T15:34:34.128 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T15:34:34.431 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T15:34:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T15:34:34.497 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T15:34:34.867 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T15:34:34.893 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T15:34:34.950 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T15:34:35.320 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T15:34:35.347 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T15:34:35.386 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T15:34:35.681 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T15:34:35.708 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T15:34:35.747 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T15:34:36.059 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T15:34:36.086 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T15:34:36.125 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T15:34:36.386 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-mako. 2024-04-17T15:34:36.413 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T15:34:36.444 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T15:34:36.731 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T15:34:36.758 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T15:34:36.789 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T15:34:37.092 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T15:34:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T15:34:37.158 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T15:34:37.478 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webob. 2024-04-17T15:34:37.505 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T15:34:37.544 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T15:34:37.889 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T15:34:37.916 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T15:34:37.959 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T15:34:38.250 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T15:34:38.266 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T15:34:38.299 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T15:34:38.553 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-paste. 2024-04-17T15:34:38.579 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T15:34:38.619 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T15:34:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T15:34:38.996 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T15:34:39.038 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T15:34:39.299 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T15:34:39.315 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T15:34:39.349 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T15:34:39.644 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T15:34:39.671 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T15:34:39.710 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T15:34:40.022 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T15:34:40.049 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T15:34:40.088 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T15:34:40.460 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T15:34:40.487 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T15:34:40.526 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T15:34:40.845 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-idna. 2024-04-17T15:34:40.872 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-17T15:34:40.912 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T15:34:41.198 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T15:34:41.225 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T15:34:41.256 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T15:34:41.559 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests. 2024-04-17T15:34:41.586 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T15:34:41.617 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T15:34:41.870 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T15:34:41.886 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T15:34:41.920 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T15:34:42.215 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T15:34:42.230 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:34:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:42.678 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T15:34:42.705 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:42.744 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:43.063 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T15:34:43.091 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T15:34:43.130 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T15:34:43.399 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T15:34:43.427 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T15:34:43.457 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T15:34:43.794 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T15:34:43.821 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:43.860 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:44.438 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T15:34:44.466 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:44.505 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mon (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:45.116 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T15:34:45.144 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:45.183 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-osd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:46.228 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph. 2024-04-17T15:34:46.244 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../066-ceph_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:46.286 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:46.605 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T15:34:46.633 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:46.671 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:47.041 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T15:34:47.069 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:47.108 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mds (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:47.511 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephadm. 2024-04-17T15:34:47.538 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../069-cephadm_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:34:47.577 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:47.888 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T15:34:47.916 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T15:34:47.955 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T15:34:48.307 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T15:34:48.324 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T15:34:48.365 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T15:34:49.346 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-babel. 2024-04-17T15:34:49.373 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T15:34:49.412 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T15:34:49.731 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T15:34:49.758 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T15:34:49.798 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T15:34:50.143 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T15:34:50.170 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:34:50.209 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:50.529 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T15:34:50.556 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T15:34:50.595 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T15:34:50.856 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-routes. 2024-04-17T15:34:50.872 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T15:34:50.906 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T15:34:51.242 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T15:34:51.270 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:34:51.309 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:52.572 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T15:34:52.597 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T15:34:52.639 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T15:34:53.150 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T15:34:53.178 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T15:34:53.217 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T15:34:53.612 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T15:34:53.640 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T15:34:53.678 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T15:34:53.964 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T15:34:53.992 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T15:34:54.031 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T15:34:54.731 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T15:34:54.759 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:34:54.874 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T15:34:55.847 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T15:34:55.885 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T15:34:56.188 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T15:34:56.216 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T15:34:56.255 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T15:34:56.566 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T15:34:56.583 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T15:34:56.624 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T15:34:56.911 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T15:34:56.927 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-17T15:34:56.961 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T15:34:57.264 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T15:34:57.292 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T15:34:57.330 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T15:34:57.633 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T15:34:57.661 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T15:34:57.700 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T15:34:57.986 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T15:34:58.002 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T15:34:58.044 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T15:34:58.364 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T15:34:58.392 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T15:34:58.430 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T15:34:59.069 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T15:34:59.086 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:34:59.127 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:34:59.430 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T15:34:59.458 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T15:34:59.500 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T15:35:00.025 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T15:35:00.060 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T15:35:00.099 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T15:35:00.335 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package jq. 2024-04-17T15:35:00.351 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T15:35:00.385 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T15:35:00.604 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package socat. 2024-04-17T15:35:00.621 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T15:35:00.662 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T15:35:00.974 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T15:35:00.990 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T15:35:01.032 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T15:35:01.413 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-test. 2024-04-17T15:35:01.441 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:35:01.479 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-test (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:03.643 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T15:35:03.670 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3101-g5bf3b3a9-1jammy_all.deb ... 2024-04-17T15:35:03.709 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-volume (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:03.996 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T15:35:04.012 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:35:04.062 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs-dev (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:04.340 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T15:35:04.356 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T15:35:04.389 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T15:35:04.677 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T15:35:04.705 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T15:35:04.744 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T15:35:05.139 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T15:35:05.167 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T15:35:05.206 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T15:35:05.644 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package pkg-config. 2024-04-17T15:35:05.672 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T15:35:05.710 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T15:35:05.971 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T15:35:05.988 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T15:35:06.021 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T15:35:06.483 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T15:35:06.511 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T15:35:06.549 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T15:35:06.877 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T15:35:06.905 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T15:35:06.934 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T15:35:07.213 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T15:35:07.241 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T15:35:07.288 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T15:35:07.602 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T15:35:07.627 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T15:35:07.665 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T15:35:08.043 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-py. 2024-04-17T15:35:08.071 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-17T15:35:08.109 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T15:35:08.421 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T15:35:08.449 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T15:35:08.487 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T15:35:08.966 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T15:35:08.995 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T15:35:09.034 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T15:35:09.344 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-toml. 2024-04-17T15:35:09.372 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-17T15:35:09.410 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T15:35:09.671 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T15:35:09.687 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T15:35:09.721 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T15:35:10.066 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T15:35:10.095 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T15:35:10.132 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T15:35:10.410 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T15:35:10.438 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T15:35:10.476 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T15:35:11.172 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package radosgw. 2024-04-17T15:35:11.201 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../116-radosgw_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:35:11.239 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking radosgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:12.175 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T15:35:12.192 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3101-g5bf3b3a9-1jammy_amd64.deb ... 2024-04-17T15:35:12.233 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking rbd-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:12.546 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T15:35:12.929 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T15:35:13.038 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T15:35:13.323 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T15:35:13.670 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T15:35:14.143 INFO:teuthology.orchestra.run.smithi063.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T15:35:14.509 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:15.682 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user cephadm....done 2024-04-17T15:35:15.945 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T15:35:16.341 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T15:35:16.618 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T15:35:16.726 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T15:35:16.969 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T15:35:17.229 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T15:35:17.354 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T15:35:17.673 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T15:35:18.100 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T15:35:18.368 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T15:35:18.702 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T15:35:18.920 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T15:35:19.188 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T15:35:19.455 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T15:35:19.715 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-argparse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:19.999 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T15:35:20.150 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T15:35:20.301 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T15:35:20.452 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T15:35:20.713 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T15:35:21.109 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T15:35:21.142 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T15:35:21.206 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T15:35:21.332 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T15:35:21.733 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T15:35:21.884 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T15:35:22.169 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T15:35:22.428 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T15:35:22.737 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T15:35:22.864 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T15:35:23.557 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T15:35:23.833 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T15:35:23.993 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T15:35:24.143 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T15:35:24.453 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T15:35:24.837 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T15:35:25.113 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T15:35:25.523 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T15:35:25.841 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T15:35:26.218 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T15:35:26.469 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T15:35:26.569 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:26.879 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T15:35:27.214 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T15:35:28.435 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T15:35:28.687 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:35:28.830 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T15:35:29.106 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T15:35:29.240 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T15:35:29.391 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T15:35:29.726 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T15:35:30.002 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T15:35:30.261 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:35:30.387 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T15:35:30.697 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T15:35:30.957 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T15:35:31.233 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T15:35:31.508 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T15:35:31.776 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T15:35:32.019 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T15:35:32.145 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T15:35:32.446 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T15:35:32.581 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T15:35:32.865 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T15:35:33.225 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T15:35:33.492 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T15:35:33.643 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T15:35:33.794 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T15:35:33.892 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T15:35:34.145 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T15:35:34.280 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T15:35:34.698 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T15:35:34.974 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T15:35:35.100 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T15:35:35.351 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T15:35:35.502 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T15:35:35.836 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T15:35:36.146 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T15:35:36.430 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T15:35:36.556 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T15:35:36.841 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T15:35:37.134 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T15:35:37.503 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T15:35:37.897 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T15:35:38.198 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T15:35:38.551 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T15:35:38.652 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librados2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:38.761 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:38.887 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T15:35:39.223 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:39.357 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libradosstriper1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:39.508 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T15:35:39.810 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librbd1 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:39.911 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-modules-core (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:40.037 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:40.261 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T15:35:40.262 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T15:35:40.730 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs-dev (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:40.856 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rados (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:41.007 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librgw2 (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:41.157 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T15:35:42.478 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rbd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:42.604 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up rbd-fuse (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:42.730 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:42.864 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cephfs (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:42.990 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-common (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:43.600 INFO:teuthology.orchestra.run.smithi063.stdout:Adding group ceph....done 2024-04-17T15:35:43.934 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user ceph....done 2024-04-17T15:35:44.128 INFO:teuthology.orchestra.run.smithi063.stdout:Setting system user ceph properties....done 2024-04-17T15:35:44.142 INFO:teuthology.orchestra.run.smithi063.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T15:35:44.287 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T15:35:44.634 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T15:35:45.125 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-test (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:45.275 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up radosgw (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:45.885 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T15:35:45.885 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T15:35:46.640 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-base (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:46.967 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T15:35:47.425 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mds (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:47.661 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T15:35:47.662 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T15:35:48.168 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:48.399 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T15:35:48.399 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T15:35:48.894 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-osd (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:49.197 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T15:35:49.197 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T15:35:49.704 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:49.838 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:49.990 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mon (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:50.209 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T15:35:50.209 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T15:35:50.691 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-cephadm (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:50.825 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:50.926 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-dashboard (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:51.077 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-volume (19.0.0-3101-g5bf3b3a9-1jammy) ... 2024-04-17T15:35:51.438 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T15:35:51.547 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T15:35:51.708 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T15:35:52.987 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T15:35:53.644 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T15:35:53.652 DEBUG:teuthology.parallel:result is None 2024-04-17T15:35:53.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-17T15:35:53.903 DEBUG:teuthology.orchestra.run.smithi044:> dpkg-query -W -f '${Version}' ceph 2024-04-17T15:35:53.924 INFO:teuthology.orchestra.run.smithi044.stdout:19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:35:53.924 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:35:53.924 INFO:teuthology.task.install:The correct ceph version 19.0.0-3101-g5bf3b3a9-1jammy is installed. 2024-04-17T15:35:53.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-17T15:35:54.152 DEBUG:teuthology.orchestra.run.smithi063:> dpkg-query -W -f '${Version}' ceph 2024-04-17T15:35:54.172 INFO:teuthology.orchestra.run.smithi063.stdout:19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:35:54.172 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3101-g5bf3b3a9-1jammy 2024-04-17T15:35:54.172 INFO:teuthology.task.install:The correct ceph version 19.0.0-3101-g5bf3b3a9-1jammy is installed. 2024-04-17T15:35:54.174 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-17T15:35:54.174 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:54.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T15:35:54.191 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:35:54.191 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T15:35:54.229 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-17T15:35:54.230 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:54.230 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T15:35:54.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T15:35:54.302 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:35:54.302 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T15:35:54.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T15:35:54.375 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-17T15:35:54.375 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:54.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T15:35:54.388 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T15:35:54.445 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:35:54.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T15:35:54.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T15:35:54.515 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-17T15:35:54.516 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:54.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T15:35:54.530 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T15:35:54.589 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:35:54.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T15:35:54.603 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T15:35:54.659 INFO:teuthology.run_tasks:Running task ceph... 2024-04-17T15:35:54.755 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-17T15:35:54.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-04-17T15:35:54.757 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-04-17T15:35:54.771 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-17T15:35:54.771 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T15:35:54.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T15:35:54.828 INFO:tasks.ceph:Creating extra log directories... 2024-04-17T15:35:54.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T15:35:54.870 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T15:35:54.893 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-17T15:35:54.893 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-17T15:35:54.894 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437', 'branch': 'rgw-update-boost-redis', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7660437', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rgw-update-boost-redis'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rgw-update-boost-redis', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}}, 'owner': 'scheduled_suriarte@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'rgw-update-boost-redis', 'suite_path': '/home/teuthworker/src/github.com_samarahu_ceph_5bf3b3a9b161d70b9aa7806055bdae202e03111c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/samarahu/ceph.git', 'suite_sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c', 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOUEALxH9IKQVeHxGeRU2BApbWMK5NqFjSUQqxGCmdrRWh6eQmZnTNpFj7eaXt1Bdz1lOfdzlZUkI9pUvXja29k=', 'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbVCOemABmPc/8qEmqtPLsyonnPsA96SEBP9Bm2/q/J1VqHo9wX37dxX+gCDq7g6423kzR7Fjnv2LbA2I13q/4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-17_14:05:14', 'tube': 'smithi', 'user': 'suriarte', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-17T15:35:54.894 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T15:35:54.927 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T15:35:54.932 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T15:35:54.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T15:35:54.987 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:54.987 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T15:35:55.034 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T15:35:55.034 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-04-17T15:35:55.082 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T15:35:55.082 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T15:35:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-04-17T15:35:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T15:35:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-04-17 15:27:42.344320428 +0000 2024-04-17T15:35:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 15:27:42.340320462 +0000 2024-04-17T15:35:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 15:27:42.340320462 +0000 2024-04-17T15:35:55.082 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-04-17T15:35:55.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T15:35:55.136 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-04-17T15:35:55.136 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-04-17T15:35:55.136 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000390736 s, 1.3 MB/s 2024-04-17T15:35:55.137 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T15:35:55.192 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-04-17T15:35:55.242 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T15:35:55.242 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T15:35:55.242 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-04-17T15:35:55.242 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T15:35:55.242 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-04-17 15:27:43.068313956 +0000 2024-04-17T15:35:55.242 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 15:27:42.816316209 +0000 2024-04-17T15:35:55.242 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 15:27:42.816316209 +0000 2024-04-17T15:35:55.242 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-04-17T15:35:55.243 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T15:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-04-17T15:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-04-17T15:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000380248 s, 1.3 MB/s 2024-04-17T15:35:55.297 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T15:35:55.347 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-04-17T15:35:55.395 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T15:35:55.395 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T15:35:55.395 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-17T15:35:55.395 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T15:35:55.395 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-04-17 15:27:43.320311703 +0000 2024-04-17T15:35:55.395 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 15:27:43.316311740 +0000 2024-04-17T15:35:55.396 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 15:27:43.316311740 +0000 2024-04-17T15:35:55.396 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-04-17T15:35:55.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T15:35:55.453 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-04-17T15:35:55.453 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-04-17T15:35:55.453 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000401381 s, 1.3 MB/s 2024-04-17T15:35:55.454 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T15:35:55.508 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-04-17T15:35:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T15:35:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T15:35:55.558 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-04-17T15:35:55.558 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T15:35:55.558 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-04-17 15:27:44.116304590 +0000 2024-04-17T15:35:55.558 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-17 15:27:43.828307164 +0000 2024-04-17T15:35:55.558 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-17 15:27:43.828307164 +0000 2024-04-17T15:35:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-04-17T15:35:55.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T15:35:55.612 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-04-17T15:35:55.612 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-04-17T15:35:55.612 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000346992 s, 1.5 MB/s 2024-04-17T15:35:55.613 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T15:35:55.663 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T15:35:55.663 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:35:55.663 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T15:35:55.669 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T15:35:55.669 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-04-17T15:35:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T15:35:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T15:35:55.717 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-04-17T15:35:55.717 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T15:35:55.717 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-04-17 15:27:42.606975886 +0000 2024-04-17T15:35:55.717 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-04-17 15:27:42.342935211 +0000 2024-04-17T15:35:55.717 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-04-17 15:27:42.342935211 +0000 2024-04-17T15:35:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-04-17T15:35:55.717 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T15:35:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-04-17T15:35:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-04-17T15:35:55.771 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000437295 s, 1.2 MB/s 2024-04-17T15:35:55.772 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T15:35:55.821 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-04-17T15:35:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T15:35:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T15:35:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-17T15:35:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T15:35:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-04-17 15:27:43.091050115 +0000 2024-04-17T15:35:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-04-17 15:27:42.819008547 +0000 2024-04-17T15:35:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-04-17 15:27:42.819008547 +0000 2024-04-17T15:35:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-04-17T15:35:55.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T15:35:55.922 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-04-17T15:35:55.922 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-04-17T15:35:55.923 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000385831 s, 1.3 MB/s 2024-04-17T15:35:55.924 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T15:35:55.973 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-04-17T15:35:56.020 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T15:35:56.020 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T15:35:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-17T15:35:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T15:35:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-04-17 15:27:43.587124549 +0000 2024-04-17T15:35:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-04-17 15:27:43.327085531 +0000 2024-04-17T15:35:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-04-17 15:27:43.327085531 +0000 2024-04-17T15:35:56.020 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-04-17T15:35:56.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T15:35:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-04-17T15:35:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-04-17T15:35:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000339489 s, 1.5 MB/s 2024-04-17T15:35:56.075 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T15:35:56.127 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-04-17T15:35:56.176 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T15:35:56.176 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T15:35:56.176 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-04-17T15:35:56.176 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T15:35:56.176 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-04-17 15:27:44.071196792 +0000 2024-04-17T15:35:56.176 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-04-17 15:27:43.795155764 +0000 2024-04-17T15:35:56.176 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-04-17 15:27:43.795155764 +0000 2024-04-17T15:35:56.177 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-04-17T15:35:56.177 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T15:35:56.230 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-04-17T15:35:56.231 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-04-17T15:35:56.231 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000378164 s, 1.4 MB/s 2024-04-17T15:35:56.232 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T15:35:56.281 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T15:35:56.281 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T15:35:56.281 INFO:tasks.ceph:Generating config... 2024-04-17T15:35:56.282 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-04-17T15:35:56.283 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-17T15:35:56.283 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-17T15:35:56.283 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-17T15:35:56.283 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-17T15:35:56.283 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-17T15:35:56.283 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-17T15:35:56.283 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-17T15:35:56.283 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-17T15:35:56.283 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-17T15:35:56.283 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-17T15:35:56.283 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-17T15:35:56.283 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-17T15:35:56.283 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-17T15:35:56.284 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-17T15:35:56.284 INFO:tasks.ceph:Setting up mon.a... 2024-04-17T15:35:56.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-17T15:35:56.320 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-04-17T15:35:56.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-17T15:35:56.415 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T15:35:56.469 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.c', '[v2:172.21.15.44:3301,v1:172.21.15.44:6790]'), ('mon.b', '172.21.15.63')] 2024-04-17T15:35:56.470 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.63'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-17T15:35:56.471 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:56.471 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T15:35:56.522 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --addv c '[v2:172.21.15.44:3301,v1:172.21.15.44:6790]' --add b 172.21.15.63 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid b60ce601-dc23-41b0-bc9a-dbbec538ec02 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:fsid b60ce601-dc23-41b0-bc9a-dbbec538ec02 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-04-17T15:35:56.611688+0000 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-04-17T15:35:56.611688+0000 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 17 (quincy) 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-04-17T15:35:56.610 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.b 2024-04-17T15:35:56.611 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.c 2024-04-17T15:35:56.611 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-17T15:35:56.612 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T15:35:56.617 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b60ce601-dc23-41b0-bc9a-dbbec538ec02... 2024-04-17T15:35:56.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T15:35:56.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T15:35:56.688 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-04-17T15:35:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-04-17T15:35:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T15:35:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-04-17T15:35:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T15:35:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.63" 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = b60ce601-dc23-41b0-bc9a-dbbec538ec02 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-04-17T15:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-04-17T15:35:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-04-17T15:35:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-04-17T15:35:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: bdev async discard = True 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: bdev enable discard = True 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore allocator = bitmap 2024-04-17T15:35:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 1/20 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 1/20 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 4/10 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: osd blocked scrub grace period = 3600 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: osd max markdown count = 1000 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: osd shutdown pgref assert = True 2024-04-17T15:35:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-04-17T15:35:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T15:35:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: rgw relaxed s3 bucket names = True 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-04-17T15:35:56.698 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-04-17T15:35:56.699 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-04-17T15:35:56.699 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-04-17T15:35:56.699 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-04-17T15:35:56.699 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T15:35:56.699 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-04-17T15:35:56.699 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T15:35:56.700 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T15:35:56.701 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-04-17T15:35:56.702 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.63" 2024-04-17T15:35:56.703 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = b60ce601-dc23-41b0-bc9a-dbbec538ec02 2024-04-17T15:35:56.703 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.703 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-04-17T15:35:56.703 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-04-17T15:35:56.704 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-04-17T15:35:56.705 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 1/20 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 1/20 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-04-17T15:35:56.706 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 4/10 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: osd blocked scrub grace period = 3600 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: osd max markdown count = 1000 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: osd shutdown pgref assert = True 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-04-17T15:35:56.707 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-04-17T15:35:56.708 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-04-17T15:35:56.709 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-04-17T15:35:56.710 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-04-17T15:35:56.710 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-04-17T15:35:56.710 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T15:35:56.710 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T15:35:56.710 INFO:teuthology.orchestra.run.smithi063.stdout: rgw relaxed s3 bucket names = True 2024-04-17T15:35:56.710 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-04-17T15:35:56.710 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-04-17T15:35:56.710 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-04-17T15:35:56.711 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-17T15:35:56.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-17T15:35:56.806 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-17T15:35:56.806 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:56.806 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-17T15:35:56.812 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:56.812 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-17T15:35:56.862 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:35:56.862 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:56.862 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T15:35:56.862 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T15:35:56.928 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:35:56.928 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:35:56.978 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:35:56.978 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:35:56.978 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T15:35:56.978 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T15:35:57.001 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:35:57.001 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:35:57.048 INFO:tasks.ceph:Setting up mon nodes... 2024-04-17T15:35:57.048 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-17T15:35:57.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T15:35:57.091 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T15:35:57.094 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T15:35:57.140 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T15:35:57.157 INFO:tasks.ceph:Setting up mds nodes... 2024-04-17T15:35:57.157 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-17T15:35:57.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-17T15:35:57.193 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-17T15:35:57.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-17T15:35:57.242 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-17T15:35:57.254 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-17T15:35:57.254 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T15:35:57.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-17T15:35:57.268 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T15:35:57.268 INFO:tasks.ceph:role: osd.0 2024-04-17T15:35:57.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:35:57.268 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T15:35:57.329 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T15:35:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T15:35:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T15:35:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T15:35:57.329 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T15:35:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-04-17T15:35:57.330 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T15:35:57.330 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T15:35:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T15:35:57.330 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T15:35:57.804 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-04-17T15:35:57.806 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-04-17T15:35:57.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-17T15:35:57.959 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-17T15:35:57.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:35:57.972 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T15:35:57.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-17T15:35:58.027 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T15:35:58.027 INFO:tasks.ceph:role: osd.1 2024-04-17T15:35:58.027 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:35:58.027 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T15:35:58.090 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T15:35:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T15:35:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T15:35:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T15:35:58.090 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T15:35:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-04-17T15:35:58.090 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T15:35:58.091 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T15:35:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T15:35:58.091 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T15:35:58.538 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-04-17T15:35:58.540 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-04-17T15:35:58.540 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-17T15:35:58.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-17T15:35:58.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:35:58.674 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T15:35:58.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-17T15:35:58.727 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T15:35:58.727 INFO:tasks.ceph:role: osd.2 2024-04-17T15:35:58.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:35:58.727 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T15:35:58.789 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T15:35:58.790 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T15:35:59.239 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-04-17T15:35:59.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-04-17T15:35:59.242 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-17T15:35:59.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-17T15:35:59.372 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T15:35:59.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:35:59.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-17T15:35:59.430 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T15:35:59.430 INFO:tasks.ceph:role: osd.3 2024-04-17T15:35:59.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:35:59.430 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T15:35:59.496 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T15:35:59.496 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T15:35:59.496 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T15:35:59.496 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T15:35:59.496 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T15:35:59.496 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-04-17T15:35:59.496 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T15:35:59.497 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T15:35:59.497 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T15:35:59.497 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T15:35:59.985 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-04-17T15:35:59.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-04-17T15:35:59.987 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-17T15:36:00.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-17T15:36:00.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:36:00.143 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T15:36:00.144 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:00.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:00.247+0000 7f780c8ab7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-17T15:36:00.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:00.251+0000 7f780c8ab7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-17T15:36:00.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:00.251+0000 7f780c8ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T15:36:00.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:00.251+0000 7f780c8ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T15:36:00.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:00.251+0000 7f780c8ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T15:36:00.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:00.251+0000 7f780c8ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-17T15:36:03.241 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-17T15:36:03.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:03.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:03.331+0000 7fb18e0057c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-17T15:36:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:03.335+0000 7fb18e0057c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-17T15:36:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:03.335+0000 7fb18e0057c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T15:36:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:03.335+0000 7fb18e0057c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T15:36:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:03.335+0000 7fb18e0057c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T15:36:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:03.335+0000 7fb18e0057c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-17T15:36:06.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-17T15:36:06.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:06.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:06.439+0000 7f86ddd607c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-17T15:36:06.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:06.439+0000 7f86ddd607c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-17T15:36:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:06.439+0000 7f86ddd607c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T15:36:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:06.439+0000 7f86ddd607c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T15:36:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:06.439+0000 7f86ddd607c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T15:36:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:06.439+0000 7f86ddd607c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-17T15:36:09.416 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-17T15:36:09.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:09.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:09.550+0000 7f4e48e037c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-17T15:36:09.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:09.550+0000 7f4e48e037c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-17T15:36:09.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:09.550+0000 7f4e48e037c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T15:36:09.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:09.550+0000 7f4e48e037c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T15:36:09.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:09.550+0000 7f4e48e037c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T15:36:09.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-17T15:36:09.550+0000 7f4e48e037c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-17T15:36:12.533 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-17T15:36:12.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-17T15:36:12.606 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T15:36:12.606 INFO:tasks.ceph:role: osd.4 2024-04-17T15:36:12.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:36:12.606 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T15:36:12.670 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T15:36:12.670 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T15:36:12.670 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T15:36:12.671 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T15:36:12.671 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T15:36:12.671 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-04-17T15:36:12.671 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T15:36:12.671 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T15:36:12.671 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T15:36:12.671 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T15:36:13.126 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-04-17T15:36:13.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-04-17T15:36:13.129 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-17T15:36:13.224 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-17T15:36:13.233 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T15:36:13.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:36:13.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-17T15:36:13.284 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T15:36:13.285 INFO:tasks.ceph:role: osd.5 2024-04-17T15:36:13.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:36:13.285 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T15:36:13.347 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T15:36:13.347 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T15:36:13.348 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T15:36:13.348 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T15:36:13.348 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T15:36:13.348 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-04-17T15:36:13.348 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T15:36:13.348 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T15:36:13.348 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T15:36:13.348 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T15:36:13.812 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-04-17T15:36:13.814 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-04-17T15:36:13.814 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-17T15:36:13.960 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-17T15:36:13.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:36:13.972 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T15:36:13.972 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-17T15:36:14.027 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T15:36:14.027 INFO:tasks.ceph:role: osd.6 2024-04-17T15:36:14.027 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:36:14.027 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T15:36:14.092 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T15:36:14.093 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T15:36:14.566 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-04-17T15:36:14.568 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-04-17T15:36:14.569 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-17T15:36:14.724 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-17T15:36:14.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:36:14.736 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T15:36:14.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-17T15:36:14.796 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T15:36:14.796 INFO:tasks.ceph:role: osd.7 2024-04-17T15:36:14.796 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:36:14.796 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T15:36:14.864 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T15:36:15.285 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-04-17T15:36:15.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-04-17T15:36:15.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-17T15:36:15.381 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-17T15:36:15.393 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T15:36:15.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:36:15.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:15.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:15.495+0000 7f1ea2ad17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-17T15:36:15.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:15.499+0000 7f1ea2ad17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-17T15:36:15.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:15.499+0000 7f1ea2ad17c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T15:36:15.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:15.499+0000 7f1ea2ad17c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T15:36:15.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:15.499+0000 7f1ea2ad17c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T15:36:15.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:15.503+0000 7f1ea2ad17c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-17T15:36:18.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-17T15:36:18.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:18.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:18.579+0000 7f9928f157c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-17T15:36:18.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:18.579+0000 7f9928f157c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-17T15:36:18.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:18.579+0000 7f9928f157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T15:36:18.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:18.579+0000 7f9928f157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T15:36:18.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:18.579+0000 7f9928f157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T15:36:18.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:18.583+0000 7f9928f157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-17T15:36:21.573 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-17T15:36:21.629 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:21.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:21.711+0000 7f53f26d27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-17T15:36:21.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:21.711+0000 7f53f26d27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-17T15:36:21.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:21.711+0000 7f53f26d27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T15:36:21.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:21.711+0000 7f53f26d27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T15:36:21.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:21.711+0000 7f53f26d27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T15:36:21.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:21.711+0000 7f53f26d27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-17T15:36:24.692 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-17T15:36:24.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:24.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:24.827+0000 7f9427e887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-17T15:36:24.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:24.831+0000 7f9427e887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-17T15:36:24.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:24.831+0000 7f9427e887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T15:36:24.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:24.831+0000 7f9427e887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T15:36:24.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:24.831+0000 7f9427e887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T15:36:24.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-04-17T15:36:24.831+0000 7f9427e887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-17T15:36:27.806 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-17T15:36:27.861 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-17T15:36:27.862 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:27.862 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-17T15:36:27.876 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:27.877 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-17T15:36:27.933 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:27.933 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-17T15:36:27.989 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:27.990 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-17T15:36:28.046 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:28.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-17T15:36:28.101 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:28.102 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-17T15:36:28.115 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:28.115 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-17T15:36:28.171 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:28.171 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-17T15:36:28.228 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:28.228 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-17T15:36:28.284 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:28.284 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-17T15:36:28.339 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:28.339 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-17T15:36:28.347 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:28.347 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-17T15:36:28.389 INFO:tasks.ceph:Adding keys to all mons... 2024-04-17T15:36:28.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T15:36:28.396 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T15:36:28.434 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBd7B9mTeSRBRAAejsyC+8wKKkOf/CTnkoV2w== 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBg7B9mTy0fDxAAIKKIxbpsIiSSRffeOqWjAw== 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBj7B9m6bUuFBAAQGnEOZQQ1v89m+sXNKWMpA== 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBm7B9mlm90GhAARUeV9QaXkhAmZhgCLYJYwQ== 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBp7B9mUsDsIBAAR18mCJQDnJ2h1YPFUkBIGg== 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBd7B9m2ASSCBAAAjBjUzTpG0S7a73Sjqhhhw== 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBv7B9mOBLiHRAAFNiK2b81hHLGycugwPWwuw== 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2024-04-17T15:36:28.435 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBy7B9mjSfjIhAA9mYoUZBg1HGf5KjD+qs9oA== 2024-04-17T15:36:28.436 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2024-04-17T15:36:28.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQB17B9mukerKhAAA4F/YgqkL/4E4+9XMvg9pg== 2024-04-17T15:36:28.436 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2024-04-17T15:36:28.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQB47B9mCCe4MRAA3TmZMdyq/B47VwhwNIxGsw== 2024-04-17T15:36:28.436 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-04-17T15:36:28.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBd7B9mQLydCxAALW61/jbnMNH7uPXa39uZSg== 2024-04-17T15:36:28.436 INFO:teuthology.orchestra.run.smithi044.stdout:[client.1] 2024-04-17T15:36:28.436 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBd7B9mCYClDhAAb8rhSQvcDM8K79ROSnkuHA== 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBd7B9mTeSRBRAAejsyC+8wKKkOf/CTnkoV2w== 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBg7B9mTy0fDxAAIKKIxbpsIiSSRffeOqWjAw== 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBj7B9m6bUuFBAAQGnEOZQQ1v89m+sXNKWMpA== 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBm7B9mlm90GhAARUeV9QaXkhAmZhgCLYJYwQ== 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBp7B9mUsDsIBAAR18mCJQDnJ2h1YPFUkBIGg== 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBd7B9m2ASSCBAAAjBjUzTpG0S7a73Sjqhhhw== 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-04-17T15:36:28.443 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBv7B9mOBLiHRAAFNiK2b81hHLGycugwPWwuw== 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBy7B9mjSfjIhAA9mYoUZBg1HGf5KjD+qs9oA== 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQB17B9mukerKhAAA4F/YgqkL/4E4+9XMvg9pg== 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQB47B9mCCe4MRAA3TmZMdyq/B47VwhwNIxGsw== 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBd7B9mQLydCxAALW61/jbnMNH7uPXa39uZSg== 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout:[client.1] 2024-04-17T15:36:28.444 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBd7B9mCYClDhAAb8rhSQvcDM8K79ROSnkuHA== 2024-04-17T15:36:28.445 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T15:36:28.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T15:36:28.533 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.536 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.578 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.665 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.748 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.832 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T15:36:28.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T15:36:28.921 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:28.965 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:29.009 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:29.056 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:29.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:29.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:29.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:29.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T15:36:29.272 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T15:36:29.274 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T15:36:29.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T15:36:29.324 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T15:36:29.368 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-17T15:36:29.368 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-17T15:36:29.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T15:36:29.517 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-17T15:36:29.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-17T15:36:29.583 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T15:36:29.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-17T15:36:29.684 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-17T15:36:29.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T15:36:29.798 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-17T15:36:29.811 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:29.813 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T15:36:29.860 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-17T15:36:29.860 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-17T15:36:29.860 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-17T15:36:29.863 INFO:tasks.ceph.mon.a:Started 2024-04-17T15:36:29.863 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-17T15:36:29.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-17T15:36:29.865 INFO:tasks.ceph.mon.c:Started 2024-04-17T15:36:29.865 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-17T15:36:29.865 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-17T15:36:29.905 INFO:tasks.ceph.mon.b:Started 2024-04-17T15:36:29.905 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-17T15:36:29.906 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-17T15:36:29.906 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-17T15:36:29.908 INFO:tasks.ceph.mgr.y:Started 2024-04-17T15:36:29.908 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-17T15:36:29.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-17T15:36:29.910 INFO:tasks.ceph.mgr.x:Started 2024-04-17T15:36:29.911 INFO:tasks.ceph:Setting crush tunables to default 2024-04-17T15:36:29.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-04-17T15:36:35.407 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-04-17T15:36:35.425 INFO:tasks.ceph:check_enable_crimson: False 2024-04-17T15:36:35.425 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-17T15:36:35.426 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:35.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-17T15:36:35.436 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:35.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-17T15:36:35.487 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:35.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-17T15:36:35.525 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:35.522+0000 7ffbeb553180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T15:36:35.530 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:35.527+0000 7fa73c428180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T15:36:35.534 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:36:35.534 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-17T15:36:35.589 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:35.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-17T15:36:35.603 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:35.603 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-17T15:36:35.658 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:35.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-17T15:36:35.711 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-04-17T15:36:35.711 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-17T15:36:35.766 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new c841b259-219b-4f39-a952-8ef354c8a4d3 0 2024-04-17T15:36:36.040 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:36.039+0000 7fa73c428180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T15:36:36.044 INFO:teuthology.orchestra.run.smithi063.stdout:0 2024-04-17T15:36:36.061 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new daffe35c-9fda-4a02-81e2-b40855ff3e24 1 2024-04-17T15:36:36.084 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:36.082+0000 7ffbeb553180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T15:36:36.287 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:36.286+0000 7ffbeb553180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T15:36:36.297 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-04-17T15:36:36.304 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:36.303+0000 7fa73c428180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T15:36:36.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new 653abe6b-68bd-4e83-b0a7-2691e1d0dd0d 2 2024-04-17T15:36:36.514 INFO:teuthology.orchestra.run.smithi063.stdout:2 2024-04-17T15:36:36.530 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new 71cbfda2-d611-49da-b314-284be425b041 3 2024-04-17T15:36:36.728 INFO:teuthology.orchestra.run.smithi063.stdout:3 2024-04-17T15:36:36.744 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new c68cb5c7-9093-418d-be3c-db3e3bd8eab2 4 2024-04-17T15:36:36.883 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:36.882+0000 7ffbeb553180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T15:36:36.884 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:36.883+0000 7fa73c428180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T15:36:36.940 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:36.938+0000 7ffbeb553180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T15:36:36.941 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:36.939+0000 7fa73c428180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T15:36:36.949 INFO:teuthology.orchestra.run.smithi063.stdout:4 2024-04-17T15:36:36.966 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new 638215dd-8efa-4141-8ae7-3aa44152ab5e 5 2024-04-17T15:36:36.996 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:36.994+0000 7ffbeb553180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T15:36:36.998 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:36.995+0000 7fa73c428180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T15:36:37.076 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:37.074+0000 7ffbeb553180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T15:36:37.083 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:37.079+0000 7fa73c428180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T15:36:37.134 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:37.130+0000 7ffbeb553180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T15:36:37.138 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:37.135+0000 7fa73c428180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T15:36:37.163 INFO:teuthology.orchestra.run.smithi063.stdout:5 2024-04-17T15:36:37.179 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new b0cb7f79-bc86-4f01-9185-35d3b5166fc6 6 2024-04-17T15:36:37.213 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:37.210+0000 7ffbeb553180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T15:36:37.220 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:37.219+0000 7fa73c428180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T15:36:37.268 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:37.266+0000 7ffbeb553180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T15:36:37.277 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:37.275+0000 7fa73c428180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T15:36:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:6 2024-04-17T15:36:37.427 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:37.426+0000 7ffbeb553180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T15:36:37.440 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d 7 2024-04-17T15:36:37.451 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:37.451+0000 7fa73c428180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T15:36:37.491 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:37.490+0000 7ffbeb553180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T15:36:37.519 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:37.519+0000 7fa73c428180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T15:36:37.644 INFO:teuthology.orchestra.run.smithi063.stdout:7 2024-04-17T15:36:37.661 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-17T15:36:37.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-17T15:36:37.664 INFO:tasks.ceph.osd.0:Started 2024-04-17T15:36:37.664 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-17T15:36:37.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-17T15:36:37.666 INFO:tasks.ceph.osd.1:Started 2024-04-17T15:36:37.666 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-17T15:36:37.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-17T15:36:37.669 INFO:tasks.ceph.osd.2:Started 2024-04-17T15:36:37.669 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-17T15:36:37.669 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-17T15:36:37.671 INFO:tasks.ceph.osd.3:Started 2024-04-17T15:36:37.671 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-17T15:36:37.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-17T15:36:37.705 INFO:tasks.ceph.osd.4:Started 2024-04-17T15:36:37.705 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-17T15:36:37.705 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-17T15:36:37.707 INFO:tasks.ceph.osd.5:Started 2024-04-17T15:36:37.707 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-17T15:36:37.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-17T15:36:37.709 INFO:tasks.ceph.osd.6:Started 2024-04-17T15:36:37.709 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-17T15:36:37.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-17T15:36:37.710 INFO:tasks.ceph.osd.7:Started 2024-04-17T15:36:37.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:36:37.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:36:37.954 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"b60ce601-dc23-41b0-bc9a-dbbec538ec02","created":"2024-04-17T15:36:35.284161+0000","modified":"2024-04-17T15:36:37.641404+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T15:36:37.641404+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c841b259-219b-4f39-a952-8ef354c8a4d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"daffe35c-9fda-4a02-81e2-b40855ff3e24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"653abe6b-68bd-4e83-b0a7-2691e1d0dd0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"71cbfda2-d611-49da-b314-284be425b041","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c68cb5c7-9093-418d-be3c-db3e3bd8eab2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"638215dd-8efa-4141-8ae7-3aa44152ab5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b0cb7f79-bc86-4f01-9185-35d3b5166fc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:36:37.972 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-17T15:36:37.973 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-17T15:36:38.142 INFO:tasks.ceph.mgr.y.smithi044.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T15:36:38.142 INFO:tasks.ceph.mgr.y.smithi044.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T15:36:38.142 INFO:tasks.ceph.mgr.y.smithi044.stderr: from numpy import show_config as show_numpy_config 2024-04-17T15:36:38.178 INFO:tasks.ceph.mgr.x.smithi063.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T15:36:38.218 INFO:tasks.ceph.mgr.x.smithi063.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T15:36:38.218 INFO:tasks.ceph.mgr.x.smithi063.stderr: from numpy import show_config as show_numpy_config 2024-04-17T15:36:38.220 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:38.218+0000 7ffbeb553180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T15:36:38.257 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:38.255+0000 7fa73c428180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T15:36:38.325 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:36:38.323+0000 7f398203b7c0 -1 Falling back to public interface 2024-04-17T15:36:38.325 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:36:38.323+0000 7f3018a507c0 -1 Falling back to public interface 2024-04-17T15:36:38.330 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:36:38.330+0000 7f29ceaf67c0 -1 Falling back to public interface 2024-04-17T15:36:38.331 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:36:38.330+0000 7f43e93817c0 -1 Falling back to public interface 2024-04-17T15:36:38.332 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:36:38.330+0000 7f83ee9837c0 -1 Falling back to public interface 2024-04-17T15:36:38.336 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:36:38.335+0000 7f35857947c0 -1 Falling back to public interface 2024-04-17T15:36:38.336 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:36:38.335+0000 7f6e09fa07c0 -1 Falling back to public interface 2024-04-17T15:36:38.341 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:36:38.342+0000 7fda226337c0 -1 Falling back to public interface 2024-04-17T15:36:38.415 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:38.414+0000 7ffbeb553180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T15:36:38.452 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:38.451+0000 7fa73c428180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T15:36:38.607 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:38.606+0000 7ffbeb553180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T15:36:38.636 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:38.635+0000 7fa73c428180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T15:36:38.679 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:38.678+0000 7ffbeb553180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T15:36:38.708 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:38.707+0000 7fa73c428180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T15:36:38.779 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T15:36:38.830 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:38.830+0000 7ffbeb553180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T15:36:38.858 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:38.855+0000 7fa73c428180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T15:36:38.960 INFO:teuthology.misc.health.smithi044.stdout: 2024-04-17T15:36:38.960 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"b60ce601-dc23-41b0-bc9a-dbbec538ec02","created":"2024-04-17T15:36:35.284161+0000","modified":"2024-04-17T15:36:37.641404+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T15:36:37.641404+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c841b259-219b-4f39-a952-8ef354c8a4d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"daffe35c-9fda-4a02-81e2-b40855ff3e24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"653abe6b-68bd-4e83-b0a7-2691e1d0dd0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"71cbfda2-d611-49da-b314-284be425b041","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c68cb5c7-9093-418d-be3c-db3e3bd8eab2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"638215dd-8efa-4141-8ae7-3aa44152ab5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b0cb7f79-bc86-4f01-9185-35d3b5166fc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:36:38.977 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-17T15:36:39.482 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:39.482+0000 7ffbeb553180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T15:36:39.534 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:39.531+0000 7fa73c428180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T15:36:39.560 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:39.558+0000 7ffbeb553180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T15:36:39.613 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:39.611+0000 7fa73c428180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T15:36:39.751 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:39.750+0000 7ffbeb553180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T15:36:39.803 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:39.803+0000 7fa73c428180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T15:36:39.828 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:39.826+0000 7ffbeb553180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T15:36:39.881 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:39.879+0000 7fa73c428180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T15:36:40.132 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:40.130+0000 7ffbeb553180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T15:36:40.185 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:40.183+0000 7fa73c428180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T15:36:40.197 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:40.194+0000 7ffbeb553180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T15:36:40.250 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-04-17T15:36:40.247+0000 7fa73c428180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T15:36:41.246 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:41.246+0000 7ffb92899640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-17T15:36:41.246 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-17T15:36:41.246+0000 7ffb92899640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-17T15:36:42.127 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:36:42.126+0000 7f29ceaf67c0 -1 osd.1 0 log_to_monitors true 2024-04-17T15:36:42.174 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:36:42.171+0000 7f35857947c0 -1 osd.7 0 log_to_monitors true 2024-04-17T15:36:42.193 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:36:42.191+0000 7f3018a507c0 -1 osd.6 0 log_to_monitors true 2024-04-17T15:36:42.207 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:36:42.203+0000 7f398203b7c0 -1 osd.5 0 log_to_monitors true 2024-04-17T15:36:42.207 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:36:42.207+0000 7f6e09fa07c0 -1 osd.4 0 log_to_monitors true 2024-04-17T15:36:42.212 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:36:42.210+0000 7fda226337c0 -1 osd.0 0 log_to_monitors true 2024-04-17T15:36:42.222 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:36:42.222+0000 7f43e93817c0 -1 osd.2 0 log_to_monitors true 2024-04-17T15:36:42.257 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:36:42.258+0000 7f83ee9837c0 -1 osd.3 0 log_to_monitors true 2024-04-17T15:36:45.006 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:36:45.006+0000 7f43e532a640 -1 osd.2 0 waiting for initial osdmap 2024-04-17T15:36:45.034 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:36:45.034+0000 7f43dd15e640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T15:36:45.043 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:36:45.042+0000 7fda1edee640 -1 osd.0 0 waiting for initial osdmap 2024-04-17T15:36:45.062 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:36:45.062+0000 7f29caa9f640 -1 osd.1 0 waiting for initial osdmap 2024-04-17T15:36:45.082 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:36:45.082+0000 7fda16410640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T15:36:45.095 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:36:45.094+0000 7f29c28d3640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T15:36:45.453 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:36:45.451+0000 7f358173d640 -1 osd.7 0 waiting for initial osdmap 2024-04-17T15:36:45.458 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:36:45.455+0000 7f30149f9640 -1 osd.6 0 waiting for initial osdmap 2024-04-17T15:36:45.459 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:36:45.455+0000 7f6e05f49640 -1 osd.4 0 waiting for initial osdmap 2024-04-17T15:36:45.463 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:36:45.463+0000 7f397e7f6640 -1 osd.5 0 waiting for initial osdmap 2024-04-17T15:36:45.471 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:36:45.471+0000 7f3579571640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T15:36:45.480 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:36:45.479+0000 7f3975e18640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T15:36:45.480 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:36:45.479+0000 7f300c82d640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T15:36:45.480 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:36:45.479+0000 7f6dfdd7d640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T15:36:45.513 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:36:45.514+0000 7f83ea92c640 -1 osd.3 0 waiting for initial osdmap 2024-04-17T15:36:45.535 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:36:45.534+0000 7f83e2760640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T15:36:45.784 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T15:36:46.102 INFO:teuthology.misc.health.smithi044.stdout: 2024-04-17T15:36:46.102 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":14,"fsid":"b60ce601-dc23-41b0-bc9a-dbbec538ec02","created":"2024-04-17T15:36:35.284161+0000","modified":"2024-04-17T15:36:46.049817+0000","last_up_change":"2024-04-17T15:36:46.049817+0000","last_in_change":"2024-04-17T15:36:37.641404+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c841b259-219b-4f39-a952-8ef354c8a4d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6825","nonce":4073594120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6827","nonce":4073594120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6831","nonce":4073594120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6829","nonce":4073594120}]},"public_addr":"172.21.15.44:6825/4073594120","cluster_addr":"172.21.15.44:6827/4073594120","heartbeat_back_addr":"172.21.15.44:6831/4073594120","heartbeat_front_addr":"172.21.15.44:6829/4073594120","state":["exists","up"]},{"osd":1,"uuid":"daffe35c-9fda-4a02-81e2-b40855ff3e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6801","nonce":3956479268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6803","nonce":3956479268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6807","nonce":3956479268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6805","nonce":3956479268}]},"public_addr":"172.21.15.44:6801/3956479268","cluster_addr":"172.21.15.44:6803/3956479268","heartbeat_back_addr":"172.21.15.44:6807/3956479268","heartbeat_front_addr":"172.21.15.44:6805/3956479268","state":["exists","up"]},{"osd":2,"uuid":"653abe6b-68bd-4e83-b0a7-2691e1d0dd0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6810","nonce":2986857736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6814","nonce":2986857736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6822","nonce":2986857736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6818","nonce":2986857736}]},"public_addr":"172.21.15.44:6810/2986857736","cluster_addr":"172.21.15.44:6814/2986857736","heartbeat_back_addr":"172.21.15.44:6822/2986857736","heartbeat_front_addr":"172.21.15.44:6818/2986857736","state":["exists","up"]},{"osd":3,"uuid":"71cbfda2-d611-49da-b314-284be425b041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6811","nonce":3785559761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6815","nonce":3785559761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6823","nonce":3785559761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6819","nonce":3785559761}]},"public_addr":"172.21.15.44:6811/3785559761","cluster_addr":"172.21.15.44:6815/3785559761","heartbeat_back_addr":"172.21.15.44:6823/3785559761","heartbeat_front_addr":"172.21.15.44:6819/3785559761","state":["exists","up"]},{"osd":4,"uuid":"c68cb5c7-9093-418d-be3c-db3e3bd8eab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6821","nonce":466020694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6825","nonce":466020694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6831","nonce":466020694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6829","nonce":466020694}]},"public_addr":"172.21.15.63:6821/466020694","cluster_addr":"172.21.15.63:6825/466020694","heartbeat_back_addr":"172.21.15.63:6831/466020694","heartbeat_front_addr":"172.21.15.63:6829/466020694","state":["exists","up"]},{"osd":5,"uuid":"638215dd-8efa-4141-8ae7-3aa44152ab5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6802","nonce":1787755738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6806","nonce":1787755738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6814","nonce":1787755738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6810","nonce":1787755738}]},"public_addr":"172.21.15.63:6802/1787755738","cluster_addr":"172.21.15.63:6806/1787755738","heartbeat_back_addr":"172.21.15.63:6814/1787755738","heartbeat_front_addr":"172.21.15.63:6810/1787755738","state":["exists","up"]},{"osd":6,"uuid":"b0cb7f79-bc86-4f01-9185-35d3b5166fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6801","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6803","nonce":1209539994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6805","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6807","nonce":1209539994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6813","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6815","nonce":1209539994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6811","nonce":1209539994}]},"public_addr":"172.21.15.63:6803/1209539994","cluster_addr":"172.21.15.63:6807/1209539994","heartbeat_back_addr":"172.21.15.63:6815/1209539994","heartbeat_front_addr":"172.21.15.63:6811/1209539994","state":["exists","up"]},{"osd":7,"uuid":"dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6817","nonce":573406477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6820","nonce":573406477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6828","nonce":573406477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6824","nonce":573406477}]},"public_addr":"172.21.15.63:6817/573406477","cluster_addr":"172.21.15.63:6820/573406477","heartbeat_back_addr":"172.21.15.63:6828/573406477","heartbeat_front_addr":"172.21.15.63:6824/573406477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:36:46.121 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-17T15:36:46.121 INFO:tasks.ceph:Creating RBD pool 2024-04-17T15:36:46.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-17T15:36:47.055 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'rbd' created 2024-04-17T15:36:47.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-17T15:36:48.057 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-17T15:36:48.086 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-17T15:36:48.087 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-17T15:36:48.087 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-17T15:36:48.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-17T15:36:48.087 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-17T15:36:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:36:48.482 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":125573325},{"type":"v1","addr":"172.21.15.44:6833","nonce":125573325}]},"active_addr":"172.21.15.44:6833/125573325","active_change":"2024-04-17T15:36:40.220932+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2149812035}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":1349008370}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":171485490}]}]} 2024-04-17T15:36:48.490 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-17T15:36:48.490 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-17T15:36:48.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:36:48.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:36:48.792 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"fsid":"b60ce601-dc23-41b0-bc9a-dbbec538ec02","created":"2024-04-17T15:36:35.284161+0000","modified":"2024-04-17T15:36:48.055756+0000","last_up_change":"2024-04-17T15:36:46.049817+0000","last_in_change":"2024-04-17T15:36:37.641404+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T15:36:46.270784+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T15:36:46.444362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c841b259-219b-4f39-a952-8ef354c8a4d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6825","nonce":4073594120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6827","nonce":4073594120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6831","nonce":4073594120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6829","nonce":4073594120}]},"public_addr":"172.21.15.44:6825/4073594120","cluster_addr":"172.21.15.44:6827/4073594120","heartbeat_back_addr":"172.21.15.44:6831/4073594120","heartbeat_front_addr":"172.21.15.44:6829/4073594120","state":["exists","up"]},{"osd":1,"uuid":"daffe35c-9fda-4a02-81e2-b40855ff3e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6801","nonce":3956479268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6803","nonce":3956479268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6807","nonce":3956479268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6805","nonce":3956479268}]},"public_addr":"172.21.15.44:6801/3956479268","cluster_addr":"172.21.15.44:6803/3956479268","heartbeat_back_addr":"172.21.15.44:6807/3956479268","heartbeat_front_addr":"172.21.15.44:6805/3956479268","state":["exists","up"]},{"osd":2,"uuid":"653abe6b-68bd-4e83-b0a7-2691e1d0dd0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6810","nonce":2986857736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6814","nonce":2986857736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6822","nonce":2986857736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6818","nonce":2986857736}]},"public_addr":"172.21.15.44:6810/2986857736","cluster_addr":"172.21.15.44:6814/2986857736","heartbeat_back_addr":"172.21.15.44:6822/2986857736","heartbeat_front_addr":"172.21.15.44:6818/2986857736","state":["exists","up"]},{"osd":3,"uuid":"71cbfda2-d611-49da-b314-284be425b041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6811","nonce":3785559761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6815","nonce":3785559761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6823","nonce":3785559761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6819","nonce":3785559761}]},"public_addr":"172.21.15.44:6811/3785559761","cluster_addr":"172.21.15.44:6815/3785559761","heartbeat_back_addr":"172.21.15.44:6823/3785559761","heartbeat_front_addr":"172.21.15.44:6819/3785559761","state":["exists","up"]},{"osd":4,"uuid":"c68cb5c7-9093-418d-be3c-db3e3bd8eab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6821","nonce":466020694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6825","nonce":466020694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6831","nonce":466020694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6829","nonce":466020694}]},"public_addr":"172.21.15.63:6821/466020694","cluster_addr":"172.21.15.63:6825/466020694","heartbeat_back_addr":"172.21.15.63:6831/466020694","heartbeat_front_addr":"172.21.15.63:6829/466020694","state":["exists","up"]},{"osd":5,"uuid":"638215dd-8efa-4141-8ae7-3aa44152ab5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6802","nonce":1787755738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6806","nonce":1787755738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6814","nonce":1787755738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6810","nonce":1787755738}]},"public_addr":"172.21.15.63:6802/1787755738","cluster_addr":"172.21.15.63:6806/1787755738","heartbeat_back_addr":"172.21.15.63:6814/1787755738","heartbeat_front_addr":"172.21.15.63:6810/1787755738","state":["exists","up"]},{"osd":6,"uuid":"b0cb7f79-bc86-4f01-9185-35d3b5166fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6801","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6803","nonce":1209539994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6805","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6807","nonce":1209539994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6813","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6815","nonce":1209539994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6811","nonce":1209539994}]},"public_addr":"172.21.15.63:6803/1209539994","cluster_addr":"172.21.15.63:6807/1209539994","heartbeat_back_addr":"172.21.15.63:6815/1209539994","heartbeat_front_addr":"172.21.15.63:6811/1209539994","state":["exists","up"]},{"osd":7,"uuid":"dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6817","nonce":573406477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6820","nonce":573406477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6828","nonce":573406477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6824","nonce":573406477}]},"public_addr":"172.21.15.63:6817/573406477","cluster_addr":"172.21.15.63:6820/573406477","heartbeat_back_addr":"172.21.15.63:6828/573406477","heartbeat_front_addr":"172.21.15.63:6824/573406477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.230218+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.131179+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.228760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.255261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.248671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.197037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.153100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.201227+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:36:48.809 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-17T15:36:48.810 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:36:49.103 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:36:49.103 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"fsid":"b60ce601-dc23-41b0-bc9a-dbbec538ec02","created":"2024-04-17T15:36:35.284161+0000","modified":"2024-04-17T15:36:49.058464+0000","last_up_change":"2024-04-17T15:36:46.049817+0000","last_in_change":"2024-04-17T15:36:37.641404+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T15:36:46.270784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T15:36:46.444362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c841b259-219b-4f39-a952-8ef354c8a4d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6825","nonce":4073594120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6827","nonce":4073594120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6831","nonce":4073594120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6829","nonce":4073594120}]},"public_addr":"172.21.15.44:6825/4073594120","cluster_addr":"172.21.15.44:6827/4073594120","heartbeat_back_addr":"172.21.15.44:6831/4073594120","heartbeat_front_addr":"172.21.15.44:6829/4073594120","state":["exists","up"]},{"osd":1,"uuid":"daffe35c-9fda-4a02-81e2-b40855ff3e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6801","nonce":3956479268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6803","nonce":3956479268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6807","nonce":3956479268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6805","nonce":3956479268}]},"public_addr":"172.21.15.44:6801/3956479268","cluster_addr":"172.21.15.44:6803/3956479268","heartbeat_back_addr":"172.21.15.44:6807/3956479268","heartbeat_front_addr":"172.21.15.44:6805/3956479268","state":["exists","up"]},{"osd":2,"uuid":"653abe6b-68bd-4e83-b0a7-2691e1d0dd0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6810","nonce":2986857736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6814","nonce":2986857736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6822","nonce":2986857736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6818","nonce":2986857736}]},"public_addr":"172.21.15.44:6810/2986857736","cluster_addr":"172.21.15.44:6814/2986857736","heartbeat_back_addr":"172.21.15.44:6822/2986857736","heartbeat_front_addr":"172.21.15.44:6818/2986857736","state":["exists","up"]},{"osd":3,"uuid":"71cbfda2-d611-49da-b314-284be425b041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6811","nonce":3785559761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6815","nonce":3785559761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6823","nonce":3785559761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6819","nonce":3785559761}]},"public_addr":"172.21.15.44:6811/3785559761","cluster_addr":"172.21.15.44:6815/3785559761","heartbeat_back_addr":"172.21.15.44:6823/3785559761","heartbeat_front_addr":"172.21.15.44:6819/3785559761","state":["exists","up"]},{"osd":4,"uuid":"c68cb5c7-9093-418d-be3c-db3e3bd8eab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6821","nonce":466020694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6825","nonce":466020694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6831","nonce":466020694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6829","nonce":466020694}]},"public_addr":"172.21.15.63:6821/466020694","cluster_addr":"172.21.15.63:6825/466020694","heartbeat_back_addr":"172.21.15.63:6831/466020694","heartbeat_front_addr":"172.21.15.63:6829/466020694","state":["exists","up"]},{"osd":5,"uuid":"638215dd-8efa-4141-8ae7-3aa44152ab5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6802","nonce":1787755738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6806","nonce":1787755738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6814","nonce":1787755738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6810","nonce":1787755738}]},"public_addr":"172.21.15.63:6802/1787755738","cluster_addr":"172.21.15.63:6806/1787755738","heartbeat_back_addr":"172.21.15.63:6814/1787755738","heartbeat_front_addr":"172.21.15.63:6810/1787755738","state":["exists","up"]},{"osd":6,"uuid":"b0cb7f79-bc86-4f01-9185-35d3b5166fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6801","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6803","nonce":1209539994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6805","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6807","nonce":1209539994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6813","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6815","nonce":1209539994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6811","nonce":1209539994}]},"public_addr":"172.21.15.63:6803/1209539994","cluster_addr":"172.21.15.63:6807/1209539994","heartbeat_back_addr":"172.21.15.63:6815/1209539994","heartbeat_front_addr":"172.21.15.63:6811/1209539994","state":["exists","up"]},{"osd":7,"uuid":"dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6817","nonce":573406477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6820","nonce":573406477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6828","nonce":573406477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6824","nonce":573406477}]},"public_addr":"172.21.15.63:6817/573406477","cluster_addr":"172.21.15.63:6820/573406477","heartbeat_back_addr":"172.21.15.63:6828/573406477","heartbeat_front_addr":"172.21.15.63:6824/573406477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.230218+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.131179+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.228760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.255261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.248671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.197037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.153100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.201227+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:36:49.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-17T15:36:49.126 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-17T15:36:49.126 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-17T15:36:49.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-17T15:36:49.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-17T15:36:49.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-17T15:36:49.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-17T15:36:49.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-17T15:36:49.385 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:49.386 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T15:36:49.388 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:49.388 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T15:36:49.398 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:49.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T15:36:49.408 INFO:teuthology.orchestra.run.smithi044.stdout:60129542149 2024-04-17T15:36:49.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T15:36:49.409 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:49.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T15:36:49.410 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:49.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T15:36:49.425 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:49.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T15:36:49.427 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:49.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T15:36:49.869 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:49.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-04-17T15:36:49.902 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:49.916 INFO:teuthology.orchestra.run.smithi044.stdout:60129542146 2024-04-17T15:36:49.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.4 2024-04-17T15:36:49.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2024-04-17T15:36:49.938 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:49.945 INFO:teuthology.orchestra.run.smithi044.stdout:60129542146 2024-04-17T15:36:49.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.5 2024-04-17T15:36:49.962 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:49.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.0 2024-04-17T15:36:49.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-04-17T15:36:50.001 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:50.003 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:50.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-04-17T15:36:50.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.2 2024-04-17T15:36:50.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T15:36:50.930 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T15:36:50.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T15:36:50.958 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T15:36:50.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T15:36:50.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T15:36:51.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T15:36:51.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T15:36:51.421 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:51.441 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:51.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-04-17T15:36:51.445 DEBUG:teuthology.parallel:result is None 2024-04-17T15:36:51.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2024-04-17T15:36:51.471 DEBUG:teuthology.parallel:result is None 2024-04-17T15:36:51.482 INFO:teuthology.orchestra.run.smithi044.stdout:60129542149 2024-04-17T15:36:51.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-04-17T15:36:51.500 DEBUG:teuthology.parallel:result is None 2024-04-17T15:36:51.507 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:51.510 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:51.522 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:51.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2024-04-17T15:36:51.530 DEBUG:teuthology.parallel:result is None 2024-04-17T15:36:51.532 INFO:teuthology.orchestra.run.smithi044.stdout:60129542147 2024-04-17T15:36:51.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2024-04-17T15:36:51.537 DEBUG:teuthology.parallel:result is None 2024-04-17T15:36:51.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.5 2024-04-17T15:36:51.545 DEBUG:teuthology.parallel:result is None 2024-04-17T15:36:51.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.0 2024-04-17T15:36:51.551 DEBUG:teuthology.parallel:result is None 2024-04-17T15:36:51.559 INFO:teuthology.orchestra.run.smithi044.stdout:60129542148 2024-04-17T15:36:51.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-04-17T15:36:51.576 DEBUG:teuthology.parallel:result is None 2024-04-17T15:36:51.576 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T15:36:51.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:36:51.893 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:36:51.893 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:36:51.910 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-04-17T15:36:50.231090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219544,"kb_used_data":2380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":2437120,"data_stored":1559650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:48.079597+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:36:48.079597+0000","last_peered":"2024-04-17T15:36:48.079597+0000","last_clean":"2024-04-17T15:36:48.079597+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:36:48.079597+0000","last_undegraded":"2024-04-17T15:36:48.079597+0000","last_fullsized":"2024-04-17T15:36:48.079597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:26.095256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.099615+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:36:49.099615+0000","last_peered":"2024-04-17T15:36:49.099615+0000","last_clean":"2024-04-17T15:36:49.099615+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:36:49.099615+0000","last_undegraded":"2024-04-17T15:36:49.099615+0000","last_fullsized":"2024-04-17T15:36:49.099615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:48.285593+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:36:48.285593+0000","last_peered":"2024-04-17T15:36:48.285593+0000","last_clean":"2024-04-17T15:36:48.285593+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:36:48.285593+0000","last_undegraded":"2024-04-17T15:36:48.285593+0000","last_fullsized":"2024-04-17T15:36:48.285593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.099475+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:36:49.099475+0000","last_peered":"2024-04-17T15:36:49.099475+0000","last_clean":"2024-04-17T15:36:49.099475+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:36:49.099475+0000","last_undegraded":"2024-04-17T15:36:49.099475+0000","last_fullsized":"2024-04-17T15:36:49.099475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.099882+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:36:49.099882+0000","last_peered":"2024-04-17T15:36:49.099882+0000","last_clean":"2024-04-17T15:36:49.099882+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:36:49.099882+0000","last_undegraded":"2024-04-17T15:36:49.099882+0000","last_fullsized":"2024-04-17T15:36:49.099882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:48.328613+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:36:48.328613+0000","last_peered":"2024-04-17T15:36:48.328613+0000","last_clean":"2024-04-17T15:36:48.328613+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:36:48.328613+0000","last_undegraded":"2024-04-17T15:36:48.328613+0000","last_fullsized":"2024-04-17T15:36:48.328613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:26.095256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:48.076463+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:36:48.076463+0000","last_peered":"2024-04-17T15:36:48.076463+0000","last_clean":"2024-04-17T15:36:48.076463+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:36:48.076463+0000","last_undegraded":"2024-04-17T15:36:48.076463+0000","last_fullsized":"2024-04-17T15:36:48.076463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.099886+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:36:49.099886+0000","last_peered":"2024-04-17T15:36:49.099886+0000","last_clean":"2024-04-17T15:36:49.099886+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:36:49.099886+0000","last_undegraded":"2024-04-17T15:36:49.099886+0000","last_fullsized":"2024-04-17T15:36:49.099886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.181712+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:36:49.181712+0000","last_peered":"2024-04-17T15:36:49.181712+0000","last_clean":"2024-04-17T15:36:49.181712+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:36:49.181712+0000","last_undegraded":"2024-04-17T15:36:49.181712+0000","last_fullsized":"2024-04-17T15:36:49.181712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":745472,"data_stored":635438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":51188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":51188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":51188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":745472,"data_stored":635438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:36:51.917 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:36:52.204 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:36:52.205 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:36:52.222 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-04-17T15:36:50.231090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219544,"kb_used_data":2380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":2437120,"data_stored":1559650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:48.079597+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:36:48.079597+0000","last_peered":"2024-04-17T15:36:48.079597+0000","last_clean":"2024-04-17T15:36:48.079597+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:36:48.079597+0000","last_undegraded":"2024-04-17T15:36:48.079597+0000","last_fullsized":"2024-04-17T15:36:48.079597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:26.095256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.099615+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:36:49.099615+0000","last_peered":"2024-04-17T15:36:49.099615+0000","last_clean":"2024-04-17T15:36:49.099615+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:36:49.099615+0000","last_undegraded":"2024-04-17T15:36:49.099615+0000","last_fullsized":"2024-04-17T15:36:49.099615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:48.285593+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:36:48.285593+0000","last_peered":"2024-04-17T15:36:48.285593+0000","last_clean":"2024-04-17T15:36:48.285593+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:36:48.285593+0000","last_undegraded":"2024-04-17T15:36:48.285593+0000","last_fullsized":"2024-04-17T15:36:48.285593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.099475+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:36:49.099475+0000","last_peered":"2024-04-17T15:36:49.099475+0000","last_clean":"2024-04-17T15:36:49.099475+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:36:49.099475+0000","last_undegraded":"2024-04-17T15:36:49.099475+0000","last_fullsized":"2024-04-17T15:36:49.099475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.099882+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:36:49.099882+0000","last_peered":"2024-04-17T15:36:49.099882+0000","last_clean":"2024-04-17T15:36:49.099882+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:36:49.099882+0000","last_undegraded":"2024-04-17T15:36:49.099882+0000","last_fullsized":"2024-04-17T15:36:49.099882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:48.328613+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:36:48.328613+0000","last_peered":"2024-04-17T15:36:48.328613+0000","last_clean":"2024-04-17T15:36:48.328613+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:36:48.328613+0000","last_undegraded":"2024-04-17T15:36:48.328613+0000","last_fullsized":"2024-04-17T15:36:48.328613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:26.095256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:48.076463+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:36:48.076463+0000","last_peered":"2024-04-17T15:36:48.076463+0000","last_clean":"2024-04-17T15:36:48.076463+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:36:48.076463+0000","last_undegraded":"2024-04-17T15:36:48.076463+0000","last_fullsized":"2024-04-17T15:36:48.076463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.099886+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:36:49.099886+0000","last_peered":"2024-04-17T15:36:49.099886+0000","last_clean":"2024-04-17T15:36:49.099886+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:36:49.099886+0000","last_undegraded":"2024-04-17T15:36:49.099886+0000","last_fullsized":"2024-04-17T15:36:49.099886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T15:36:49.181712+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:36:49.181712+0000","last_peered":"2024-04-17T15:36:49.181712+0000","last_clean":"2024-04-17T15:36:49.181712+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:36:49.181712+0000","last_undegraded":"2024-04-17T15:36:49.181712+0000","last_fullsized":"2024-04-17T15:36:49.181712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":745472,"data_stored":635438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":51188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":51188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":51188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":745472,"data_stored":635438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:36:52.223 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T15:36:52.223 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-17T15:36:52.223 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-17T15:36:52.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T15:36:52.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:36:52.535 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-17T15:36:52.552 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-17T15:36:52.552 INFO:teuthology.run_tasks:Running task rgw... 2024-04-17T15:36:52.569 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-17T15:36:52.569 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-17T15:36:52.569 INFO:tasks.rgw:Creating data pools 2024-04-17T15:36:52.569 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-17T15:36:52.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-04-17T15:36:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'default.rgw.buckets.data' created 2024-04-17T15:36:53.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-17T15:36:54.156 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-17T15:36:54.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-17T15:36:55.167 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'default.rgw.buckets.index' created 2024-04-17T15:36:55.205 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-17T15:36:56.161 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-17T15:36:56.214 DEBUG:tasks.rgw:Pools created 2024-04-17T15:36:56.214 INFO:tasks.rgw:Starting rgw... 2024-04-17T15:36:56.215 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-17T15:36:56.215 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-17T15:36:56.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo echo -n http://smithi044.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-17T15:36:56.227 INFO:teuthology.orchestra.run.smithi044.stdout:http://smithi044.front.sepia.ceph.com:80 2024-04-17T15:36:56.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-17T15:36:56.279 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-17T15:36:56.279 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-17T15:36:56.322 INFO:tasks.rgw.client.0:Started 2024-04-17T15:36:56.323 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi044.front.sepia.ceph.com:80/ 2024-04-17T15:36:56.323 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2024-04-17T15:36:56.361 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-17T15:36:56.361 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2024-04-17T15:36:56.361 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-17T15:36:56.363 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-17T15:36:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:curl: (7) Failed to connect to smithi044.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-17T15:36:57.364 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2024-04-17T15:36:57.377 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-17T15:36:57.378 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2024-04-17T15:36:57.378 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-17T15:36:57.378 INFO:teuthology.orchestra.run.smithi044.stderr:curl: (7) Failed to connect to smithi044.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-17T15:36:57.379 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-17T15:36:59.380 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2024-04-17T15:36:59.393 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-17T15:36:59.393 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2024-04-17T15:36:59.393 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-17T15:36:59.393 INFO:teuthology.orchestra.run.smithi044.stderr:curl: (7) Failed to connect to smithi044.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-17T15:36:59.394 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-17T15:37:03.395 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2024-04-17T15:37:03.407 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-17T15:37:03.407 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2024-04-17T15:37:03.407 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-17T15:37:03.408 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-17T15:37:03.408 INFO:teuthology.orchestra.run.smithi044.stderr:curl: (7) Failed to connect to smithi044.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-17T15:37:05.429 INFO:tasks.rgw.client.0.smithi044.stdout:2024-04-17T15:37:05.430+0000 7f691ae4da40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-17T15:37:11.409 DEBUG:teuthology.orchestra.run.smithi044:> curl http://smithi044.front.sepia.ceph.com:80/ 2024-04-17T15:37:11.421 INFO:teuthology.orchestra.run.smithi044.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-17T15:37:11.421 INFO:teuthology.orchestra.run.smithi044.stderr: Dload Upload Total Spent Left Speed 2024-04-17T15:37:11.424 INFO:teuthology.orchestra.run.smithi044.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 54046 0 --:--:-- --:--:-- --:--:-- 62333 2024-04-17T15:37:11.425 INFO:teuthology.orchestra.run.smithi044.stdout:anonymous 2024-04-17T15:37:11.425 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-17T15:37:11.437 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-17T15:37:11.437 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'rgw-update-boost-redis'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rgw-update-boost-redis', 'sha1': '5bf3b3a9b161d70b9aa7806055bdae202e03111c'}} 2024-04-17T15:37:11.437 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-17T15:37:11.437 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-17T15:37:11.807 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-17T15:37:11.807 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T15:37:11.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:37:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:37:12.125 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:37:12.138 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-17T15:37:10.241377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":799,"num_read_kb":544,"num_write":580,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":520,"ondisk_log_size":520,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":513,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224300,"kb_used_data":3980,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750420,"statfs":{"total":773094113280,"available":772864430080,"internally_reserved":0,"allocated":4075520,"data_stored":2357684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":679,"num_read_kb":440,"num_write":411,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.991901"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291274+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:37:05.291274+0000","last_peered":"2024-04-17T15:37:05.291274+0000","last_clean":"2024-04-17T15:37:05.291274+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:37:05.291274+0000","last_undegraded":"2024-04-17T15:37:05.291274+0000","last_fullsized":"2024-04-17T15:37:05.291274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280558+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:37:05.280558+0000","last_peered":"2024-04-17T15:37:05.280558+0000","last_clean":"2024-04-17T15:37:05.280558+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:37:05.280558+0000","last_undegraded":"2024-04-17T15:37:05.280558+0000","last_fullsized":"2024-04-17T15:37:05.280558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271068+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:37:05.271068+0000","last_peered":"2024-04-17T15:37:05.271068+0000","last_clean":"2024-04-17T15:37:05.271068+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:37:05.271068+0000","last_undegraded":"2024-04-17T15:37:05.271068+0000","last_fullsized":"2024-04-17T15:37:05.271068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289669+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:37:05.289669+0000","last_peered":"2024-04-17T15:37:05.289669+0000","last_clean":"2024-04-17T15:37:05.289669+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:37:05.289669+0000","last_undegraded":"2024-04-17T15:37:05.289669+0000","last_fullsized":"2024-04-17T15:37:05.289669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286631+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:37:05.286631+0000","last_peered":"2024-04-17T15:37:05.286631+0000","last_clean":"2024-04-17T15:37:05.286631+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:37:05.286631+0000","last_undegraded":"2024-04-17T15:37:05.286631+0000","last_fullsized":"2024-04-17T15:37:05.286631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271544+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:37:05.271544+0000","last_peered":"2024-04-17T15:37:05.271544+0000","last_clean":"2024-04-17T15:37:05.271544+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:37:05.271544+0000","last_undegraded":"2024-04-17T15:37:05.271544+0000","last_fullsized":"2024-04-17T15:37:05.271544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282687+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:37:05.282687+0000","last_peered":"2024-04-17T15:37:05.282687+0000","last_clean":"2024-04-17T15:37:05.282687+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:37:05.282687+0000","last_undegraded":"2024-04-17T15:37:05.282687+0000","last_fullsized":"2024-04-17T15:37:05.282687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285287+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:37:05.285287+0000","last_peered":"2024-04-17T15:37:05.285287+0000","last_clean":"2024-04-17T15:37:05.285287+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:37:05.285287+0000","last_undegraded":"2024-04-17T15:37:05.285287+0000","last_fullsized":"2024-04-17T15:37:05.285287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290267+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:37:05.290267+0000","last_peered":"2024-04-17T15:37:05.290267+0000","last_clean":"2024-04-17T15:37:05.290267+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:37:05.290267+0000","last_undegraded":"2024-04-17T15:37:05.290267+0000","last_fullsized":"2024-04-17T15:37:05.290267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300071+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:37:05.300071+0000","last_peered":"2024-04-17T15:37:05.300071+0000","last_clean":"2024-04-17T15:37:05.300071+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:37:05.300071+0000","last_undegraded":"2024-04-17T15:37:05.300071+0000","last_fullsized":"2024-04-17T15:37:05.300071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280910+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:37:05.280910+0000","last_peered":"2024-04-17T15:37:05.280910+0000","last_clean":"2024-04-17T15:37:05.280910+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:37:05.280910+0000","last_undegraded":"2024-04-17T15:37:05.280910+0000","last_fullsized":"2024-04-17T15:37:05.280910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272607+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:37:05.272607+0000","last_peered":"2024-04-17T15:37:05.272607+0000","last_clean":"2024-04-17T15:37:05.272607+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:37:05.272607+0000","last_undegraded":"2024-04-17T15:37:05.272607+0000","last_fullsized":"2024-04-17T15:37:05.272607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290019+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:37:05.290019+0000","last_peered":"2024-04-17T15:37:05.290019+0000","last_clean":"2024-04-17T15:37:05.290019+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:37:05.290019+0000","last_undegraded":"2024-04-17T15:37:05.290019+0000","last_fullsized":"2024-04-17T15:37:05.290019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282219+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:37:05.282219+0000","last_peered":"2024-04-17T15:37:05.282219+0000","last_clean":"2024-04-17T15:37:05.282219+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:37:05.282219+0000","last_undegraded":"2024-04-17T15:37:05.282219+0000","last_fullsized":"2024-04-17T15:37:05.282219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292694+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:37:05.292694+0000","last_peered":"2024-04-17T15:37:05.292694+0000","last_clean":"2024-04-17T15:37:05.292694+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:37:05.292694+0000","last_undegraded":"2024-04-17T15:37:05.292694+0000","last_fullsized":"2024-04-17T15:37:05.292694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273588+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:37:05.273588+0000","last_peered":"2024-04-17T15:37:05.273588+0000","last_clean":"2024-04-17T15:37:05.273588+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:37:05.273588+0000","last_undegraded":"2024-04-17T15:37:05.273588+0000","last_fullsized":"2024-04-17T15:37:05.273588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271326+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:37:05.271326+0000","last_peered":"2024-04-17T15:37:05.271326+0000","last_clean":"2024-04-17T15:37:05.271326+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:37:05.271326+0000","last_undegraded":"2024-04-17T15:37:05.271326+0000","last_fullsized":"2024-04-17T15:37:05.271326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291281+0000","last_change":"2024-04-17T15:36:54.210516+0000","last_active":"2024-04-17T15:37:05.291281+0000","last_peered":"2024-04-17T15:37:05.291281+0000","last_clean":"2024-04-17T15:37:05.291281+0000","last_became_active":"2024-04-17T15:36:54.208488+0000","last_became_peered":"2024-04-17T15:36:54.208488+0000","last_unstale":"2024-04-17T15:37:05.291281+0000","last_undegraded":"2024-04-17T15:37:05.291281+0000","last_fullsized":"2024-04-17T15:37:05.291281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:43.263883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289952+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:37:05.289952+0000","last_peered":"2024-04-17T15:37:05.289952+0000","last_clean":"2024-04-17T15:37:05.289952+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:37:05.289952+0000","last_undegraded":"2024-04-17T15:37:05.289952+0000","last_fullsized":"2024-04-17T15:37:05.289952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.301034+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:37:05.301034+0000","last_peered":"2024-04-17T15:37:05.301034+0000","last_clean":"2024-04-17T15:37:05.301034+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:37:05.301034+0000","last_undegraded":"2024-04-17T15:37:05.301034+0000","last_fullsized":"2024-04-17T15:37:05.301034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281229+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:37:05.281229+0000","last_peered":"2024-04-17T15:37:05.281229+0000","last_clean":"2024-04-17T15:37:05.281229+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:37:05.281229+0000","last_undegraded":"2024-04-17T15:37:05.281229+0000","last_fullsized":"2024-04-17T15:37:05.281229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.303918+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:37:05.303918+0000","last_peered":"2024-04-17T15:37:05.303918+0000","last_clean":"2024-04-17T15:37:05.303918+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:37:05.303918+0000","last_undegraded":"2024-04-17T15:37:05.303918+0000","last_fullsized":"2024-04-17T15:37:05.303918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272258+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:37:05.272258+0000","last_peered":"2024-04-17T15:37:05.272258+0000","last_clean":"2024-04-17T15:37:05.272258+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:37:05.272258+0000","last_undegraded":"2024-04-17T15:37:05.272258+0000","last_fullsized":"2024-04-17T15:37:05.272258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272089+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:37:05.272089+0000","last_peered":"2024-04-17T15:37:05.272089+0000","last_clean":"2024-04-17T15:37:05.272089+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:37:05.272089+0000","last_undegraded":"2024-04-17T15:37:05.272089+0000","last_fullsized":"2024-04-17T15:37:05.272089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272961+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:37:05.272961+0000","last_peered":"2024-04-17T15:37:05.272961+0000","last_clean":"2024-04-17T15:37:05.272961+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:37:05.272961+0000","last_undegraded":"2024-04-17T15:37:05.272961+0000","last_fullsized":"2024-04-17T15:37:05.272961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292845+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:37:05.292845+0000","last_peered":"2024-04-17T15:37:05.292845+0000","last_clean":"2024-04-17T15:37:05.292845+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:37:05.292845+0000","last_undegraded":"2024-04-17T15:37:05.292845+0000","last_fullsized":"2024-04-17T15:37:05.292845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272695+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:37:05.272695+0000","last_peered":"2024-04-17T15:37:05.272695+0000","last_clean":"2024-04-17T15:37:05.272695+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:37:05.272695+0000","last_undegraded":"2024-04-17T15:37:05.272695+0000","last_fullsized":"2024-04-17T15:37:05.272695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284718+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:37:05.284718+0000","last_peered":"2024-04-17T15:37:05.284718+0000","last_clean":"2024-04-17T15:37:05.284718+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:37:05.284718+0000","last_undegraded":"2024-04-17T15:37:05.284718+0000","last_fullsized":"2024-04-17T15:37:05.284718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270749+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:37:05.270749+0000","last_peered":"2024-04-17T15:37:05.270749+0000","last_clean":"2024-04-17T15:37:05.270749+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:37:05.270749+0000","last_undegraded":"2024-04-17T15:37:05.270749+0000","last_fullsized":"2024-04-17T15:37:05.270749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293964+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:37:05.293964+0000","last_peered":"2024-04-17T15:37:05.293964+0000","last_clean":"2024-04-17T15:37:05.293964+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:37:05.293964+0000","last_undegraded":"2024-04-17T15:37:05.293964+0000","last_fullsized":"2024-04-17T15:37:05.293964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290501+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:37:05.290501+0000","last_peered":"2024-04-17T15:37:05.290501+0000","last_clean":"2024-04-17T15:37:05.290501+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:37:05.290501+0000","last_undegraded":"2024-04-17T15:37:05.290501+0000","last_fullsized":"2024-04-17T15:37:05.290501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282049+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:37:05.282049+0000","last_peered":"2024-04-17T15:37:05.282049+0000","last_clean":"2024-04-17T15:37:05.282049+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:37:05.282049+0000","last_undegraded":"2024-04-17T15:37:05.282049+0000","last_fullsized":"2024-04-17T15:37:05.282049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.698358+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:37:05.698358+0000","last_peered":"2024-04-17T15:37:05.698358+0000","last_clean":"2024-04-17T15:37:05.698358+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:37:05.698358+0000","last_undegraded":"2024-04-17T15:37:05.698358+0000","last_fullsized":"2024-04-17T15:37:05.698358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290978+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:37:05.290978+0000","last_peered":"2024-04-17T15:37:05.290978+0000","last_clean":"2024-04-17T15:37:05.290978+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:37:05.290978+0000","last_undegraded":"2024-04-17T15:37:05.290978+0000","last_fullsized":"2024-04-17T15:37:05.290978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280613+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:37:05.280613+0000","last_peered":"2024-04-17T15:37:05.280613+0000","last_clean":"2024-04-17T15:37:05.280613+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:37:05.280613+0000","last_undegraded":"2024-04-17T15:37:05.280613+0000","last_fullsized":"2024-04-17T15:37:05.280613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282624+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:37:05.282624+0000","last_peered":"2024-04-17T15:37:05.282624+0000","last_clean":"2024-04-17T15:37:05.282624+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:37:05.282624+0000","last_undegraded":"2024-04-17T15:37:05.282624+0000","last_fullsized":"2024-04-17T15:37:05.282624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284850+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:37:05.284850+0000","last_peered":"2024-04-17T15:37:05.284850+0000","last_clean":"2024-04-17T15:37:05.284850+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:37:05.284850+0000","last_undegraded":"2024-04-17T15:37:05.284850+0000","last_fullsized":"2024-04-17T15:37:05.284850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293499+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:37:05.293499+0000","last_peered":"2024-04-17T15:37:05.293499+0000","last_clean":"2024-04-17T15:37:05.293499+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:37:05.293499+0000","last_undegraded":"2024-04-17T15:37:05.293499+0000","last_fullsized":"2024-04-17T15:37:05.293499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.109707+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:37:06.109707+0000","last_peered":"2024-04-17T15:37:06.109707+0000","last_clean":"2024-04-17T15:37:06.109707+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:37:06.109707+0000","last_undegraded":"2024-04-17T15:37:06.109707+0000","last_fullsized":"2024-04-17T15:37:06.109707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272801+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:37:05.272801+0000","last_peered":"2024-04-17T15:37:05.272801+0000","last_clean":"2024-04-17T15:37:05.272801+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:37:05.272801+0000","last_undegraded":"2024-04-17T15:37:05.272801+0000","last_fullsized":"2024-04-17T15:37:05.272801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284412+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:37:05.284412+0000","last_peered":"2024-04-17T15:37:05.284412+0000","last_clean":"2024-04-17T15:37:05.284412+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:37:05.284412+0000","last_undegraded":"2024-04-17T15:37:05.284412+0000","last_fullsized":"2024-04-17T15:37:05.284412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.287247+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:37:05.287247+0000","last_peered":"2024-04-17T15:37:05.287247+0000","last_clean":"2024-04-17T15:37:05.287247+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:37:05.287247+0000","last_undegraded":"2024-04-17T15:37:05.287247+0000","last_fullsized":"2024-04-17T15:37:05.287247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290229+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:37:05.290229+0000","last_peered":"2024-04-17T15:37:05.290229+0000","last_clean":"2024-04-17T15:37:05.290229+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:37:05.290229+0000","last_undegraded":"2024-04-17T15:37:05.290229+0000","last_fullsized":"2024-04-17T15:37:05.290229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.295494+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:37:05.295494+0000","last_peered":"2024-04-17T15:37:05.295494+0000","last_clean":"2024-04-17T15:37:05.295494+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:37:05.295494+0000","last_undegraded":"2024-04-17T15:37:05.295494+0000","last_fullsized":"2024-04-17T15:37:05.295494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.164670+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:37:06.164670+0000","last_peered":"2024-04-17T15:37:06.164670+0000","last_clean":"2024-04-17T15:37:06.164670+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:37:06.164670+0000","last_undegraded":"2024-04-17T15:37:06.164670+0000","last_fullsized":"2024-04-17T15:37:06.164670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290625+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:37:05.290625+0000","last_peered":"2024-04-17T15:37:05.290625+0000","last_clean":"2024-04-17T15:37:05.290625+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:37:05.290625+0000","last_undegraded":"2024-04-17T15:37:05.290625+0000","last_fullsized":"2024-04-17T15:37:05.290625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271249+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:37:05.271249+0000","last_peered":"2024-04-17T15:37:05.271249+0000","last_clean":"2024-04-17T15:37:05.271249+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:37:05.271249+0000","last_undegraded":"2024-04-17T15:37:05.271249+0000","last_fullsized":"2024-04-17T15:37:05.271249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.295080+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:37:05.295080+0000","last_peered":"2024-04-17T15:37:05.295080+0000","last_clean":"2024-04-17T15:37:05.295080+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:37:05.295080+0000","last_undegraded":"2024-04-17T15:37:05.295080+0000","last_fullsized":"2024-04-17T15:37:05.295080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299333+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:37:05.299333+0000","last_peered":"2024-04-17T15:37:05.299333+0000","last_clean":"2024-04-17T15:37:05.299333+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:37:05.299333+0000","last_undegraded":"2024-04-17T15:37:05.299333+0000","last_fullsized":"2024-04-17T15:37:05.299333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282020+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:37:05.282020+0000","last_peered":"2024-04-17T15:37:05.282020+0000","last_clean":"2024-04-17T15:37:05.282020+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:37:05.282020+0000","last_undegraded":"2024-04-17T15:37:05.282020+0000","last_fullsized":"2024-04-17T15:37:05.282020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.172629+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:37:06.172629+0000","last_peered":"2024-04-17T15:37:06.172629+0000","last_clean":"2024-04-17T15:37:06.172629+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:37:06.172629+0000","last_undegraded":"2024-04-17T15:37:06.172629+0000","last_fullsized":"2024-04-17T15:37:06.172629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292872+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:37:05.292872+0000","last_peered":"2024-04-17T15:37:05.292872+0000","last_clean":"2024-04-17T15:37:05.292872+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:37:05.292872+0000","last_undegraded":"2024-04-17T15:37:05.292872+0000","last_fullsized":"2024-04-17T15:37:05.292872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281022+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:37:05.281022+0000","last_peered":"2024-04-17T15:37:05.281022+0000","last_clean":"2024-04-17T15:37:05.281022+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:37:05.281022+0000","last_undegraded":"2024-04-17T15:37:05.281022+0000","last_fullsized":"2024-04-17T15:37:05.281022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291567+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:37:05.291567+0000","last_peered":"2024-04-17T15:37:05.291567+0000","last_clean":"2024-04-17T15:37:05.291567+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:37:05.291567+0000","last_undegraded":"2024-04-17T15:37:05.291567+0000","last_fullsized":"2024-04-17T15:37:05.291567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289295+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:37:05.289295+0000","last_peered":"2024-04-17T15:37:05.289295+0000","last_clean":"2024-04-17T15:37:05.289295+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:37:05.289295+0000","last_undegraded":"2024-04-17T15:37:05.289295+0000","last_fullsized":"2024-04-17T15:37:05.289295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.273810+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:37:06.273810+0000","last_peered":"2024-04-17T15:37:06.273810+0000","last_clean":"2024-04-17T15:37:06.273810+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:37:06.273810+0000","last_undegraded":"2024-04-17T15:37:06.273810+0000","last_fullsized":"2024-04-17T15:37:06.273810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":19,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267629+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:37:05.267629+0000","last_peered":"2024-04-17T15:37:05.267629+0000","last_clean":"2024-04-17T15:37:05.267629+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:37:05.267629+0000","last_undegraded":"2024-04-17T15:37:05.267629+0000","last_fullsized":"2024-04-17T15:37:05.267629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282140+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:37:05.282140+0000","last_peered":"2024-04-17T15:37:05.282140+0000","last_clean":"2024-04-17T15:37:05.282140+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:37:05.282140+0000","last_undegraded":"2024-04-17T15:37:05.282140+0000","last_fullsized":"2024-04-17T15:37:05.282140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271109+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:37:05.271109+0000","last_peered":"2024-04-17T15:37:05.271109+0000","last_clean":"2024-04-17T15:37:05.271109+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:37:05.271109+0000","last_undegraded":"2024-04-17T15:37:05.271109+0000","last_fullsized":"2024-04-17T15:37:05.271109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291418+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:37:05.291418+0000","last_peered":"2024-04-17T15:37:05.291418+0000","last_clean":"2024-04-17T15:37:05.291418+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:37:05.291418+0000","last_undegraded":"2024-04-17T15:37:05.291418+0000","last_fullsized":"2024-04-17T15:37:05.291418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271255+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:37:05.271255+0000","last_peered":"2024-04-17T15:37:05.271255+0000","last_clean":"2024-04-17T15:37:05.271255+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:37:05.271255+0000","last_undegraded":"2024-04-17T15:37:05.271255+0000","last_fullsized":"2024-04-17T15:37:05.271255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.143801+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:37:06.143801+0000","last_peered":"2024-04-17T15:37:06.143801+0000","last_clean":"2024-04-17T15:37:06.143801+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:37:06.143801+0000","last_undegraded":"2024-04-17T15:37:06.143801+0000","last_fullsized":"2024-04-17T15:37:06.143801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291957+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:37:05.291957+0000","last_peered":"2024-04-17T15:37:05.291957+0000","last_clean":"2024-04-17T15:37:05.291957+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:37:05.291957+0000","last_undegraded":"2024-04-17T15:37:05.291957+0000","last_fullsized":"2024-04-17T15:37:05.291957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.302762+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:37:05.302762+0000","last_peered":"2024-04-17T15:37:05.302762+0000","last_clean":"2024-04-17T15:37:05.302762+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:37:05.302762+0000","last_undegraded":"2024-04-17T15:37:05.302762+0000","last_fullsized":"2024-04-17T15:37:05.302762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300133+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:37:05.300133+0000","last_peered":"2024-04-17T15:37:05.300133+0000","last_clean":"2024-04-17T15:37:05.300133+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:37:05.300133+0000","last_undegraded":"2024-04-17T15:37:05.300133+0000","last_fullsized":"2024-04-17T15:37:05.300133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291998+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:37:05.291998+0000","last_peered":"2024-04-17T15:37:05.291998+0000","last_clean":"2024-04-17T15:37:05.291998+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:37:05.291998+0000","last_undegraded":"2024-04-17T15:37:05.291998+0000","last_fullsized":"2024-04-17T15:37:05.291998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272599+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:37:05.272599+0000","last_peered":"2024-04-17T15:37:05.272599+0000","last_clean":"2024-04-17T15:37:05.272599+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:37:05.272599+0000","last_undegraded":"2024-04-17T15:37:05.272599+0000","last_fullsized":"2024-04-17T15:37:05.272599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.058974+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:37:06.058974+0000","last_peered":"2024-04-17T15:37:06.058974+0000","last_clean":"2024-04-17T15:37:06.058974+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:37:06.058974+0000","last_undegraded":"2024-04-17T15:37:06.058974+0000","last_fullsized":"2024-04-17T15:37:06.058974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283773+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:37:05.283773+0000","last_peered":"2024-04-17T15:37:05.283773+0000","last_clean":"2024-04-17T15:37:05.283773+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:37:05.283773+0000","last_undegraded":"2024-04-17T15:37:05.283773+0000","last_fullsized":"2024-04-17T15:37:05.283773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286680+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:37:05.286680+0000","last_peered":"2024-04-17T15:37:05.286680+0000","last_clean":"2024-04-17T15:37:05.286680+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:37:05.286680+0000","last_undegraded":"2024-04-17T15:37:05.286680+0000","last_fullsized":"2024-04-17T15:37:05.286680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286940+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:37:05.286940+0000","last_peered":"2024-04-17T15:37:05.286940+0000","last_clean":"2024-04-17T15:37:05.286940+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:37:05.286940+0000","last_undegraded":"2024-04-17T15:37:05.286940+0000","last_fullsized":"2024-04-17T15:37:05.286940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283064+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:37:05.283064+0000","last_peered":"2024-04-17T15:37:05.283064+0000","last_clean":"2024-04-17T15:37:05.283064+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:37:05.283064+0000","last_undegraded":"2024-04-17T15:37:05.283064+0000","last_fullsized":"2024-04-17T15:37:05.283064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271923+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:37:05.271923+0000","last_peered":"2024-04-17T15:37:05.271923+0000","last_clean":"2024-04-17T15:37:05.271923+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:37:05.271923+0000","last_undegraded":"2024-04-17T15:37:05.271923+0000","last_fullsized":"2024-04-17T15:37:05.271923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.655984+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:37:05.655984+0000","last_peered":"2024-04-17T15:37:05.655984+0000","last_clean":"2024-04-17T15:37:05.655984+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:37:05.655984+0000","last_undegraded":"2024-04-17T15:37:05.655984+0000","last_fullsized":"2024-04-17T15:37:05.655984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270904+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:37:05.270904+0000","last_peered":"2024-04-17T15:37:05.270904+0000","last_clean":"2024-04-17T15:37:05.270904+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:37:05.270904+0000","last_undegraded":"2024-04-17T15:37:05.270904+0000","last_fullsized":"2024-04-17T15:37:05.270904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270652+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:37:05.270652+0000","last_peered":"2024-04-17T15:37:05.270652+0000","last_clean":"2024-04-17T15:37:05.270652+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:37:05.270652+0000","last_undegraded":"2024-04-17T15:37:05.270652+0000","last_fullsized":"2024-04-17T15:37:05.270652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272826+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:37:05.272826+0000","last_peered":"2024-04-17T15:37:05.272826+0000","last_clean":"2024-04-17T15:37:05.272826+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:37:05.272826+0000","last_undegraded":"2024-04-17T15:37:05.272826+0000","last_fullsized":"2024-04-17T15:37:05.272826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292505+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:37:05.292505+0000","last_peered":"2024-04-17T15:37:05.292505+0000","last_clean":"2024-04-17T15:37:05.292505+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:37:05.292505+0000","last_undegraded":"2024-04-17T15:37:05.292505+0000","last_fullsized":"2024-04-17T15:37:05.292505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272597+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:37:05.272597+0000","last_peered":"2024-04-17T15:37:05.272597+0000","last_clean":"2024-04-17T15:37:05.272597+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:37:05.272597+0000","last_undegraded":"2024-04-17T15:37:05.272597+0000","last_fullsized":"2024-04-17T15:37:05.272597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.208623+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:37:06.208623+0000","last_peered":"2024-04-17T15:37:06.208623+0000","last_clean":"2024-04-17T15:37:06.208623+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:37:06.208623+0000","last_undegraded":"2024-04-17T15:37:06.208623+0000","last_fullsized":"2024-04-17T15:37:06.208623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286449+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:37:05.286449+0000","last_peered":"2024-04-17T15:37:05.286449+0000","last_clean":"2024-04-17T15:37:05.286449+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:37:05.286449+0000","last_undegraded":"2024-04-17T15:37:05.286449+0000","last_fullsized":"2024-04-17T15:37:05.286449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292012+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:37:05.292012+0000","last_peered":"2024-04-17T15:37:05.292012+0000","last_clean":"2024-04-17T15:37:05.292012+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:37:05.292012+0000","last_undegraded":"2024-04-17T15:37:05.292012+0000","last_fullsized":"2024-04-17T15:37:05.292012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272850+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:37:05.272850+0000","last_peered":"2024-04-17T15:37:05.272850+0000","last_clean":"2024-04-17T15:37:05.272850+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:37:05.272850+0000","last_undegraded":"2024-04-17T15:37:05.272850+0000","last_fullsized":"2024-04-17T15:37:05.272850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300385+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:37:05.300385+0000","last_peered":"2024-04-17T15:37:05.300385+0000","last_clean":"2024-04-17T15:37:05.300385+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:37:05.300385+0000","last_undegraded":"2024-04-17T15:37:05.300385+0000","last_fullsized":"2024-04-17T15:37:05.300385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268078+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:37:05.268078+0000","last_peered":"2024-04-17T15:37:05.268078+0000","last_clean":"2024-04-17T15:37:05.268078+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:37:05.268078+0000","last_undegraded":"2024-04-17T15:37:05.268078+0000","last_fullsized":"2024-04-17T15:37:05.268078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.072438+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:37:06.072438+0000","last_peered":"2024-04-17T15:37:06.072438+0000","last_clean":"2024-04-17T15:37:06.072438+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:37:06.072438+0000","last_undegraded":"2024-04-17T15:37:06.072438+0000","last_fullsized":"2024-04-17T15:37:06.072438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273854+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:37:05.273854+0000","last_peered":"2024-04-17T15:37:05.273854+0000","last_clean":"2024-04-17T15:37:05.273854+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:37:05.273854+0000","last_undegraded":"2024-04-17T15:37:05.273854+0000","last_fullsized":"2024-04-17T15:37:05.273854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268339+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:37:05.268339+0000","last_peered":"2024-04-17T15:37:05.268339+0000","last_clean":"2024-04-17T15:37:05.268339+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:37:05.268339+0000","last_undegraded":"2024-04-17T15:37:05.268339+0000","last_fullsized":"2024-04-17T15:37:05.268339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273418+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:37:05.273418+0000","last_peered":"2024-04-17T15:37:05.273418+0000","last_clean":"2024-04-17T15:37:05.273418+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:37:05.273418+0000","last_undegraded":"2024-04-17T15:37:05.273418+0000","last_fullsized":"2024-04-17T15:37:05.273418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271868+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:37:05.271868+0000","last_peered":"2024-04-17T15:37:05.271868+0000","last_clean":"2024-04-17T15:37:05.271868+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:37:05.271868+0000","last_undegraded":"2024-04-17T15:37:05.271868+0000","last_fullsized":"2024-04-17T15:37:05.271868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282231+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:37:05.282231+0000","last_peered":"2024-04-17T15:37:05.282231+0000","last_clean":"2024-04-17T15:37:05.282231+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:37:05.282231+0000","last_undegraded":"2024-04-17T15:37:05.282231+0000","last_fullsized":"2024-04-17T15:37:05.282231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.065087+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:37:06.065087+0000","last_peered":"2024-04-17T15:37:06.065087+0000","last_clean":"2024-04-17T15:37:06.065087+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:37:06.065087+0000","last_undegraded":"2024-04-17T15:37:06.065087+0000","last_fullsized":"2024-04-17T15:37:06.065087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.303035+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:37:05.303035+0000","last_peered":"2024-04-17T15:37:05.303035+0000","last_clean":"2024-04-17T15:37:05.303035+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:37:05.303035+0000","last_undegraded":"2024-04-17T15:37:05.303035+0000","last_fullsized":"2024-04-17T15:37:05.303035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271658+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:37:05.271658+0000","last_peered":"2024-04-17T15:37:05.271658+0000","last_clean":"2024-04-17T15:37:05.271658+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:37:05.271658+0000","last_undegraded":"2024-04-17T15:37:05.271658+0000","last_fullsized":"2024-04-17T15:37:05.271658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271003+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:37:05.271003+0000","last_peered":"2024-04-17T15:37:05.271003+0000","last_clean":"2024-04-17T15:37:05.271003+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:37:05.271003+0000","last_undegraded":"2024-04-17T15:37:05.271003+0000","last_fullsized":"2024-04-17T15:37:05.271003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293233+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:37:05.293233+0000","last_peered":"2024-04-17T15:37:05.293233+0000","last_clean":"2024-04-17T15:37:05.293233+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:37:05.293233+0000","last_undegraded":"2024-04-17T15:37:05.293233+0000","last_fullsized":"2024-04-17T15:37:05.293233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273120+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:37:05.273120+0000","last_peered":"2024-04-17T15:37:05.273120+0000","last_clean":"2024-04-17T15:37:05.273120+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:37:05.273120+0000","last_undegraded":"2024-04-17T15:37:05.273120+0000","last_fullsized":"2024-04-17T15:37:05.273120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.200712+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:37:06.200712+0000","last_peered":"2024-04-17T15:37:06.200712+0000","last_clean":"2024-04-17T15:37:06.200712+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:37:06.200712+0000","last_undegraded":"2024-04-17T15:37:06.200712+0000","last_fullsized":"2024-04-17T15:37:06.200712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299567+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:37:05.299567+0000","last_peered":"2024-04-17T15:37:05.299567+0000","last_clean":"2024-04-17T15:37:05.299567+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:37:05.299567+0000","last_undegraded":"2024-04-17T15:37:05.299567+0000","last_fullsized":"2024-04-17T15:37:05.299567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267692+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:37:05.267692+0000","last_peered":"2024-04-17T15:37:05.267692+0000","last_clean":"2024-04-17T15:37:05.267692+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:37:05.267692+0000","last_undegraded":"2024-04-17T15:37:05.267692+0000","last_fullsized":"2024-04-17T15:37:05.267692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.303561+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:37:05.303561+0000","last_peered":"2024-04-17T15:37:05.303561+0000","last_clean":"2024-04-17T15:37:05.303561+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:37:05.303561+0000","last_undegraded":"2024-04-17T15:37:05.303561+0000","last_fullsized":"2024-04-17T15:37:05.303561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289925+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:37:05.289925+0000","last_peered":"2024-04-17T15:37:05.289925+0000","last_clean":"2024-04-17T15:37:05.289925+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:37:05.289925+0000","last_undegraded":"2024-04-17T15:37:05.289925+0000","last_fullsized":"2024-04-17T15:37:05.289925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281401+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:37:05.281401+0000","last_peered":"2024-04-17T15:37:05.281401+0000","last_clean":"2024-04-17T15:37:05.281401+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:37:05.281401+0000","last_undegraded":"2024-04-17T15:37:05.281401+0000","last_fullsized":"2024-04-17T15:37:05.281401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292922+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:37:05.292922+0000","last_peered":"2024-04-17T15:37:05.292922+0000","last_clean":"2024-04-17T15:37:05.292922+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:37:05.292922+0000","last_undegraded":"2024-04-17T15:37:05.292922+0000","last_fullsized":"2024-04-17T15:37:05.292922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290619+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:37:05.290619+0000","last_peered":"2024-04-17T15:37:05.290619+0000","last_clean":"2024-04-17T15:37:05.290619+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:37:05.290619+0000","last_undegraded":"2024-04-17T15:37:05.290619+0000","last_fullsized":"2024-04-17T15:37:05.290619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.995736+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:37:05.995736+0000","last_peered":"2024-04-17T15:37:05.995736+0000","last_clean":"2024-04-17T15:37:05.995736+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:37:05.995736+0000","last_undegraded":"2024-04-17T15:37:05.995736+0000","last_fullsized":"2024-04-17T15:37:05.995736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286369+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:37:05.286369+0000","last_peered":"2024-04-17T15:37:05.286369+0000","last_clean":"2024-04-17T15:37:05.286369+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:37:05.286369+0000","last_undegraded":"2024-04-17T15:37:05.286369+0000","last_fullsized":"2024-04-17T15:37:05.286369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299409+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:37:05.299409+0000","last_peered":"2024-04-17T15:37:05.299409+0000","last_clean":"2024-04-17T15:37:05.299409+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:37:05.299409+0000","last_undegraded":"2024-04-17T15:37:05.299409+0000","last_fullsized":"2024-04-17T15:37:05.299409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.287027+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:37:05.287027+0000","last_peered":"2024-04-17T15:37:05.287027+0000","last_clean":"2024-04-17T15:37:05.287027+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:37:05.287027+0000","last_undegraded":"2024-04-17T15:37:05.287027+0000","last_fullsized":"2024-04-17T15:37:05.287027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289728+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:37:05.289728+0000","last_peered":"2024-04-17T15:37:05.289728+0000","last_clean":"2024-04-17T15:37:05.289728+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:37:05.289728+0000","last_undegraded":"2024-04-17T15:37:05.289728+0000","last_fullsized":"2024-04-17T15:37:05.289728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284579+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:37:05.284579+0000","last_peered":"2024-04-17T15:37:05.284579+0000","last_clean":"2024-04-17T15:37:05.284579+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:37:05.284579+0000","last_undegraded":"2024-04-17T15:37:05.284579+0000","last_fullsized":"2024-04-17T15:37:05.284579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283066+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:37:05.283066+0000","last_peered":"2024-04-17T15:37:05.283066+0000","last_clean":"2024-04-17T15:37:05.283066+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:37:05.283066+0000","last_undegraded":"2024-04-17T15:37:05.283066+0000","last_fullsized":"2024-04-17T15:37:05.283066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.185831+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:37:06.185831+0000","last_peered":"2024-04-17T15:37:06.185831+0000","last_clean":"2024-04-17T15:37:06.185831+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:37:06.185831+0000","last_undegraded":"2024-04-17T15:37:06.185831+0000","last_fullsized":"2024-04-17T15:37:06.185831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290917+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:37:05.290917+0000","last_peered":"2024-04-17T15:37:05.290917+0000","last_clean":"2024-04-17T15:37:05.290917+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:37:05.290917+0000","last_undegraded":"2024-04-17T15:37:05.290917+0000","last_fullsized":"2024-04-17T15:37:05.290917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267683+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:37:05.267683+0000","last_peered":"2024-04-17T15:37:05.267683+0000","last_clean":"2024-04-17T15:37:05.267683+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:37:05.267683+0000","last_undegraded":"2024-04-17T15:37:05.267683+0000","last_fullsized":"2024-04-17T15:37:05.267683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271244+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:37:05.271244+0000","last_peered":"2024-04-17T15:37:05.271244+0000","last_clean":"2024-04-17T15:37:05.271244+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:37:05.271244+0000","last_undegraded":"2024-04-17T15:37:05.271244+0000","last_fullsized":"2024-04-17T15:37:05.271244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271472+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:37:05.271472+0000","last_peered":"2024-04-17T15:37:05.271472+0000","last_clean":"2024-04-17T15:37:05.271472+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:37:05.271472+0000","last_undegraded":"2024-04-17T15:37:05.271472+0000","last_fullsized":"2024-04-17T15:37:05.271472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267320+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:37:05.267320+0000","last_peered":"2024-04-17T15:37:05.267320+0000","last_clean":"2024-04-17T15:37:05.267320+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:37:05.267320+0000","last_undegraded":"2024-04-17T15:37:05.267320+0000","last_fullsized":"2024-04-17T15:37:05.267320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273352+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:37:05.273352+0000","last_peered":"2024-04-17T15:37:05.273352+0000","last_clean":"2024-04-17T15:37:05.273352+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:37:05.273352+0000","last_undegraded":"2024-04-17T15:37:05.273352+0000","last_fullsized":"2024-04-17T15:37:05.273352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.193785+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:37:06.193785+0000","last_peered":"2024-04-17T15:37:06.193785+0000","last_clean":"2024-04-17T15:37:06.193785+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:37:06.193785+0000","last_undegraded":"2024-04-17T15:37:06.193785+0000","last_fullsized":"2024-04-17T15:37:06.193785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285273+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:37:05.285273+0000","last_peered":"2024-04-17T15:37:05.285273+0000","last_clean":"2024-04-17T15:37:05.285273+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:37:05.285273+0000","last_undegraded":"2024-04-17T15:37:05.285273+0000","last_fullsized":"2024-04-17T15:37:05.285273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293696+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:37:05.293696+0000","last_peered":"2024-04-17T15:37:05.293696+0000","last_clean":"2024-04-17T15:37:05.293696+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:37:05.293696+0000","last_undegraded":"2024-04-17T15:37:05.293696+0000","last_fullsized":"2024-04-17T15:37:05.293696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268391+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:37:05.268391+0000","last_peered":"2024-04-17T15:37:05.268391+0000","last_clean":"2024-04-17T15:37:05.268391+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:37:05.268391+0000","last_undegraded":"2024-04-17T15:37:05.268391+0000","last_fullsized":"2024-04-17T15:37:05.268391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281656+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:37:05.281656+0000","last_peered":"2024-04-17T15:37:05.281656+0000","last_clean":"2024-04-17T15:37:05.281656+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:37:05.281656+0000","last_undegraded":"2024-04-17T15:37:05.281656+0000","last_fullsized":"2024-04-17T15:37:05.281656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272241+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:37:05.272241+0000","last_peered":"2024-04-17T15:37:05.272241+0000","last_clean":"2024-04-17T15:37:05.272241+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:37:05.272241+0000","last_undegraded":"2024-04-17T15:37:05.272241+0000","last_fullsized":"2024-04-17T15:37:05.272241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286009+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:37:05.286009+0000","last_peered":"2024-04-17T15:37:05.286009+0000","last_clean":"2024-04-17T15:37:05.286009+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:37:05.286009+0000","last_undegraded":"2024-04-17T15:37:05.286009+0000","last_fullsized":"2024-04-17T15:37:05.286009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.029851+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:37:06.029851+0000","last_peered":"2024-04-17T15:37:06.029851+0000","last_clean":"2024-04-17T15:37:06.029851+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:37:06.029851+0000","last_undegraded":"2024-04-17T15:37:06.029851+0000","last_fullsized":"2024-04-17T15:37:06.029851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300713+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:37:05.300713+0000","last_peered":"2024-04-17T15:37:05.300713+0000","last_clean":"2024-04-17T15:37:05.300713+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:37:05.300713+0000","last_undegraded":"2024-04-17T15:37:05.300713+0000","last_fullsized":"2024-04-17T15:37:05.300713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280399+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:37:05.280399+0000","last_peered":"2024-04-17T15:37:05.280399+0000","last_clean":"2024-04-17T15:37:05.280399+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:37:05.280399+0000","last_undegraded":"2024-04-17T15:37:05.280399+0000","last_fullsized":"2024-04-17T15:37:05.280399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268531+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:37:05.268531+0000","last_peered":"2024-04-17T15:37:05.268531+0000","last_clean":"2024-04-17T15:37:05.268531+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:37:05.268531+0000","last_undegraded":"2024-04-17T15:37:05.268531+0000","last_fullsized":"2024-04-17T15:37:05.268531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282901+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:37:05.282901+0000","last_peered":"2024-04-17T15:37:05.282901+0000","last_clean":"2024-04-17T15:37:05.282901+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:37:05.282901+0000","last_undegraded":"2024-04-17T15:37:05.282901+0000","last_fullsized":"2024-04-17T15:37:05.282901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268733+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:37:05.268733+0000","last_peered":"2024-04-17T15:37:05.268733+0000","last_clean":"2024-04-17T15:37:05.268733+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:37:05.268733+0000","last_undegraded":"2024-04-17T15:37:05.268733+0000","last_fullsized":"2024-04-17T15:37:05.268733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285604+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:37:05.285604+0000","last_peered":"2024-04-17T15:37:05.285604+0000","last_clean":"2024-04-17T15:37:05.285604+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:37:05.285604+0000","last_undegraded":"2024-04-17T15:37:05.285604+0000","last_fullsized":"2024-04-17T15:37:05.285604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.122618+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:37:06.122618+0000","last_peered":"2024-04-17T15:37:06.122618+0000","last_clean":"2024-04-17T15:37:06.122618+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:37:06.122618+0000","last_undegraded":"2024-04-17T15:37:06.122618+0000","last_fullsized":"2024-04-17T15:37:06.122618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270544+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:37:05.270544+0000","last_peered":"2024-04-17T15:37:05.270544+0000","last_clean":"2024-04-17T15:37:05.270544+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:37:05.270544+0000","last_undegraded":"2024-04-17T15:37:05.270544+0000","last_fullsized":"2024-04-17T15:37:05.270544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286173+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:37:05.286173+0000","last_peered":"2024-04-17T15:37:05.286173+0000","last_clean":"2024-04-17T15:37:05.286173+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:37:05.286173+0000","last_undegraded":"2024-04-17T15:37:05.286173+0000","last_fullsized":"2024-04-17T15:37:05.286173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286819+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:37:05.286819+0000","last_peered":"2024-04-17T15:37:05.286819+0000","last_clean":"2024-04-17T15:37:05.286819+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:37:05.286819+0000","last_undegraded":"2024-04-17T15:37:05.286819+0000","last_fullsized":"2024-04-17T15:37:05.286819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268453+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:37:05.268453+0000","last_peered":"2024-04-17T15:37:05.268453+0000","last_clean":"2024-04-17T15:37:05.268453+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:37:05.268453+0000","last_undegraded":"2024-04-17T15:37:05.268453+0000","last_fullsized":"2024-04-17T15:37:05.268453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292209+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:37:05.292209+0000","last_peered":"2024-04-17T15:37:05.292209+0000","last_clean":"2024-04-17T15:37:05.292209+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:37:05.292209+0000","last_undegraded":"2024-04-17T15:37:05.292209+0000","last_fullsized":"2024-04-17T15:37:05.292209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299791+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:37:05.299791+0000","last_peered":"2024-04-17T15:37:05.299791+0000","last_clean":"2024-04-17T15:37:05.299791+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:37:05.299791+0000","last_undegraded":"2024-04-17T15:37:05.299791+0000","last_fullsized":"2024-04-17T15:37:05.299791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.222396+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:37:06.222396+0000","last_peered":"2024-04-17T15:37:06.222396+0000","last_clean":"2024-04-17T15:37:06.222396+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:37:06.222396+0000","last_undegraded":"2024-04-17T15:37:06.222396+0000","last_fullsized":"2024-04-17T15:37:06.222396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282848+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:37:05.282848+0000","last_peered":"2024-04-17T15:37:05.282848+0000","last_clean":"2024-04-17T15:37:05.282848+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:37:05.282848+0000","last_undegraded":"2024-04-17T15:37:05.282848+0000","last_fullsized":"2024-04-17T15:37:05.282848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.295418+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:37:05.295418+0000","last_peered":"2024-04-17T15:37:05.295418+0000","last_clean":"2024-04-17T15:37:05.295418+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:37:05.295418+0000","last_undegraded":"2024-04-17T15:37:05.295418+0000","last_fullsized":"2024-04-17T15:37:05.295418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292360+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:37:05.292360+0000","last_peered":"2024-04-17T15:37:05.292360+0000","last_clean":"2024-04-17T15:37:05.292360+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:37:05.292360+0000","last_undegraded":"2024-04-17T15:37:05.292360+0000","last_fullsized":"2024-04-17T15:37:05.292360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294066+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:37:05.294066+0000","last_peered":"2024-04-17T15:37:05.294066+0000","last_clean":"2024-04-17T15:37:05.294066+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:37:05.294066+0000","last_undegraded":"2024-04-17T15:37:05.294066+0000","last_fullsized":"2024-04-17T15:37:05.294066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271304+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:37:05.271304+0000","last_peered":"2024-04-17T15:37:05.271304+0000","last_clean":"2024-04-17T15:37:05.271304+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:37:05.271304+0000","last_undegraded":"2024-04-17T15:37:05.271304+0000","last_fullsized":"2024-04-17T15:37:05.271304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270845+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:37:05.270845+0000","last_peered":"2024-04-17T15:37:05.270845+0000","last_clean":"2024-04-17T15:37:05.270845+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:37:05.270845+0000","last_undegraded":"2024-04-17T15:37:05.270845+0000","last_fullsized":"2024-04-17T15:37:05.270845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.179906+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:37:06.179906+0000","last_peered":"2024-04-17T15:37:06.179906+0000","last_clean":"2024-04-17T15:37:06.179906+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:37:06.179906+0000","last_undegraded":"2024-04-17T15:37:06.179906+0000","last_fullsized":"2024-04-17T15:37:06.179906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294484+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:37:05.294484+0000","last_peered":"2024-04-17T15:37:05.294484+0000","last_clean":"2024-04-17T15:37:05.294484+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:37:05.294484+0000","last_undegraded":"2024-04-17T15:37:05.294484+0000","last_fullsized":"2024-04-17T15:37:05.294484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285793+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:37:05.285793+0000","last_peered":"2024-04-17T15:37:05.285793+0000","last_clean":"2024-04-17T15:37:05.285793+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:37:05.285793+0000","last_undegraded":"2024-04-17T15:37:05.285793+0000","last_fullsized":"2024-04-17T15:37:05.285793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271165+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:37:05.271165+0000","last_peered":"2024-04-17T15:37:05.271165+0000","last_clean":"2024-04-17T15:37:05.271165+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:37:05.271165+0000","last_undegraded":"2024-04-17T15:37:05.271165+0000","last_fullsized":"2024-04-17T15:37:05.271165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.287330+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:37:05.287330+0000","last_peered":"2024-04-17T15:37:05.287330+0000","last_clean":"2024-04-17T15:37:05.287330+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:37:05.287330+0000","last_undegraded":"2024-04-17T15:37:05.287330+0000","last_fullsized":"2024-04-17T15:37:05.287330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.301348+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:37:05.301348+0000","last_peered":"2024-04-17T15:37:05.301348+0000","last_clean":"2024-04-17T15:37:05.301348+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:37:05.301348+0000","last_undegraded":"2024-04-17T15:37:05.301348+0000","last_fullsized":"2024-04-17T15:37:05.301348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292196+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:37:05.292196+0000","last_peered":"2024-04-17T15:37:05.292196+0000","last_clean":"2024-04-17T15:37:05.292196+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:37:05.292196+0000","last_undegraded":"2024-04-17T15:37:05.292196+0000","last_fullsized":"2024-04-17T15:37:05.292196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.158234+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:37:06.158234+0000","last_peered":"2024-04-17T15:37:06.158234+0000","last_clean":"2024-04-17T15:37:06.158234+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:37:06.158234+0000","last_undegraded":"2024-04-17T15:37:06.158234+0000","last_fullsized":"2024-04-17T15:37:06.158234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292032+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:37:05.292032+0000","last_peered":"2024-04-17T15:37:05.292032+0000","last_clean":"2024-04-17T15:37:05.292032+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:37:05.292032+0000","last_undegraded":"2024-04-17T15:37:05.292032+0000","last_fullsized":"2024-04-17T15:37:05.292032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281876+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:37:05.281876+0000","last_peered":"2024-04-17T15:37:05.281876+0000","last_clean":"2024-04-17T15:37:05.281876+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:37:05.281876+0000","last_undegraded":"2024-04-17T15:37:05.281876+0000","last_fullsized":"2024-04-17T15:37:05.281876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286287+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:37:05.286287+0000","last_peered":"2024-04-17T15:37:05.286287+0000","last_clean":"2024-04-17T15:37:05.286287+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:37:05.286287+0000","last_undegraded":"2024-04-17T15:37:05.286287+0000","last_fullsized":"2024-04-17T15:37:05.286287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271706+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:37:05.271706+0000","last_peered":"2024-04-17T15:37:05.271706+0000","last_clean":"2024-04-17T15:37:05.271706+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:37:05.271706+0000","last_undegraded":"2024-04-17T15:37:05.271706+0000","last_fullsized":"2024-04-17T15:37:05.271706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271886+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:37:05.271886+0000","last_peered":"2024-04-17T15:37:05.271886+0000","last_clean":"2024-04-17T15:37:05.271886+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:37:05.271886+0000","last_undegraded":"2024-04-17T15:37:05.271886+0000","last_fullsized":"2024-04-17T15:37:05.271886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268765+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:37:05.268765+0000","last_peered":"2024-04-17T15:37:05.268765+0000","last_clean":"2024-04-17T15:37:05.268765+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:37:05.268765+0000","last_undegraded":"2024-04-17T15:37:05.268765+0000","last_fullsized":"2024-04-17T15:37:05.268765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.229245+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:37:06.229245+0000","last_peered":"2024-04-17T15:37:06.229245+0000","last_clean":"2024-04-17T15:37:06.229245+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:37:06.229245+0000","last_undegraded":"2024-04-17T15:37:06.229245+0000","last_fullsized":"2024-04-17T15:37:06.229245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291733+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:37:05.291733+0000","last_peered":"2024-04-17T15:37:05.291733+0000","last_clean":"2024-04-17T15:37:05.291733+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:37:05.291733+0000","last_undegraded":"2024-04-17T15:37:05.291733+0000","last_fullsized":"2024-04-17T15:37:05.291733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294452+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:37:05.294452+0000","last_peered":"2024-04-17T15:37:05.294452+0000","last_clean":"2024-04-17T15:37:05.294452+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:37:05.294452+0000","last_undegraded":"2024-04-17T15:37:05.294452+0000","last_fullsized":"2024-04-17T15:37:05.294452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268273+0000","last_change":"2024-04-17T15:36:56.210604+0000","last_active":"2024-04-17T15:37:05.268273+0000","last_peered":"2024-04-17T15:37:05.268273+0000","last_clean":"2024-04-17T15:37:05.268273+0000","last_became_active":"2024-04-17T15:36:56.210290+0000","last_became_peered":"2024-04-17T15:36:56.210290+0000","last_unstale":"2024-04-17T15:37:05.268273+0000","last_undegraded":"2024-04-17T15:37:05.268273+0000","last_fullsized":"2024-04-17T15:37:05.268273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291997+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:37:05.291997+0000","last_peered":"2024-04-17T15:37:05.291997+0000","last_clean":"2024-04-17T15:37:05.291997+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:37:05.291997+0000","last_undegraded":"2024-04-17T15:37:05.291997+0000","last_fullsized":"2024-04-17T15:37:05.291997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293038+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:37:05.293038+0000","last_peered":"2024-04-17T15:37:05.293038+0000","last_clean":"2024-04-17T15:37:05.293038+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:37:05.293038+0000","last_undegraded":"2024-04-17T15:37:05.293038+0000","last_fullsized":"2024-04-17T15:37:05.293038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'4","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.662658+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:37:05.662658+0000","last_peered":"2024-04-17T15:37:05.662658+0000","last_clean":"2024-04-17T15:37:05.662658+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:37:05.662658+0000","last_undegraded":"2024-04-17T15:37:05.662658+0000","last_fullsized":"2024-04-17T15:37:05.662658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289654+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:37:05.289654+0000","last_peered":"2024-04-17T15:37:05.289654+0000","last_clean":"2024-04-17T15:37:05.289654+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:37:05.289654+0000","last_undegraded":"2024-04-17T15:37:05.289654+0000","last_fullsized":"2024-04-17T15:37:05.289654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285873+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:37:05.285873+0000","last_peered":"2024-04-17T15:37:05.285873+0000","last_clean":"2024-04-17T15:37:05.285873+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:37:05.285873+0000","last_undegraded":"2024-04-17T15:37:05.285873+0000","last_fullsized":"2024-04-17T15:37:05.285873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292268+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:37:05.292268+0000","last_peered":"2024-04-17T15:37:05.292268+0000","last_clean":"2024-04-17T15:37:05.292268+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:37:05.292268+0000","last_undegraded":"2024-04-17T15:37:05.292268+0000","last_fullsized":"2024-04-17T15:37:05.292268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282696+0000","last_change":"2024-04-17T15:36:54.207503+0000","last_active":"2024-04-17T15:37:05.282696+0000","last_peered":"2024-04-17T15:37:05.282696+0000","last_clean":"2024-04-17T15:37:05.282696+0000","last_became_active":"2024-04-17T15:36:54.206672+0000","last_became_peered":"2024-04-17T15:36:54.206672+0000","last_unstale":"2024-04-17T15:37:05.282696+0000","last_undegraded":"2024-04-17T15:37:05.282696+0000","last_fullsized":"2024-04-17T15:37:05.282696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.288875+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:37:05.288875+0000","last_peered":"2024-04-17T15:37:05.288875+0000","last_clean":"2024-04-17T15:37:05.288875+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:37:05.288875+0000","last_undegraded":"2024-04-17T15:37:05.288875+0000","last_fullsized":"2024-04-17T15:37:05.288875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.137336+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:37:06.137336+0000","last_peered":"2024-04-17T15:37:06.137336+0000","last_clean":"2024-04-17T15:37:06.137336+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:37:06.137336+0000","last_undegraded":"2024-04-17T15:37:06.137336+0000","last_fullsized":"2024-04-17T15:37:06.137336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299728+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:37:05.299728+0000","last_peered":"2024-04-17T15:37:05.299728+0000","last_clean":"2024-04-17T15:37:05.299728+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:37:05.299728+0000","last_undegraded":"2024-04-17T15:37:05.299728+0000","last_fullsized":"2024-04-17T15:37:05.299728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281685+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:37:05.281685+0000","last_peered":"2024-04-17T15:37:05.281685+0000","last_clean":"2024-04-17T15:37:05.281685+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:37:05.281685+0000","last_undegraded":"2024-04-17T15:37:05.281685+0000","last_fullsized":"2024-04-17T15:37:05.281685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292830+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:37:05.292830+0000","last_peered":"2024-04-17T15:37:05.292830+0000","last_clean":"2024-04-17T15:37:05.292830+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:37:05.292830+0000","last_undegraded":"2024-04-17T15:37:05.292830+0000","last_fullsized":"2024-04-17T15:37:05.292830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.287129+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:37:05.287129+0000","last_peered":"2024-04-17T15:37:05.287129+0000","last_clean":"2024-04-17T15:37:05.287129+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:37:05.287129+0000","last_undegraded":"2024-04-17T15:37:05.287129+0000","last_fullsized":"2024-04-17T15:37:05.287129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299875+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:37:05.299875+0000","last_peered":"2024-04-17T15:37:05.299875+0000","last_clean":"2024-04-17T15:37:05.299875+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:37:05.299875+0000","last_undegraded":"2024-04-17T15:37:05.299875+0000","last_fullsized":"2024-04-17T15:37:05.299875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.912409+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:37:05.912409+0000","last_peered":"2024-04-17T15:37:05.912409+0000","last_clean":"2024-04-17T15:37:05.912409+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:37:05.912409+0000","last_undegraded":"2024-04-17T15:37:05.912409+0000","last_fullsized":"2024-04-17T15:37:05.912409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285040+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:37:05.285040+0000","last_peered":"2024-04-17T15:37:05.285040+0000","last_clean":"2024-04-17T15:37:05.285040+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:37:05.285040+0000","last_undegraded":"2024-04-17T15:37:05.285040+0000","last_fullsized":"2024-04-17T15:37:05.285040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.301061+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:37:05.301061+0000","last_peered":"2024-04-17T15:37:05.301061+0000","last_clean":"2024-04-17T15:37:05.301061+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:37:05.301061+0000","last_undegraded":"2024-04-17T15:37:05.301061+0000","last_fullsized":"2024-04-17T15:37:05.301061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293012+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:37:05.293012+0000","last_peered":"2024-04-17T15:37:05.293012+0000","last_clean":"2024-04-17T15:37:05.293012+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:37:05.293012+0000","last_undegraded":"2024-04-17T15:37:05.293012+0000","last_fullsized":"2024-04-17T15:37:05.293012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286625+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:37:05.286625+0000","last_peered":"2024-04-17T15:37:05.286625+0000","last_clean":"2024-04-17T15:37:05.286625+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:37:05.286625+0000","last_undegraded":"2024-04-17T15:37:05.286625+0000","last_fullsized":"2024-04-17T15:37:05.286625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'11","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.153086+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:37:06.153086+0000","last_peered":"2024-04-17T15:37:06.153086+0000","last_clean":"2024-04-17T15:37:06.153086+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:37:06.153086+0000","last_undegraded":"2024-04-17T15:37:06.153086+0000","last_fullsized":"2024-04-17T15:37:06.153086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":14,"num_write":13,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282284+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:37:05.282284+0000","last_peered":"2024-04-17T15:37:05.282284+0000","last_clean":"2024-04-17T15:37:05.282284+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:37:05.282284+0000","last_undegraded":"2024-04-17T15:37:05.282284+0000","last_fullsized":"2024-04-17T15:37:05.282284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292416+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:37:05.292416+0000","last_peered":"2024-04-17T15:37:05.292416+0000","last_clean":"2024-04-17T15:37:05.292416+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:37:05.292416+0000","last_undegraded":"2024-04-17T15:37:05.292416+0000","last_fullsized":"2024-04-17T15:37:05.292416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286928+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:37:05.286928+0000","last_peered":"2024-04-17T15:37:05.286928+0000","last_clean":"2024-04-17T15:37:05.286928+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:37:05.286928+0000","last_undegraded":"2024-04-17T15:37:05.286928+0000","last_fullsized":"2024-04-17T15:37:05.286928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.269150+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:37:05.269150+0000","last_peered":"2024-04-17T15:37:05.269150+0000","last_clean":"2024-04-17T15:37:05.269150+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:37:05.269150+0000","last_undegraded":"2024-04-17T15:37:05.269150+0000","last_fullsized":"2024-04-17T15:37:05.269150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300837+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:37:05.300837+0000","last_peered":"2024-04-17T15:37:05.300837+0000","last_clean":"2024-04-17T15:37:05.300837+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:37:05.300837+0000","last_undegraded":"2024-04-17T15:37:05.300837+0000","last_fullsized":"2024-04-17T15:37:05.300837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.038016+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:37:06.038016+0000","last_peered":"2024-04-17T15:37:06.038016+0000","last_clean":"2024-04-17T15:37:06.038016+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:37:06.038016+0000","last_undegraded":"2024-04-17T15:37:06.038016+0000","last_fullsized":"2024-04-17T15:37:06.038016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.269631+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:37:05.269631+0000","last_peered":"2024-04-17T15:37:05.269631+0000","last_clean":"2024-04-17T15:37:05.269631+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:37:05.269631+0000","last_undegraded":"2024-04-17T15:37:05.269631+0000","last_fullsized":"2024-04-17T15:37:05.269631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299617+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:37:05.299617+0000","last_peered":"2024-04-17T15:37:05.299617+0000","last_clean":"2024-04-17T15:37:05.299617+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:37:05.299617+0000","last_undegraded":"2024-04-17T15:37:05.299617+0000","last_fullsized":"2024-04-17T15:37:05.299617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294000+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:37:05.294000+0000","last_peered":"2024-04-17T15:37:05.294000+0000","last_clean":"2024-04-17T15:37:05.294000+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:37:05.294000+0000","last_undegraded":"2024-04-17T15:37:05.294000+0000","last_fullsized":"2024-04-17T15:37:05.294000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272441+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:37:05.272441+0000","last_peered":"2024-04-17T15:37:05.272441+0000","last_clean":"2024-04-17T15:37:05.272441+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:37:05.272441+0000","last_undegraded":"2024-04-17T15:37:05.272441+0000","last_fullsized":"2024-04-17T15:37:05.272441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273310+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:37:05.273310+0000","last_peered":"2024-04-17T15:37:05.273310+0000","last_clean":"2024-04-17T15:37:05.273310+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:37:05.273310+0000","last_undegraded":"2024-04-17T15:37:05.273310+0000","last_fullsized":"2024-04-17T15:37:05.273310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.236358+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:37:06.236358+0000","last_peered":"2024-04-17T15:37:06.236358+0000","last_clean":"2024-04-17T15:37:06.236358+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:37:06.236358+0000","last_undegraded":"2024-04-17T15:37:06.236358+0000","last_fullsized":"2024-04-17T15:37:06.236358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270265+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:37:05.270265+0000","last_peered":"2024-04-17T15:37:05.270265+0000","last_clean":"2024-04-17T15:37:05.270265+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:37:05.270265+0000","last_undegraded":"2024-04-17T15:37:05.270265+0000","last_fullsized":"2024-04-17T15:37:05.270265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280853+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:37:05.280853+0000","last_peered":"2024-04-17T15:37:05.280853+0000","last_clean":"2024-04-17T15:37:05.280853+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:37:05.280853+0000","last_undegraded":"2024-04-17T15:37:05.280853+0000","last_fullsized":"2024-04-17T15:37:05.280853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273036+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:37:05.273036+0000","last_peered":"2024-04-17T15:37:05.273036+0000","last_clean":"2024-04-17T15:37:05.273036+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:37:05.273036+0000","last_undegraded":"2024-04-17T15:37:05.273036+0000","last_fullsized":"2024-04-17T15:37:05.273036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285296+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:37:05.285296+0000","last_peered":"2024-04-17T15:37:05.285296+0000","last_clean":"2024-04-17T15:37:05.285296+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:37:05.285296+0000","last_undegraded":"2024-04-17T15:37:05.285296+0000","last_fullsized":"2024-04-17T15:37:05.285296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270160+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:37:05.270160+0000","last_peered":"2024-04-17T15:37:05.270160+0000","last_clean":"2024-04-17T15:37:05.270160+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:37:05.270160+0000","last_undegraded":"2024-04-17T15:37:05.270160+0000","last_fullsized":"2024-04-17T15:37:05.270160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.215850+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:37:06.215850+0000","last_peered":"2024-04-17T15:37:06.215850+0000","last_clean":"2024-04-17T15:37:06.215850+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:37:06.215850+0000","last_undegraded":"2024-04-17T15:37:06.215850+0000","last_fullsized":"2024-04-17T15:37:06.215850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300425+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:37:05.300425+0000","last_peered":"2024-04-17T15:37:05.300425+0000","last_clean":"2024-04-17T15:37:05.300425+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:37:05.300425+0000","last_undegraded":"2024-04-17T15:37:05.300425+0000","last_fullsized":"2024-04-17T15:37:05.300425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289216+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:37:05.289216+0000","last_peered":"2024-04-17T15:37:05.289216+0000","last_clean":"2024-04-17T15:37:05.289216+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:37:05.289216+0000","last_undegraded":"2024-04-17T15:37:05.289216+0000","last_fullsized":"2024-04-17T15:37:05.289216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271444+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:37:05.271444+0000","last_peered":"2024-04-17T15:37:05.271444+0000","last_clean":"2024-04-17T15:37:05.271444+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:37:05.271444+0000","last_undegraded":"2024-04-17T15:37:05.271444+0000","last_fullsized":"2024-04-17T15:37:05.271444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282872+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:37:05.282872+0000","last_peered":"2024-04-17T15:37:05.282872+0000","last_clean":"2024-04-17T15:37:05.282872+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:37:05.282872+0000","last_undegraded":"2024-04-17T15:37:05.282872+0000","last_fullsized":"2024-04-17T15:37:05.282872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289530+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:37:05.289530+0000","last_peered":"2024-04-17T15:37:05.289530+0000","last_clean":"2024-04-17T15:37:05.289530+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:37:05.289530+0000","last_undegraded":"2024-04-17T15:37:05.289530+0000","last_fullsized":"2024-04-17T15:37:05.289530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.251813+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:37:06.251813+0000","last_peered":"2024-04-17T15:37:06.251813+0000","last_clean":"2024-04-17T15:37:06.251813+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:37:06.251813+0000","last_undegraded":"2024-04-17T15:37:06.251813+0000","last_fullsized":"2024-04-17T15:37:06.251813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283154+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:37:05.283154+0000","last_peered":"2024-04-17T15:37:05.283154+0000","last_clean":"2024-04-17T15:37:05.283154+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:37:05.283154+0000","last_undegraded":"2024-04-17T15:37:05.283154+0000","last_fullsized":"2024-04-17T15:37:05.283154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291857+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:37:05.291857+0000","last_peered":"2024-04-17T15:37:05.291857+0000","last_clean":"2024-04-17T15:37:05.291857+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:37:05.291857+0000","last_undegraded":"2024-04-17T15:37:05.291857+0000","last_fullsized":"2024-04-17T15:37:05.291857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271883+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:37:05.271883+0000","last_peered":"2024-04-17T15:37:05.271883+0000","last_clean":"2024-04-17T15:37:05.271883+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:37:05.271883+0000","last_undegraded":"2024-04-17T15:37:05.271883+0000","last_fullsized":"2024-04-17T15:37:05.271883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282729+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:37:05.282729+0000","last_peered":"2024-04-17T15:37:05.282729+0000","last_clean":"2024-04-17T15:37:05.282729+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:37:05.282729+0000","last_undegraded":"2024-04-17T15:37:05.282729+0000","last_fullsized":"2024-04-17T15:37:05.282729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281074+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:37:05.281074+0000","last_peered":"2024-04-17T15:37:05.281074+0000","last_clean":"2024-04-17T15:37:05.281074+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:37:05.281074+0000","last_undegraded":"2024-04-17T15:37:05.281074+0000","last_fullsized":"2024-04-17T15:37:05.281074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.603229+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:37:05.603229+0000","last_peered":"2024-04-17T15:37:05.603229+0000","last_clean":"2024-04-17T15:37:05.603229+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:37:05.603229+0000","last_undegraded":"2024-04-17T15:37:05.603229+0000","last_fullsized":"2024-04-17T15:37:05.603229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299227+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:37:05.299227+0000","last_peered":"2024-04-17T15:37:05.299227+0000","last_clean":"2024-04-17T15:37:05.299227+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:37:05.299227+0000","last_undegraded":"2024-04-17T15:37:05.299227+0000","last_fullsized":"2024-04-17T15:37:05.299227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294494+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:37:05.294494+0000","last_peered":"2024-04-17T15:37:05.294494+0000","last_clean":"2024-04-17T15:37:05.294494+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:37:05.294494+0000","last_undegraded":"2024-04-17T15:37:05.294494+0000","last_fullsized":"2024-04-17T15:37:05.294494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292465+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:37:05.292465+0000","last_peered":"2024-04-17T15:37:05.292465+0000","last_clean":"2024-04-17T15:37:05.292465+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:37:05.292465+0000","last_undegraded":"2024-04-17T15:37:05.292465+0000","last_fullsized":"2024-04-17T15:37:05.292465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294763+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:37:05.294763+0000","last_peered":"2024-04-17T15:37:05.294763+0000","last_clean":"2024-04-17T15:37:05.294763+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:37:05.294763+0000","last_undegraded":"2024-04-17T15:37:05.294763+0000","last_fullsized":"2024-04-17T15:37:05.294763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270446+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:37:05.270446+0000","last_peered":"2024-04-17T15:37:05.270446+0000","last_clean":"2024-04-17T15:37:05.270446+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:37:05.270446+0000","last_undegraded":"2024-04-17T15:37:05.270446+0000","last_fullsized":"2024-04-17T15:37:05.270446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.860676+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:37:05.860676+0000","last_peered":"2024-04-17T15:37:05.860676+0000","last_clean":"2024-04-17T15:37:05.860676+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:37:05.860676+0000","last_undegraded":"2024-04-17T15:37:05.860676+0000","last_fullsized":"2024-04-17T15:37:05.860676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270830+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:37:05.270830+0000","last_peered":"2024-04-17T15:37:05.270830+0000","last_clean":"2024-04-17T15:37:05.270830+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:37:05.270830+0000","last_undegraded":"2024-04-17T15:37:05.270830+0000","last_fullsized":"2024-04-17T15:37:05.270830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291826+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:37:05.291826+0000","last_peered":"2024-04-17T15:37:05.291826+0000","last_clean":"2024-04-17T15:37:05.291826+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:37:05.291826+0000","last_undegraded":"2024-04-17T15:37:05.291826+0000","last_fullsized":"2024-04-17T15:37:05.291826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271079+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:37:05.271079+0000","last_peered":"2024-04-17T15:37:05.271079+0000","last_clean":"2024-04-17T15:37:05.271079+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:37:05.271079+0000","last_undegraded":"2024-04-17T15:37:05.271079+0000","last_fullsized":"2024-04-17T15:37:05.271079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286810+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:37:05.286810+0000","last_peered":"2024-04-17T15:37:05.286810+0000","last_clean":"2024-04-17T15:37:05.286810+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:37:05.286810+0000","last_undegraded":"2024-04-17T15:37:05.286810+0000","last_fullsized":"2024-04-17T15:37:05.286810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267441+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:37:05.267441+0000","last_peered":"2024-04-17T15:37:05.267441+0000","last_clean":"2024-04-17T15:37:05.267441+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:37:05.267441+0000","last_undegraded":"2024-04-17T15:37:05.267441+0000","last_fullsized":"2024-04-17T15:37:05.267441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.933312+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:37:05.933312+0000","last_peered":"2024-04-17T15:37:05.933312+0000","last_clean":"2024-04-17T15:37:05.933312+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:37:05.933312+0000","last_undegraded":"2024-04-17T15:37:05.933312+0000","last_fullsized":"2024-04-17T15:37:05.933312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284884+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:37:05.284884+0000","last_peered":"2024-04-17T15:37:05.284884+0000","last_clean":"2024-04-17T15:37:05.284884+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:37:05.284884+0000","last_undegraded":"2024-04-17T15:37:05.284884+0000","last_fullsized":"2024-04-17T15:37:05.284884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273644+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:37:05.273644+0000","last_peered":"2024-04-17T15:37:05.273644+0000","last_clean":"2024-04-17T15:37:05.273644+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:37:05.273644+0000","last_undegraded":"2024-04-17T15:37:05.273644+0000","last_fullsized":"2024-04-17T15:37:05.273644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271453+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:37:05.271453+0000","last_peered":"2024-04-17T15:37:05.271453+0000","last_clean":"2024-04-17T15:37:05.271453+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:37:05.271453+0000","last_undegraded":"2024-04-17T15:37:05.271453+0000","last_fullsized":"2024-04-17T15:37:05.271453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299222+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:37:05.299222+0000","last_peered":"2024-04-17T15:37:05.299222+0000","last_clean":"2024-04-17T15:37:05.299222+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:37:05.299222+0000","last_undegraded":"2024-04-17T15:37:05.299222+0000","last_fullsized":"2024-04-17T15:37:05.299222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271518+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:37:05.271518+0000","last_peered":"2024-04-17T15:37:05.271518+0000","last_clean":"2024-04-17T15:37:05.271518+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:37:05.271518+0000","last_undegraded":"2024-04-17T15:37:05.271518+0000","last_fullsized":"2024-04-17T15:37:05.271518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271043+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:37:05.271043+0000","last_peered":"2024-04-17T15:37:05.271043+0000","last_clean":"2024-04-17T15:37:05.271043+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:37:05.271043+0000","last_undegraded":"2024-04-17T15:37:05.271043+0000","last_fullsized":"2024-04-17T15:37:05.271043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282061+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:37:05.282061+0000","last_peered":"2024-04-17T15:37:05.282061+0000","last_clean":"2024-04-17T15:37:05.282061+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:37:05.282061+0000","last_undegraded":"2024-04-17T15:37:05.282061+0000","last_fullsized":"2024-04-17T15:37:05.282061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281561+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:37:05.281561+0000","last_peered":"2024-04-17T15:37:05.281561+0000","last_clean":"2024-04-17T15:37:05.281561+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:37:05.281561+0000","last_undegraded":"2024-04-17T15:37:05.281561+0000","last_fullsized":"2024-04-17T15:37:05.281561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268716+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:37:05.268716+0000","last_peered":"2024-04-17T15:37:05.268716+0000","last_clean":"2024-04-17T15:37:05.268716+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:37:05.268716+0000","last_undegraded":"2024-04-17T15:37:05.268716+0000","last_fullsized":"2024-04-17T15:37:05.268716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286631+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:37:05.286631+0000","last_peered":"2024-04-17T15:37:05.286631+0000","last_clean":"2024-04-17T15:37:05.286631+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:37:05.286631+0000","last_undegraded":"2024-04-17T15:37:05.286631+0000","last_fullsized":"2024-04-17T15:37:05.286631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293550+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:37:05.293550+0000","last_peered":"2024-04-17T15:37:05.293550+0000","last_clean":"2024-04-17T15:37:05.293550+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:37:05.293550+0000","last_undegraded":"2024-04-17T15:37:05.293550+0000","last_fullsized":"2024-04-17T15:37:05.293550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294330+0000","last_change":"2024-04-17T15:36:54.177547+0000","last_active":"2024-04-17T15:37:05.294330+0000","last_peered":"2024-04-17T15:37:05.294330+0000","last_clean":"2024-04-17T15:37:05.294330+0000","last_became_active":"2024-04-17T15:36:54.176327+0000","last_became_peered":"2024-04-17T15:36:54.176327+0000","last_unstale":"2024-04-17T15:37:05.294330+0000","last_undegraded":"2024-04-17T15:37:05.294330+0000","last_fullsized":"2024-04-17T15:37:05.294330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:54:55.766570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272191+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:37:05.272191+0000","last_peered":"2024-04-17T15:37:05.272191+0000","last_clean":"2024-04-17T15:37:05.272191+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:37:05.272191+0000","last_undegraded":"2024-04-17T15:37:05.272191+0000","last_fullsized":"2024-04-17T15:37:05.272191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270608+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:37:05.270608+0000","last_peered":"2024-04-17T15:37:05.270608+0000","last_clean":"2024-04-17T15:37:05.270608+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:37:05.270608+0000","last_undegraded":"2024-04-17T15:37:05.270608+0000","last_fullsized":"2024-04-17T15:37:05.270608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292007+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:37:05.292007+0000","last_peered":"2024-04-17T15:37:05.292007+0000","last_clean":"2024-04-17T15:37:05.292007+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:37:05.292007+0000","last_undegraded":"2024-04-17T15:37:05.292007+0000","last_fullsized":"2024-04-17T15:37:05.292007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.301416+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:37:05.301416+0000","last_peered":"2024-04-17T15:37:05.301416+0000","last_clean":"2024-04-17T15:37:05.301416+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:37:05.301416+0000","last_undegraded":"2024-04-17T15:37:05.301416+0000","last_fullsized":"2024-04-17T15:37:05.301416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299070+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:37:05.299070+0000","last_peered":"2024-04-17T15:37:05.299070+0000","last_clean":"2024-04-17T15:37:05.299070+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:37:05.299070+0000","last_undegraded":"2024-04-17T15:37:05.299070+0000","last_fullsized":"2024-04-17T15:37:05.299070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.295240+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:37:05.295240+0000","last_peered":"2024-04-17T15:37:05.295240+0000","last_clean":"2024-04-17T15:37:05.295240+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:37:05.295240+0000","last_undegraded":"2024-04-17T15:37:05.295240+0000","last_fullsized":"2024-04-17T15:37:05.295240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286818+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:37:05.286818+0000","last_peered":"2024-04-17T15:37:05.286818+0000","last_clean":"2024-04-17T15:37:05.286818+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:37:05.286818+0000","last_undegraded":"2024-04-17T15:37:05.286818+0000","last_fullsized":"2024-04-17T15:37:05.286818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281442+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:37:05.281442+0000","last_peered":"2024-04-17T15:37:05.281442+0000","last_clean":"2024-04-17T15:37:05.281442+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:37:05.281442+0000","last_undegraded":"2024-04-17T15:37:05.281442+0000","last_fullsized":"2024-04-17T15:37:05.281442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273407+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:37:05.273407+0000","last_peered":"2024-04-17T15:37:05.273407+0000","last_clean":"2024-04-17T15:37:05.273407+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:37:05.273407+0000","last_undegraded":"2024-04-17T15:37:05.273407+0000","last_fullsized":"2024-04-17T15:37:05.273407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292722+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:37:05.292722+0000","last_peered":"2024-04-17T15:37:05.292722+0000","last_clean":"2024-04-17T15:37:05.292722+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:37:05.292722+0000","last_undegraded":"2024-04-17T15:37:05.292722+0000","last_fullsized":"2024-04-17T15:37:05.292722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273174+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:37:05.273174+0000","last_peered":"2024-04-17T15:37:05.273174+0000","last_clean":"2024-04-17T15:37:05.273174+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:37:05.273174+0000","last_undegraded":"2024-04-17T15:37:05.273174+0000","last_fullsized":"2024-04-17T15:37:05.273174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281285+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:37:05.281285+0000","last_peered":"2024-04-17T15:37:05.281285+0000","last_clean":"2024-04-17T15:37:05.281285+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:37:05.281285+0000","last_undegraded":"2024-04-17T15:37:05.281285+0000","last_fullsized":"2024-04-17T15:37:05.281285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272839+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:37:05.272839+0000","last_peered":"2024-04-17T15:37:05.272839+0000","last_clean":"2024-04-17T15:37:05.272839+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:37:05.272839+0000","last_undegraded":"2024-04-17T15:37:05.272839+0000","last_fullsized":"2024-04-17T15:37:05.272839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285864+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:37:05.285864+0000","last_peered":"2024-04-17T15:37:05.285864+0000","last_clean":"2024-04-17T15:37:05.285864+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:37:05.285864+0000","last_undegraded":"2024-04-17T15:37:05.285864+0000","last_fullsized":"2024-04-17T15:37:05.285864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290042+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:37:05.290042+0000","last_peered":"2024-04-17T15:37:05.290042+0000","last_clean":"2024-04-17T15:37:05.290042+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:37:05.290042+0000","last_undegraded":"2024-04-17T15:37:05.290042+0000","last_fullsized":"2024-04-17T15:37:05.290042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300342+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:37:05.300342+0000","last_peered":"2024-04-17T15:37:05.300342+0000","last_clean":"2024-04-17T15:37:05.300342+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:37:05.300342+0000","last_undegraded":"2024-04-17T15:37:05.300342+0000","last_fullsized":"2024-04-17T15:37:05.300342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284104+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:37:05.284104+0000","last_peered":"2024-04-17T15:37:05.284104+0000","last_clean":"2024-04-17T15:37:05.284104+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:37:05.284104+0000","last_undegraded":"2024-04-17T15:37:05.284104+0000","last_fullsized":"2024-04-17T15:37:05.284104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292171+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:37:05.292171+0000","last_peered":"2024-04-17T15:37:05.292171+0000","last_clean":"2024-04-17T15:37:05.292171+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:37:05.292171+0000","last_undegraded":"2024-04-17T15:37:05.292171+0000","last_fullsized":"2024-04-17T15:37:05.292171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291933+0000","last_change":"2024-04-17T15:36:56.190009+0000","last_active":"2024-04-17T15:37:05.291933+0000","last_peered":"2024-04-17T15:37:05.291933+0000","last_clean":"2024-04-17T15:37:05.291933+0000","last_became_active":"2024-04-17T15:36:56.189084+0000","last_became_peered":"2024-04-17T15:36:56.189084+0000","last_unstale":"2024-04-17T15:37:05.291933+0000","last_undegraded":"2024-04-17T15:37:05.291933+0000","last_fullsized":"2024-04-17T15:37:05.291933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:04:56.180628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273700+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:37:05.273700+0000","last_peered":"2024-04-17T15:37:05.273700+0000","last_clean":"2024-04-17T15:37:05.273700+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:37:05.273700+0000","last_undegraded":"2024-04-17T15:37:05.273700+0000","last_fullsized":"2024-04-17T15:37:05.273700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289277+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:37:05.289277+0000","last_peered":"2024-04-17T15:37:05.289277+0000","last_clean":"2024-04-17T15:37:05.289277+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:37:05.289277+0000","last_undegraded":"2024-04-17T15:37:05.289277+0000","last_fullsized":"2024-04-17T15:37:05.289277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283324+0000","last_change":"2024-04-17T15:36:54.206097+0000","last_active":"2024-04-17T15:37:05.283324+0000","last_peered":"2024-04-17T15:37:05.283324+0000","last_clean":"2024-04-17T15:37:05.283324+0000","last_became_active":"2024-04-17T15:36:54.205139+0000","last_became_peered":"2024-04-17T15:36:54.205139+0000","last_unstale":"2024-04-17T15:37:05.283324+0000","last_undegraded":"2024-04-17T15:37:05.283324+0000","last_fullsized":"2024-04-17T15:37:05.283324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281303+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:37:05.281303+0000","last_peered":"2024-04-17T15:37:05.281303+0000","last_clean":"2024-04-17T15:37:05.281303+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:37:05.281303+0000","last_undegraded":"2024-04-17T15:37:05.281303+0000","last_fullsized":"2024-04-17T15:37:05.281303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286482+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:37:05.286482+0000","last_peered":"2024-04-17T15:37:05.286482+0000","last_clean":"2024-04-17T15:37:05.286482+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:37:05.286482+0000","last_undegraded":"2024-04-17T15:37:05.286482+0000","last_fullsized":"2024-04-17T15:37:05.286482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268765+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:37:05.268765+0000","last_peered":"2024-04-17T15:37:05.268765+0000","last_clean":"2024-04-17T15:37:05.268765+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:37:05.268765+0000","last_undegraded":"2024-04-17T15:37:05.268765+0000","last_fullsized":"2024-04-17T15:37:05.268765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282537+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:37:05.282537+0000","last_peered":"2024-04-17T15:37:05.282537+0000","last_clean":"2024-04-17T15:37:05.282537+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:37:05.282537+0000","last_undegraded":"2024-04-17T15:37:05.282537+0000","last_fullsized":"2024-04-17T15:37:05.282537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":679,"num_read_kb":440,"num_write":411,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":381,"ondisk_log_size":381,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":146480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":146198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":372736,"data_stored":148089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":146262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":147386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":738127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:37:12.149 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:37:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:37:12.540 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:37:12.557 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-17T15:37:12.242022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224328,"kb_used_data":4008,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750392,"statfs":{"total":773094113280,"available":772864401408,"internally_reserved":0,"allocated":4104192,"data_stored":2358454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003785"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291274+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:37:05.291274+0000","last_peered":"2024-04-17T15:37:05.291274+0000","last_clean":"2024-04-17T15:37:05.291274+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:37:05.291274+0000","last_undegraded":"2024-04-17T15:37:05.291274+0000","last_fullsized":"2024-04-17T15:37:05.291274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280558+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:37:05.280558+0000","last_peered":"2024-04-17T15:37:05.280558+0000","last_clean":"2024-04-17T15:37:05.280558+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:37:05.280558+0000","last_undegraded":"2024-04-17T15:37:05.280558+0000","last_fullsized":"2024-04-17T15:37:05.280558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271068+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:37:05.271068+0000","last_peered":"2024-04-17T15:37:05.271068+0000","last_clean":"2024-04-17T15:37:05.271068+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:37:05.271068+0000","last_undegraded":"2024-04-17T15:37:05.271068+0000","last_fullsized":"2024-04-17T15:37:05.271068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289669+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:37:05.289669+0000","last_peered":"2024-04-17T15:37:05.289669+0000","last_clean":"2024-04-17T15:37:05.289669+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:37:05.289669+0000","last_undegraded":"2024-04-17T15:37:05.289669+0000","last_fullsized":"2024-04-17T15:37:05.289669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286631+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:37:05.286631+0000","last_peered":"2024-04-17T15:37:05.286631+0000","last_clean":"2024-04-17T15:37:05.286631+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:37:05.286631+0000","last_undegraded":"2024-04-17T15:37:05.286631+0000","last_fullsized":"2024-04-17T15:37:05.286631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271544+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:37:05.271544+0000","last_peered":"2024-04-17T15:37:05.271544+0000","last_clean":"2024-04-17T15:37:05.271544+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:37:05.271544+0000","last_undegraded":"2024-04-17T15:37:05.271544+0000","last_fullsized":"2024-04-17T15:37:05.271544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282687+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:37:05.282687+0000","last_peered":"2024-04-17T15:37:05.282687+0000","last_clean":"2024-04-17T15:37:05.282687+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:37:05.282687+0000","last_undegraded":"2024-04-17T15:37:05.282687+0000","last_fullsized":"2024-04-17T15:37:05.282687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285287+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:37:05.285287+0000","last_peered":"2024-04-17T15:37:05.285287+0000","last_clean":"2024-04-17T15:37:05.285287+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:37:05.285287+0000","last_undegraded":"2024-04-17T15:37:05.285287+0000","last_fullsized":"2024-04-17T15:37:05.285287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290267+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:37:05.290267+0000","last_peered":"2024-04-17T15:37:05.290267+0000","last_clean":"2024-04-17T15:37:05.290267+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:37:05.290267+0000","last_undegraded":"2024-04-17T15:37:05.290267+0000","last_fullsized":"2024-04-17T15:37:05.290267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300071+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:37:05.300071+0000","last_peered":"2024-04-17T15:37:05.300071+0000","last_clean":"2024-04-17T15:37:05.300071+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:37:05.300071+0000","last_undegraded":"2024-04-17T15:37:05.300071+0000","last_fullsized":"2024-04-17T15:37:05.300071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280910+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:37:05.280910+0000","last_peered":"2024-04-17T15:37:05.280910+0000","last_clean":"2024-04-17T15:37:05.280910+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:37:05.280910+0000","last_undegraded":"2024-04-17T15:37:05.280910+0000","last_fullsized":"2024-04-17T15:37:05.280910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272607+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:37:05.272607+0000","last_peered":"2024-04-17T15:37:05.272607+0000","last_clean":"2024-04-17T15:37:05.272607+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:37:05.272607+0000","last_undegraded":"2024-04-17T15:37:05.272607+0000","last_fullsized":"2024-04-17T15:37:05.272607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290019+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:37:05.290019+0000","last_peered":"2024-04-17T15:37:05.290019+0000","last_clean":"2024-04-17T15:37:05.290019+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:37:05.290019+0000","last_undegraded":"2024-04-17T15:37:05.290019+0000","last_fullsized":"2024-04-17T15:37:05.290019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282219+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:37:05.282219+0000","last_peered":"2024-04-17T15:37:05.282219+0000","last_clean":"2024-04-17T15:37:05.282219+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:37:05.282219+0000","last_undegraded":"2024-04-17T15:37:05.282219+0000","last_fullsized":"2024-04-17T15:37:05.282219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292694+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:37:05.292694+0000","last_peered":"2024-04-17T15:37:05.292694+0000","last_clean":"2024-04-17T15:37:05.292694+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:37:05.292694+0000","last_undegraded":"2024-04-17T15:37:05.292694+0000","last_fullsized":"2024-04-17T15:37:05.292694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273588+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:37:05.273588+0000","last_peered":"2024-04-17T15:37:05.273588+0000","last_clean":"2024-04-17T15:37:05.273588+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:37:05.273588+0000","last_undegraded":"2024-04-17T15:37:05.273588+0000","last_fullsized":"2024-04-17T15:37:05.273588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271326+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:37:05.271326+0000","last_peered":"2024-04-17T15:37:05.271326+0000","last_clean":"2024-04-17T15:37:05.271326+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:37:05.271326+0000","last_undegraded":"2024-04-17T15:37:05.271326+0000","last_fullsized":"2024-04-17T15:37:05.271326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291281+0000","last_change":"2024-04-17T15:36:54.210516+0000","last_active":"2024-04-17T15:37:05.291281+0000","last_peered":"2024-04-17T15:37:05.291281+0000","last_clean":"2024-04-17T15:37:05.291281+0000","last_became_active":"2024-04-17T15:36:54.208488+0000","last_became_peered":"2024-04-17T15:36:54.208488+0000","last_unstale":"2024-04-17T15:37:05.291281+0000","last_undegraded":"2024-04-17T15:37:05.291281+0000","last_fullsized":"2024-04-17T15:37:05.291281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:43.263883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289952+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:37:05.289952+0000","last_peered":"2024-04-17T15:37:05.289952+0000","last_clean":"2024-04-17T15:37:05.289952+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:37:05.289952+0000","last_undegraded":"2024-04-17T15:37:05.289952+0000","last_fullsized":"2024-04-17T15:37:05.289952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.301034+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:37:05.301034+0000","last_peered":"2024-04-17T15:37:05.301034+0000","last_clean":"2024-04-17T15:37:05.301034+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:37:05.301034+0000","last_undegraded":"2024-04-17T15:37:05.301034+0000","last_fullsized":"2024-04-17T15:37:05.301034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281229+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:37:05.281229+0000","last_peered":"2024-04-17T15:37:05.281229+0000","last_clean":"2024-04-17T15:37:05.281229+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:37:05.281229+0000","last_undegraded":"2024-04-17T15:37:05.281229+0000","last_fullsized":"2024-04-17T15:37:05.281229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.303918+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:37:05.303918+0000","last_peered":"2024-04-17T15:37:05.303918+0000","last_clean":"2024-04-17T15:37:05.303918+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:37:05.303918+0000","last_undegraded":"2024-04-17T15:37:05.303918+0000","last_fullsized":"2024-04-17T15:37:05.303918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272258+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:37:05.272258+0000","last_peered":"2024-04-17T15:37:05.272258+0000","last_clean":"2024-04-17T15:37:05.272258+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:37:05.272258+0000","last_undegraded":"2024-04-17T15:37:05.272258+0000","last_fullsized":"2024-04-17T15:37:05.272258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272089+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:37:05.272089+0000","last_peered":"2024-04-17T15:37:05.272089+0000","last_clean":"2024-04-17T15:37:05.272089+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:37:05.272089+0000","last_undegraded":"2024-04-17T15:37:05.272089+0000","last_fullsized":"2024-04-17T15:37:05.272089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272961+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:37:05.272961+0000","last_peered":"2024-04-17T15:37:05.272961+0000","last_clean":"2024-04-17T15:37:05.272961+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:37:05.272961+0000","last_undegraded":"2024-04-17T15:37:05.272961+0000","last_fullsized":"2024-04-17T15:37:05.272961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292845+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:37:05.292845+0000","last_peered":"2024-04-17T15:37:05.292845+0000","last_clean":"2024-04-17T15:37:05.292845+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:37:05.292845+0000","last_undegraded":"2024-04-17T15:37:05.292845+0000","last_fullsized":"2024-04-17T15:37:05.292845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272695+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:37:05.272695+0000","last_peered":"2024-04-17T15:37:05.272695+0000","last_clean":"2024-04-17T15:37:05.272695+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:37:05.272695+0000","last_undegraded":"2024-04-17T15:37:05.272695+0000","last_fullsized":"2024-04-17T15:37:05.272695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284718+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:37:05.284718+0000","last_peered":"2024-04-17T15:37:05.284718+0000","last_clean":"2024-04-17T15:37:05.284718+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:37:05.284718+0000","last_undegraded":"2024-04-17T15:37:05.284718+0000","last_fullsized":"2024-04-17T15:37:05.284718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270749+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:37:05.270749+0000","last_peered":"2024-04-17T15:37:05.270749+0000","last_clean":"2024-04-17T15:37:05.270749+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:37:05.270749+0000","last_undegraded":"2024-04-17T15:37:05.270749+0000","last_fullsized":"2024-04-17T15:37:05.270749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293964+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:37:05.293964+0000","last_peered":"2024-04-17T15:37:05.293964+0000","last_clean":"2024-04-17T15:37:05.293964+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:37:05.293964+0000","last_undegraded":"2024-04-17T15:37:05.293964+0000","last_fullsized":"2024-04-17T15:37:05.293964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290501+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:37:05.290501+0000","last_peered":"2024-04-17T15:37:05.290501+0000","last_clean":"2024-04-17T15:37:05.290501+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:37:05.290501+0000","last_undegraded":"2024-04-17T15:37:05.290501+0000","last_fullsized":"2024-04-17T15:37:05.290501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282049+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:37:05.282049+0000","last_peered":"2024-04-17T15:37:05.282049+0000","last_clean":"2024-04-17T15:37:05.282049+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:37:05.282049+0000","last_undegraded":"2024-04-17T15:37:05.282049+0000","last_fullsized":"2024-04-17T15:37:05.282049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.698358+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:37:05.698358+0000","last_peered":"2024-04-17T15:37:05.698358+0000","last_clean":"2024-04-17T15:37:05.698358+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:37:05.698358+0000","last_undegraded":"2024-04-17T15:37:05.698358+0000","last_fullsized":"2024-04-17T15:37:05.698358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290978+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:37:05.290978+0000","last_peered":"2024-04-17T15:37:05.290978+0000","last_clean":"2024-04-17T15:37:05.290978+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:37:05.290978+0000","last_undegraded":"2024-04-17T15:37:05.290978+0000","last_fullsized":"2024-04-17T15:37:05.290978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280613+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:37:05.280613+0000","last_peered":"2024-04-17T15:37:05.280613+0000","last_clean":"2024-04-17T15:37:05.280613+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:37:05.280613+0000","last_undegraded":"2024-04-17T15:37:05.280613+0000","last_fullsized":"2024-04-17T15:37:05.280613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282624+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:37:05.282624+0000","last_peered":"2024-04-17T15:37:05.282624+0000","last_clean":"2024-04-17T15:37:05.282624+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:37:05.282624+0000","last_undegraded":"2024-04-17T15:37:05.282624+0000","last_fullsized":"2024-04-17T15:37:05.282624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284850+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:37:05.284850+0000","last_peered":"2024-04-17T15:37:05.284850+0000","last_clean":"2024-04-17T15:37:05.284850+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:37:05.284850+0000","last_undegraded":"2024-04-17T15:37:05.284850+0000","last_fullsized":"2024-04-17T15:37:05.284850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293499+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:37:05.293499+0000","last_peered":"2024-04-17T15:37:05.293499+0000","last_clean":"2024-04-17T15:37:05.293499+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:37:05.293499+0000","last_undegraded":"2024-04-17T15:37:05.293499+0000","last_fullsized":"2024-04-17T15:37:05.293499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.109707+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:37:06.109707+0000","last_peered":"2024-04-17T15:37:06.109707+0000","last_clean":"2024-04-17T15:37:06.109707+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:37:06.109707+0000","last_undegraded":"2024-04-17T15:37:06.109707+0000","last_fullsized":"2024-04-17T15:37:06.109707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272801+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:37:05.272801+0000","last_peered":"2024-04-17T15:37:05.272801+0000","last_clean":"2024-04-17T15:37:05.272801+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:37:05.272801+0000","last_undegraded":"2024-04-17T15:37:05.272801+0000","last_fullsized":"2024-04-17T15:37:05.272801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284412+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:37:05.284412+0000","last_peered":"2024-04-17T15:37:05.284412+0000","last_clean":"2024-04-17T15:37:05.284412+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:37:05.284412+0000","last_undegraded":"2024-04-17T15:37:05.284412+0000","last_fullsized":"2024-04-17T15:37:05.284412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.287247+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:37:05.287247+0000","last_peered":"2024-04-17T15:37:05.287247+0000","last_clean":"2024-04-17T15:37:05.287247+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:37:05.287247+0000","last_undegraded":"2024-04-17T15:37:05.287247+0000","last_fullsized":"2024-04-17T15:37:05.287247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290229+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:37:05.290229+0000","last_peered":"2024-04-17T15:37:05.290229+0000","last_clean":"2024-04-17T15:37:05.290229+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:37:05.290229+0000","last_undegraded":"2024-04-17T15:37:05.290229+0000","last_fullsized":"2024-04-17T15:37:05.290229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.295494+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:37:05.295494+0000","last_peered":"2024-04-17T15:37:05.295494+0000","last_clean":"2024-04-17T15:37:05.295494+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:37:05.295494+0000","last_undegraded":"2024-04-17T15:37:05.295494+0000","last_fullsized":"2024-04-17T15:37:05.295494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.164670+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:37:06.164670+0000","last_peered":"2024-04-17T15:37:06.164670+0000","last_clean":"2024-04-17T15:37:06.164670+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:37:06.164670+0000","last_undegraded":"2024-04-17T15:37:06.164670+0000","last_fullsized":"2024-04-17T15:37:06.164670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290745+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:37:05.290745+0000","last_peered":"2024-04-17T15:37:05.290745+0000","last_clean":"2024-04-17T15:37:05.290745+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:37:05.290745+0000","last_undegraded":"2024-04-17T15:37:05.290745+0000","last_fullsized":"2024-04-17T15:37:05.290745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271249+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:37:05.271249+0000","last_peered":"2024-04-17T15:37:05.271249+0000","last_clean":"2024-04-17T15:37:05.271249+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:37:05.271249+0000","last_undegraded":"2024-04-17T15:37:05.271249+0000","last_fullsized":"2024-04-17T15:37:05.271249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.295080+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:37:05.295080+0000","last_peered":"2024-04-17T15:37:05.295080+0000","last_clean":"2024-04-17T15:37:05.295080+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:37:05.295080+0000","last_undegraded":"2024-04-17T15:37:05.295080+0000","last_fullsized":"2024-04-17T15:37:05.295080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299333+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:37:05.299333+0000","last_peered":"2024-04-17T15:37:05.299333+0000","last_clean":"2024-04-17T15:37:05.299333+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:37:05.299333+0000","last_undegraded":"2024-04-17T15:37:05.299333+0000","last_fullsized":"2024-04-17T15:37:05.299333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282020+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:37:05.282020+0000","last_peered":"2024-04-17T15:37:05.282020+0000","last_clean":"2024-04-17T15:37:05.282020+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:37:05.282020+0000","last_undegraded":"2024-04-17T15:37:05.282020+0000","last_fullsized":"2024-04-17T15:37:05.282020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.172629+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:37:06.172629+0000","last_peered":"2024-04-17T15:37:06.172629+0000","last_clean":"2024-04-17T15:37:06.172629+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:37:06.172629+0000","last_undegraded":"2024-04-17T15:37:06.172629+0000","last_fullsized":"2024-04-17T15:37:06.172629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293014+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:37:05.293014+0000","last_peered":"2024-04-17T15:37:05.293014+0000","last_clean":"2024-04-17T15:37:05.293014+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:37:05.293014+0000","last_undegraded":"2024-04-17T15:37:05.293014+0000","last_fullsized":"2024-04-17T15:37:05.293014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281022+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:37:05.281022+0000","last_peered":"2024-04-17T15:37:05.281022+0000","last_clean":"2024-04-17T15:37:05.281022+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:37:05.281022+0000","last_undegraded":"2024-04-17T15:37:05.281022+0000","last_fullsized":"2024-04-17T15:37:05.281022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291567+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:37:05.291567+0000","last_peered":"2024-04-17T15:37:05.291567+0000","last_clean":"2024-04-17T15:37:05.291567+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:37:05.291567+0000","last_undegraded":"2024-04-17T15:37:05.291567+0000","last_fullsized":"2024-04-17T15:37:05.291567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289295+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:37:05.289295+0000","last_peered":"2024-04-17T15:37:05.289295+0000","last_clean":"2024-04-17T15:37:05.289295+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:37:05.289295+0000","last_undegraded":"2024-04-17T15:37:05.289295+0000","last_fullsized":"2024-04-17T15:37:05.289295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.274561+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:37:06.274561+0000","last_peered":"2024-04-17T15:37:06.274561+0000","last_clean":"2024-04-17T15:37:06.274561+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:37:06.274561+0000","last_undegraded":"2024-04-17T15:37:06.274561+0000","last_fullsized":"2024-04-17T15:37:06.274561+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267629+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:37:05.267629+0000","last_peered":"2024-04-17T15:37:05.267629+0000","last_clean":"2024-04-17T15:37:05.267629+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:37:05.267629+0000","last_undegraded":"2024-04-17T15:37:05.267629+0000","last_fullsized":"2024-04-17T15:37:05.267629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282140+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:37:05.282140+0000","last_peered":"2024-04-17T15:37:05.282140+0000","last_clean":"2024-04-17T15:37:05.282140+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:37:05.282140+0000","last_undegraded":"2024-04-17T15:37:05.282140+0000","last_fullsized":"2024-04-17T15:37:05.282140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271109+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:37:05.271109+0000","last_peered":"2024-04-17T15:37:05.271109+0000","last_clean":"2024-04-17T15:37:05.271109+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:37:05.271109+0000","last_undegraded":"2024-04-17T15:37:05.271109+0000","last_fullsized":"2024-04-17T15:37:05.271109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291418+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:37:05.291418+0000","last_peered":"2024-04-17T15:37:05.291418+0000","last_clean":"2024-04-17T15:37:05.291418+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:37:05.291418+0000","last_undegraded":"2024-04-17T15:37:05.291418+0000","last_fullsized":"2024-04-17T15:37:05.291418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271255+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:37:05.271255+0000","last_peered":"2024-04-17T15:37:05.271255+0000","last_clean":"2024-04-17T15:37:05.271255+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:37:05.271255+0000","last_undegraded":"2024-04-17T15:37:05.271255+0000","last_fullsized":"2024-04-17T15:37:05.271255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.143801+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:37:06.143801+0000","last_peered":"2024-04-17T15:37:06.143801+0000","last_clean":"2024-04-17T15:37:06.143801+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:37:06.143801+0000","last_undegraded":"2024-04-17T15:37:06.143801+0000","last_fullsized":"2024-04-17T15:37:06.143801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291957+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:37:05.291957+0000","last_peered":"2024-04-17T15:37:05.291957+0000","last_clean":"2024-04-17T15:37:05.291957+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:37:05.291957+0000","last_undegraded":"2024-04-17T15:37:05.291957+0000","last_fullsized":"2024-04-17T15:37:05.291957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.302762+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:37:05.302762+0000","last_peered":"2024-04-17T15:37:05.302762+0000","last_clean":"2024-04-17T15:37:05.302762+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:37:05.302762+0000","last_undegraded":"2024-04-17T15:37:05.302762+0000","last_fullsized":"2024-04-17T15:37:05.302762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300133+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:37:05.300133+0000","last_peered":"2024-04-17T15:37:05.300133+0000","last_clean":"2024-04-17T15:37:05.300133+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:37:05.300133+0000","last_undegraded":"2024-04-17T15:37:05.300133+0000","last_fullsized":"2024-04-17T15:37:05.300133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291998+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:37:05.291998+0000","last_peered":"2024-04-17T15:37:05.291998+0000","last_clean":"2024-04-17T15:37:05.291998+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:37:05.291998+0000","last_undegraded":"2024-04-17T15:37:05.291998+0000","last_fullsized":"2024-04-17T15:37:05.291998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272599+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:37:05.272599+0000","last_peered":"2024-04-17T15:37:05.272599+0000","last_clean":"2024-04-17T15:37:05.272599+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:37:05.272599+0000","last_undegraded":"2024-04-17T15:37:05.272599+0000","last_fullsized":"2024-04-17T15:37:05.272599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.058974+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:37:06.058974+0000","last_peered":"2024-04-17T15:37:06.058974+0000","last_clean":"2024-04-17T15:37:06.058974+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:37:06.058974+0000","last_undegraded":"2024-04-17T15:37:06.058974+0000","last_fullsized":"2024-04-17T15:37:06.058974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283959+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:37:05.283959+0000","last_peered":"2024-04-17T15:37:05.283959+0000","last_clean":"2024-04-17T15:37:05.283959+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:37:05.283959+0000","last_undegraded":"2024-04-17T15:37:05.283959+0000","last_fullsized":"2024-04-17T15:37:05.283959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286680+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:37:05.286680+0000","last_peered":"2024-04-17T15:37:05.286680+0000","last_clean":"2024-04-17T15:37:05.286680+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:37:05.286680+0000","last_undegraded":"2024-04-17T15:37:05.286680+0000","last_fullsized":"2024-04-17T15:37:05.286680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286940+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:37:05.286940+0000","last_peered":"2024-04-17T15:37:05.286940+0000","last_clean":"2024-04-17T15:37:05.286940+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:37:05.286940+0000","last_undegraded":"2024-04-17T15:37:05.286940+0000","last_fullsized":"2024-04-17T15:37:05.286940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283064+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:37:05.283064+0000","last_peered":"2024-04-17T15:37:05.283064+0000","last_clean":"2024-04-17T15:37:05.283064+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:37:05.283064+0000","last_undegraded":"2024-04-17T15:37:05.283064+0000","last_fullsized":"2024-04-17T15:37:05.283064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271923+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:37:05.271923+0000","last_peered":"2024-04-17T15:37:05.271923+0000","last_clean":"2024-04-17T15:37:05.271923+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:37:05.271923+0000","last_undegraded":"2024-04-17T15:37:05.271923+0000","last_fullsized":"2024-04-17T15:37:05.271923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.655984+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:37:05.655984+0000","last_peered":"2024-04-17T15:37:05.655984+0000","last_clean":"2024-04-17T15:37:05.655984+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:37:05.655984+0000","last_undegraded":"2024-04-17T15:37:05.655984+0000","last_fullsized":"2024-04-17T15:37:05.655984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270904+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:37:05.270904+0000","last_peered":"2024-04-17T15:37:05.270904+0000","last_clean":"2024-04-17T15:37:05.270904+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:37:05.270904+0000","last_undegraded":"2024-04-17T15:37:05.270904+0000","last_fullsized":"2024-04-17T15:37:05.270904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270652+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:37:05.270652+0000","last_peered":"2024-04-17T15:37:05.270652+0000","last_clean":"2024-04-17T15:37:05.270652+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:37:05.270652+0000","last_undegraded":"2024-04-17T15:37:05.270652+0000","last_fullsized":"2024-04-17T15:37:05.270652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272826+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:37:05.272826+0000","last_peered":"2024-04-17T15:37:05.272826+0000","last_clean":"2024-04-17T15:37:05.272826+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:37:05.272826+0000","last_undegraded":"2024-04-17T15:37:05.272826+0000","last_fullsized":"2024-04-17T15:37:05.272826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292505+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:37:05.292505+0000","last_peered":"2024-04-17T15:37:05.292505+0000","last_clean":"2024-04-17T15:37:05.292505+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:37:05.292505+0000","last_undegraded":"2024-04-17T15:37:05.292505+0000","last_fullsized":"2024-04-17T15:37:05.292505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272597+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:37:05.272597+0000","last_peered":"2024-04-17T15:37:05.272597+0000","last_clean":"2024-04-17T15:37:05.272597+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:37:05.272597+0000","last_undegraded":"2024-04-17T15:37:05.272597+0000","last_fullsized":"2024-04-17T15:37:05.272597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.208623+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:37:06.208623+0000","last_peered":"2024-04-17T15:37:06.208623+0000","last_clean":"2024-04-17T15:37:06.208623+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:37:06.208623+0000","last_undegraded":"2024-04-17T15:37:06.208623+0000","last_fullsized":"2024-04-17T15:37:06.208623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286449+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:37:05.286449+0000","last_peered":"2024-04-17T15:37:05.286449+0000","last_clean":"2024-04-17T15:37:05.286449+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:37:05.286449+0000","last_undegraded":"2024-04-17T15:37:05.286449+0000","last_fullsized":"2024-04-17T15:37:05.286449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292012+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:37:05.292012+0000","last_peered":"2024-04-17T15:37:05.292012+0000","last_clean":"2024-04-17T15:37:05.292012+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:37:05.292012+0000","last_undegraded":"2024-04-17T15:37:05.292012+0000","last_fullsized":"2024-04-17T15:37:05.292012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272850+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:37:05.272850+0000","last_peered":"2024-04-17T15:37:05.272850+0000","last_clean":"2024-04-17T15:37:05.272850+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:37:05.272850+0000","last_undegraded":"2024-04-17T15:37:05.272850+0000","last_fullsized":"2024-04-17T15:37:05.272850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300385+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:37:05.300385+0000","last_peered":"2024-04-17T15:37:05.300385+0000","last_clean":"2024-04-17T15:37:05.300385+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:37:05.300385+0000","last_undegraded":"2024-04-17T15:37:05.300385+0000","last_fullsized":"2024-04-17T15:37:05.300385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268078+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:37:05.268078+0000","last_peered":"2024-04-17T15:37:05.268078+0000","last_clean":"2024-04-17T15:37:05.268078+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:37:05.268078+0000","last_undegraded":"2024-04-17T15:37:05.268078+0000","last_fullsized":"2024-04-17T15:37:05.268078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.280646+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:37:06.280646+0000","last_peered":"2024-04-17T15:37:06.280646+0000","last_clean":"2024-04-17T15:37:06.280646+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:37:06.280646+0000","last_undegraded":"2024-04-17T15:37:06.280646+0000","last_fullsized":"2024-04-17T15:37:06.280646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273915+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:37:05.273915+0000","last_peered":"2024-04-17T15:37:05.273915+0000","last_clean":"2024-04-17T15:37:05.273915+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:37:05.273915+0000","last_undegraded":"2024-04-17T15:37:05.273915+0000","last_fullsized":"2024-04-17T15:37:05.273915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268339+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:37:05.268339+0000","last_peered":"2024-04-17T15:37:05.268339+0000","last_clean":"2024-04-17T15:37:05.268339+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:37:05.268339+0000","last_undegraded":"2024-04-17T15:37:05.268339+0000","last_fullsized":"2024-04-17T15:37:05.268339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273418+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:37:05.273418+0000","last_peered":"2024-04-17T15:37:05.273418+0000","last_clean":"2024-04-17T15:37:05.273418+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:37:05.273418+0000","last_undegraded":"2024-04-17T15:37:05.273418+0000","last_fullsized":"2024-04-17T15:37:05.273418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271868+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:37:05.271868+0000","last_peered":"2024-04-17T15:37:05.271868+0000","last_clean":"2024-04-17T15:37:05.271868+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:37:05.271868+0000","last_undegraded":"2024-04-17T15:37:05.271868+0000","last_fullsized":"2024-04-17T15:37:05.271868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282231+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:37:05.282231+0000","last_peered":"2024-04-17T15:37:05.282231+0000","last_clean":"2024-04-17T15:37:05.282231+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:37:05.282231+0000","last_undegraded":"2024-04-17T15:37:05.282231+0000","last_fullsized":"2024-04-17T15:37:05.282231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.065087+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:37:06.065087+0000","last_peered":"2024-04-17T15:37:06.065087+0000","last_clean":"2024-04-17T15:37:06.065087+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:37:06.065087+0000","last_undegraded":"2024-04-17T15:37:06.065087+0000","last_fullsized":"2024-04-17T15:37:06.065087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.303156+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:37:05.303156+0000","last_peered":"2024-04-17T15:37:05.303156+0000","last_clean":"2024-04-17T15:37:05.303156+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:37:05.303156+0000","last_undegraded":"2024-04-17T15:37:05.303156+0000","last_fullsized":"2024-04-17T15:37:05.303156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271658+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:37:05.271658+0000","last_peered":"2024-04-17T15:37:05.271658+0000","last_clean":"2024-04-17T15:37:05.271658+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:37:05.271658+0000","last_undegraded":"2024-04-17T15:37:05.271658+0000","last_fullsized":"2024-04-17T15:37:05.271658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271003+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:37:05.271003+0000","last_peered":"2024-04-17T15:37:05.271003+0000","last_clean":"2024-04-17T15:37:05.271003+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:37:05.271003+0000","last_undegraded":"2024-04-17T15:37:05.271003+0000","last_fullsized":"2024-04-17T15:37:05.271003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293233+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:37:05.293233+0000","last_peered":"2024-04-17T15:37:05.293233+0000","last_clean":"2024-04-17T15:37:05.293233+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:37:05.293233+0000","last_undegraded":"2024-04-17T15:37:05.293233+0000","last_fullsized":"2024-04-17T15:37:05.293233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273120+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:37:05.273120+0000","last_peered":"2024-04-17T15:37:05.273120+0000","last_clean":"2024-04-17T15:37:05.273120+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:37:05.273120+0000","last_undegraded":"2024-04-17T15:37:05.273120+0000","last_fullsized":"2024-04-17T15:37:05.273120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.200712+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:37:06.200712+0000","last_peered":"2024-04-17T15:37:06.200712+0000","last_clean":"2024-04-17T15:37:06.200712+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:37:06.200712+0000","last_undegraded":"2024-04-17T15:37:06.200712+0000","last_fullsized":"2024-04-17T15:37:06.200712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299567+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:37:05.299567+0000","last_peered":"2024-04-17T15:37:05.299567+0000","last_clean":"2024-04-17T15:37:05.299567+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:37:05.299567+0000","last_undegraded":"2024-04-17T15:37:05.299567+0000","last_fullsized":"2024-04-17T15:37:05.299567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267692+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:37:05.267692+0000","last_peered":"2024-04-17T15:37:05.267692+0000","last_clean":"2024-04-17T15:37:05.267692+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:37:05.267692+0000","last_undegraded":"2024-04-17T15:37:05.267692+0000","last_fullsized":"2024-04-17T15:37:05.267692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.303561+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:37:05.303561+0000","last_peered":"2024-04-17T15:37:05.303561+0000","last_clean":"2024-04-17T15:37:05.303561+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:37:05.303561+0000","last_undegraded":"2024-04-17T15:37:05.303561+0000","last_fullsized":"2024-04-17T15:37:05.303561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289925+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:37:05.289925+0000","last_peered":"2024-04-17T15:37:05.289925+0000","last_clean":"2024-04-17T15:37:05.289925+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:37:05.289925+0000","last_undegraded":"2024-04-17T15:37:05.289925+0000","last_fullsized":"2024-04-17T15:37:05.289925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281401+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:37:05.281401+0000","last_peered":"2024-04-17T15:37:05.281401+0000","last_clean":"2024-04-17T15:37:05.281401+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:37:05.281401+0000","last_undegraded":"2024-04-17T15:37:05.281401+0000","last_fullsized":"2024-04-17T15:37:05.281401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292922+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:37:05.292922+0000","last_peered":"2024-04-17T15:37:05.292922+0000","last_clean":"2024-04-17T15:37:05.292922+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:37:05.292922+0000","last_undegraded":"2024-04-17T15:37:05.292922+0000","last_fullsized":"2024-04-17T15:37:05.292922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290619+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:37:05.290619+0000","last_peered":"2024-04-17T15:37:05.290619+0000","last_clean":"2024-04-17T15:37:05.290619+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:37:05.290619+0000","last_undegraded":"2024-04-17T15:37:05.290619+0000","last_fullsized":"2024-04-17T15:37:05.290619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.995736+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:37:05.995736+0000","last_peered":"2024-04-17T15:37:05.995736+0000","last_clean":"2024-04-17T15:37:05.995736+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:37:05.995736+0000","last_undegraded":"2024-04-17T15:37:05.995736+0000","last_fullsized":"2024-04-17T15:37:05.995736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286369+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:37:05.286369+0000","last_peered":"2024-04-17T15:37:05.286369+0000","last_clean":"2024-04-17T15:37:05.286369+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:37:05.286369+0000","last_undegraded":"2024-04-17T15:37:05.286369+0000","last_fullsized":"2024-04-17T15:37:05.286369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299409+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:37:05.299409+0000","last_peered":"2024-04-17T15:37:05.299409+0000","last_clean":"2024-04-17T15:37:05.299409+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:37:05.299409+0000","last_undegraded":"2024-04-17T15:37:05.299409+0000","last_fullsized":"2024-04-17T15:37:05.299409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.287027+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:37:05.287027+0000","last_peered":"2024-04-17T15:37:05.287027+0000","last_clean":"2024-04-17T15:37:05.287027+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:37:05.287027+0000","last_undegraded":"2024-04-17T15:37:05.287027+0000","last_fullsized":"2024-04-17T15:37:05.287027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289728+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:37:05.289728+0000","last_peered":"2024-04-17T15:37:05.289728+0000","last_clean":"2024-04-17T15:37:05.289728+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:37:05.289728+0000","last_undegraded":"2024-04-17T15:37:05.289728+0000","last_fullsized":"2024-04-17T15:37:05.289728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284579+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:37:05.284579+0000","last_peered":"2024-04-17T15:37:05.284579+0000","last_clean":"2024-04-17T15:37:05.284579+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:37:05.284579+0000","last_undegraded":"2024-04-17T15:37:05.284579+0000","last_fullsized":"2024-04-17T15:37:05.284579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283066+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:37:05.283066+0000","last_peered":"2024-04-17T15:37:05.283066+0000","last_clean":"2024-04-17T15:37:05.283066+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:37:05.283066+0000","last_undegraded":"2024-04-17T15:37:05.283066+0000","last_fullsized":"2024-04-17T15:37:05.283066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.188520+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:37:06.188520+0000","last_peered":"2024-04-17T15:37:06.188520+0000","last_clean":"2024-04-17T15:37:06.188520+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:37:06.188520+0000","last_undegraded":"2024-04-17T15:37:06.188520+0000","last_fullsized":"2024-04-17T15:37:06.188520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290917+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:37:05.290917+0000","last_peered":"2024-04-17T15:37:05.290917+0000","last_clean":"2024-04-17T15:37:05.290917+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:37:05.290917+0000","last_undegraded":"2024-04-17T15:37:05.290917+0000","last_fullsized":"2024-04-17T15:37:05.290917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267683+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:37:05.267683+0000","last_peered":"2024-04-17T15:37:05.267683+0000","last_clean":"2024-04-17T15:37:05.267683+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:37:05.267683+0000","last_undegraded":"2024-04-17T15:37:05.267683+0000","last_fullsized":"2024-04-17T15:37:05.267683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271244+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:37:05.271244+0000","last_peered":"2024-04-17T15:37:05.271244+0000","last_clean":"2024-04-17T15:37:05.271244+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:37:05.271244+0000","last_undegraded":"2024-04-17T15:37:05.271244+0000","last_fullsized":"2024-04-17T15:37:05.271244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271472+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:37:05.271472+0000","last_peered":"2024-04-17T15:37:05.271472+0000","last_clean":"2024-04-17T15:37:05.271472+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:37:05.271472+0000","last_undegraded":"2024-04-17T15:37:05.271472+0000","last_fullsized":"2024-04-17T15:37:05.271472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267320+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:37:05.267320+0000","last_peered":"2024-04-17T15:37:05.267320+0000","last_clean":"2024-04-17T15:37:05.267320+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:37:05.267320+0000","last_undegraded":"2024-04-17T15:37:05.267320+0000","last_fullsized":"2024-04-17T15:37:05.267320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273352+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:37:05.273352+0000","last_peered":"2024-04-17T15:37:05.273352+0000","last_clean":"2024-04-17T15:37:05.273352+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:37:05.273352+0000","last_undegraded":"2024-04-17T15:37:05.273352+0000","last_fullsized":"2024-04-17T15:37:05.273352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.196703+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:37:06.196703+0000","last_peered":"2024-04-17T15:37:06.196703+0000","last_clean":"2024-04-17T15:37:06.196703+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:37:06.196703+0000","last_undegraded":"2024-04-17T15:37:06.196703+0000","last_fullsized":"2024-04-17T15:37:06.196703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285273+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:37:05.285273+0000","last_peered":"2024-04-17T15:37:05.285273+0000","last_clean":"2024-04-17T15:37:05.285273+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:37:05.285273+0000","last_undegraded":"2024-04-17T15:37:05.285273+0000","last_fullsized":"2024-04-17T15:37:05.285273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293696+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:37:05.293696+0000","last_peered":"2024-04-17T15:37:05.293696+0000","last_clean":"2024-04-17T15:37:05.293696+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:37:05.293696+0000","last_undegraded":"2024-04-17T15:37:05.293696+0000","last_fullsized":"2024-04-17T15:37:05.293696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268391+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:37:05.268391+0000","last_peered":"2024-04-17T15:37:05.268391+0000","last_clean":"2024-04-17T15:37:05.268391+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:37:05.268391+0000","last_undegraded":"2024-04-17T15:37:05.268391+0000","last_fullsized":"2024-04-17T15:37:05.268391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281656+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:37:05.281656+0000","last_peered":"2024-04-17T15:37:05.281656+0000","last_clean":"2024-04-17T15:37:05.281656+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:37:05.281656+0000","last_undegraded":"2024-04-17T15:37:05.281656+0000","last_fullsized":"2024-04-17T15:37:05.281656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272241+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:37:05.272241+0000","last_peered":"2024-04-17T15:37:05.272241+0000","last_clean":"2024-04-17T15:37:05.272241+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:37:05.272241+0000","last_undegraded":"2024-04-17T15:37:05.272241+0000","last_fullsized":"2024-04-17T15:37:05.272241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286009+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:37:05.286009+0000","last_peered":"2024-04-17T15:37:05.286009+0000","last_clean":"2024-04-17T15:37:05.286009+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:37:05.286009+0000","last_undegraded":"2024-04-17T15:37:05.286009+0000","last_fullsized":"2024-04-17T15:37:05.286009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.029851+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:37:06.029851+0000","last_peered":"2024-04-17T15:37:06.029851+0000","last_clean":"2024-04-17T15:37:06.029851+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:37:06.029851+0000","last_undegraded":"2024-04-17T15:37:06.029851+0000","last_fullsized":"2024-04-17T15:37:06.029851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300713+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:37:05.300713+0000","last_peered":"2024-04-17T15:37:05.300713+0000","last_clean":"2024-04-17T15:37:05.300713+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:37:05.300713+0000","last_undegraded":"2024-04-17T15:37:05.300713+0000","last_fullsized":"2024-04-17T15:37:05.300713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280399+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:37:05.280399+0000","last_peered":"2024-04-17T15:37:05.280399+0000","last_clean":"2024-04-17T15:37:05.280399+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:37:05.280399+0000","last_undegraded":"2024-04-17T15:37:05.280399+0000","last_fullsized":"2024-04-17T15:37:05.280399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268531+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:37:05.268531+0000","last_peered":"2024-04-17T15:37:05.268531+0000","last_clean":"2024-04-17T15:37:05.268531+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:37:05.268531+0000","last_undegraded":"2024-04-17T15:37:05.268531+0000","last_fullsized":"2024-04-17T15:37:05.268531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282901+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:37:05.282901+0000","last_peered":"2024-04-17T15:37:05.282901+0000","last_clean":"2024-04-17T15:37:05.282901+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:37:05.282901+0000","last_undegraded":"2024-04-17T15:37:05.282901+0000","last_fullsized":"2024-04-17T15:37:05.282901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268733+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:37:05.268733+0000","last_peered":"2024-04-17T15:37:05.268733+0000","last_clean":"2024-04-17T15:37:05.268733+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:37:05.268733+0000","last_undegraded":"2024-04-17T15:37:05.268733+0000","last_fullsized":"2024-04-17T15:37:05.268733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285604+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:37:05.285604+0000","last_peered":"2024-04-17T15:37:05.285604+0000","last_clean":"2024-04-17T15:37:05.285604+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:37:05.285604+0000","last_undegraded":"2024-04-17T15:37:05.285604+0000","last_fullsized":"2024-04-17T15:37:05.285604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.122618+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:37:06.122618+0000","last_peered":"2024-04-17T15:37:06.122618+0000","last_clean":"2024-04-17T15:37:06.122618+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:37:06.122618+0000","last_undegraded":"2024-04-17T15:37:06.122618+0000","last_fullsized":"2024-04-17T15:37:06.122618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270544+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:37:05.270544+0000","last_peered":"2024-04-17T15:37:05.270544+0000","last_clean":"2024-04-17T15:37:05.270544+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:37:05.270544+0000","last_undegraded":"2024-04-17T15:37:05.270544+0000","last_fullsized":"2024-04-17T15:37:05.270544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286173+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:37:05.286173+0000","last_peered":"2024-04-17T15:37:05.286173+0000","last_clean":"2024-04-17T15:37:05.286173+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:37:05.286173+0000","last_undegraded":"2024-04-17T15:37:05.286173+0000","last_fullsized":"2024-04-17T15:37:05.286173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286819+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:37:05.286819+0000","last_peered":"2024-04-17T15:37:05.286819+0000","last_clean":"2024-04-17T15:37:05.286819+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:37:05.286819+0000","last_undegraded":"2024-04-17T15:37:05.286819+0000","last_fullsized":"2024-04-17T15:37:05.286819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268453+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:37:05.268453+0000","last_peered":"2024-04-17T15:37:05.268453+0000","last_clean":"2024-04-17T15:37:05.268453+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:37:05.268453+0000","last_undegraded":"2024-04-17T15:37:05.268453+0000","last_fullsized":"2024-04-17T15:37:05.268453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292209+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:37:05.292209+0000","last_peered":"2024-04-17T15:37:05.292209+0000","last_clean":"2024-04-17T15:37:05.292209+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:37:05.292209+0000","last_undegraded":"2024-04-17T15:37:05.292209+0000","last_fullsized":"2024-04-17T15:37:05.292209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299791+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:37:05.299791+0000","last_peered":"2024-04-17T15:37:05.299791+0000","last_clean":"2024-04-17T15:37:05.299791+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:37:05.299791+0000","last_undegraded":"2024-04-17T15:37:05.299791+0000","last_fullsized":"2024-04-17T15:37:05.299791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.222396+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:37:06.222396+0000","last_peered":"2024-04-17T15:37:06.222396+0000","last_clean":"2024-04-17T15:37:06.222396+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:37:06.222396+0000","last_undegraded":"2024-04-17T15:37:06.222396+0000","last_fullsized":"2024-04-17T15:37:06.222396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282978+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:37:05.282978+0000","last_peered":"2024-04-17T15:37:05.282978+0000","last_clean":"2024-04-17T15:37:05.282978+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:37:05.282978+0000","last_undegraded":"2024-04-17T15:37:05.282978+0000","last_fullsized":"2024-04-17T15:37:05.282978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.295418+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:37:05.295418+0000","last_peered":"2024-04-17T15:37:05.295418+0000","last_clean":"2024-04-17T15:37:05.295418+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:37:05.295418+0000","last_undegraded":"2024-04-17T15:37:05.295418+0000","last_fullsized":"2024-04-17T15:37:05.295418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292360+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:37:05.292360+0000","last_peered":"2024-04-17T15:37:05.292360+0000","last_clean":"2024-04-17T15:37:05.292360+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:37:05.292360+0000","last_undegraded":"2024-04-17T15:37:05.292360+0000","last_fullsized":"2024-04-17T15:37:05.292360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294066+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:37:05.294066+0000","last_peered":"2024-04-17T15:37:05.294066+0000","last_clean":"2024-04-17T15:37:05.294066+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:37:05.294066+0000","last_undegraded":"2024-04-17T15:37:05.294066+0000","last_fullsized":"2024-04-17T15:37:05.294066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271304+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:37:05.271304+0000","last_peered":"2024-04-17T15:37:05.271304+0000","last_clean":"2024-04-17T15:37:05.271304+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:37:05.271304+0000","last_undegraded":"2024-04-17T15:37:05.271304+0000","last_fullsized":"2024-04-17T15:37:05.271304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270845+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:37:05.270845+0000","last_peered":"2024-04-17T15:37:05.270845+0000","last_clean":"2024-04-17T15:37:05.270845+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:37:05.270845+0000","last_undegraded":"2024-04-17T15:37:05.270845+0000","last_fullsized":"2024-04-17T15:37:05.270845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.179906+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:37:06.179906+0000","last_peered":"2024-04-17T15:37:06.179906+0000","last_clean":"2024-04-17T15:37:06.179906+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:37:06.179906+0000","last_undegraded":"2024-04-17T15:37:06.179906+0000","last_fullsized":"2024-04-17T15:37:06.179906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294556+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:37:05.294556+0000","last_peered":"2024-04-17T15:37:05.294556+0000","last_clean":"2024-04-17T15:37:05.294556+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:37:05.294556+0000","last_undegraded":"2024-04-17T15:37:05.294556+0000","last_fullsized":"2024-04-17T15:37:05.294556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285793+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:37:05.285793+0000","last_peered":"2024-04-17T15:37:05.285793+0000","last_clean":"2024-04-17T15:37:05.285793+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:37:05.285793+0000","last_undegraded":"2024-04-17T15:37:05.285793+0000","last_fullsized":"2024-04-17T15:37:05.285793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271165+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:37:05.271165+0000","last_peered":"2024-04-17T15:37:05.271165+0000","last_clean":"2024-04-17T15:37:05.271165+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:37:05.271165+0000","last_undegraded":"2024-04-17T15:37:05.271165+0000","last_fullsized":"2024-04-17T15:37:05.271165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.287330+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:37:05.287330+0000","last_peered":"2024-04-17T15:37:05.287330+0000","last_clean":"2024-04-17T15:37:05.287330+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:37:05.287330+0000","last_undegraded":"2024-04-17T15:37:05.287330+0000","last_fullsized":"2024-04-17T15:37:05.287330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.301348+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:37:05.301348+0000","last_peered":"2024-04-17T15:37:05.301348+0000","last_clean":"2024-04-17T15:37:05.301348+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:37:05.301348+0000","last_undegraded":"2024-04-17T15:37:05.301348+0000","last_fullsized":"2024-04-17T15:37:05.301348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292196+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:37:05.292196+0000","last_peered":"2024-04-17T15:37:05.292196+0000","last_clean":"2024-04-17T15:37:05.292196+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:37:05.292196+0000","last_undegraded":"2024-04-17T15:37:05.292196+0000","last_fullsized":"2024-04-17T15:37:05.292196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.158234+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:37:06.158234+0000","last_peered":"2024-04-17T15:37:06.158234+0000","last_clean":"2024-04-17T15:37:06.158234+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:37:06.158234+0000","last_undegraded":"2024-04-17T15:37:06.158234+0000","last_fullsized":"2024-04-17T15:37:06.158234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292032+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:37:05.292032+0000","last_peered":"2024-04-17T15:37:05.292032+0000","last_clean":"2024-04-17T15:37:05.292032+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:37:05.292032+0000","last_undegraded":"2024-04-17T15:37:05.292032+0000","last_fullsized":"2024-04-17T15:37:05.292032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281876+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:37:05.281876+0000","last_peered":"2024-04-17T15:37:05.281876+0000","last_clean":"2024-04-17T15:37:05.281876+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:37:05.281876+0000","last_undegraded":"2024-04-17T15:37:05.281876+0000","last_fullsized":"2024-04-17T15:37:05.281876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286287+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:37:05.286287+0000","last_peered":"2024-04-17T15:37:05.286287+0000","last_clean":"2024-04-17T15:37:05.286287+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:37:05.286287+0000","last_undegraded":"2024-04-17T15:37:05.286287+0000","last_fullsized":"2024-04-17T15:37:05.286287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271706+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:37:05.271706+0000","last_peered":"2024-04-17T15:37:05.271706+0000","last_clean":"2024-04-17T15:37:05.271706+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:37:05.271706+0000","last_undegraded":"2024-04-17T15:37:05.271706+0000","last_fullsized":"2024-04-17T15:37:05.271706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271886+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:37:05.271886+0000","last_peered":"2024-04-17T15:37:05.271886+0000","last_clean":"2024-04-17T15:37:05.271886+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:37:05.271886+0000","last_undegraded":"2024-04-17T15:37:05.271886+0000","last_fullsized":"2024-04-17T15:37:05.271886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268765+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:37:05.268765+0000","last_peered":"2024-04-17T15:37:05.268765+0000","last_clean":"2024-04-17T15:37:05.268765+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:37:05.268765+0000","last_undegraded":"2024-04-17T15:37:05.268765+0000","last_fullsized":"2024-04-17T15:37:05.268765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.229245+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:37:06.229245+0000","last_peered":"2024-04-17T15:37:06.229245+0000","last_clean":"2024-04-17T15:37:06.229245+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:37:06.229245+0000","last_undegraded":"2024-04-17T15:37:06.229245+0000","last_fullsized":"2024-04-17T15:37:06.229245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291733+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:37:05.291733+0000","last_peered":"2024-04-17T15:37:05.291733+0000","last_clean":"2024-04-17T15:37:05.291733+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:37:05.291733+0000","last_undegraded":"2024-04-17T15:37:05.291733+0000","last_fullsized":"2024-04-17T15:37:05.291733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294452+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:37:05.294452+0000","last_peered":"2024-04-17T15:37:05.294452+0000","last_clean":"2024-04-17T15:37:05.294452+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:37:05.294452+0000","last_undegraded":"2024-04-17T15:37:05.294452+0000","last_fullsized":"2024-04-17T15:37:05.294452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268273+0000","last_change":"2024-04-17T15:36:56.210604+0000","last_active":"2024-04-17T15:37:05.268273+0000","last_peered":"2024-04-17T15:37:05.268273+0000","last_clean":"2024-04-17T15:37:05.268273+0000","last_became_active":"2024-04-17T15:36:56.210290+0000","last_became_peered":"2024-04-17T15:36:56.210290+0000","last_unstale":"2024-04-17T15:37:05.268273+0000","last_undegraded":"2024-04-17T15:37:05.268273+0000","last_fullsized":"2024-04-17T15:37:05.268273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291997+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:37:05.291997+0000","last_peered":"2024-04-17T15:37:05.291997+0000","last_clean":"2024-04-17T15:37:05.291997+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:37:05.291997+0000","last_undegraded":"2024-04-17T15:37:05.291997+0000","last_fullsized":"2024-04-17T15:37:05.291997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293038+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:37:05.293038+0000","last_peered":"2024-04-17T15:37:05.293038+0000","last_clean":"2024-04-17T15:37:05.293038+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:37:05.293038+0000","last_undegraded":"2024-04-17T15:37:05.293038+0000","last_fullsized":"2024-04-17T15:37:05.293038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'4","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.662658+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:37:05.662658+0000","last_peered":"2024-04-17T15:37:05.662658+0000","last_clean":"2024-04-17T15:37:05.662658+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:37:05.662658+0000","last_undegraded":"2024-04-17T15:37:05.662658+0000","last_fullsized":"2024-04-17T15:37:05.662658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289654+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:37:05.289654+0000","last_peered":"2024-04-17T15:37:05.289654+0000","last_clean":"2024-04-17T15:37:05.289654+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:37:05.289654+0000","last_undegraded":"2024-04-17T15:37:05.289654+0000","last_fullsized":"2024-04-17T15:37:05.289654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285873+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:37:05.285873+0000","last_peered":"2024-04-17T15:37:05.285873+0000","last_clean":"2024-04-17T15:37:05.285873+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:37:05.285873+0000","last_undegraded":"2024-04-17T15:37:05.285873+0000","last_fullsized":"2024-04-17T15:37:05.285873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292268+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:37:05.292268+0000","last_peered":"2024-04-17T15:37:05.292268+0000","last_clean":"2024-04-17T15:37:05.292268+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:37:05.292268+0000","last_undegraded":"2024-04-17T15:37:05.292268+0000","last_fullsized":"2024-04-17T15:37:05.292268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282696+0000","last_change":"2024-04-17T15:36:54.207503+0000","last_active":"2024-04-17T15:37:05.282696+0000","last_peered":"2024-04-17T15:37:05.282696+0000","last_clean":"2024-04-17T15:37:05.282696+0000","last_became_active":"2024-04-17T15:36:54.206672+0000","last_became_peered":"2024-04-17T15:36:54.206672+0000","last_unstale":"2024-04-17T15:37:05.282696+0000","last_undegraded":"2024-04-17T15:37:05.282696+0000","last_fullsized":"2024-04-17T15:37:05.282696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.288875+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:37:05.288875+0000","last_peered":"2024-04-17T15:37:05.288875+0000","last_clean":"2024-04-17T15:37:05.288875+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:37:05.288875+0000","last_undegraded":"2024-04-17T15:37:05.288875+0000","last_fullsized":"2024-04-17T15:37:05.288875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.137336+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:37:06.137336+0000","last_peered":"2024-04-17T15:37:06.137336+0000","last_clean":"2024-04-17T15:37:06.137336+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:37:06.137336+0000","last_undegraded":"2024-04-17T15:37:06.137336+0000","last_fullsized":"2024-04-17T15:37:06.137336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299728+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:37:05.299728+0000","last_peered":"2024-04-17T15:37:05.299728+0000","last_clean":"2024-04-17T15:37:05.299728+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:37:05.299728+0000","last_undegraded":"2024-04-17T15:37:05.299728+0000","last_fullsized":"2024-04-17T15:37:05.299728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281685+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:37:05.281685+0000","last_peered":"2024-04-17T15:37:05.281685+0000","last_clean":"2024-04-17T15:37:05.281685+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:37:05.281685+0000","last_undegraded":"2024-04-17T15:37:05.281685+0000","last_fullsized":"2024-04-17T15:37:05.281685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292830+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:37:05.292830+0000","last_peered":"2024-04-17T15:37:05.292830+0000","last_clean":"2024-04-17T15:37:05.292830+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:37:05.292830+0000","last_undegraded":"2024-04-17T15:37:05.292830+0000","last_fullsized":"2024-04-17T15:37:05.292830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.287129+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:37:05.287129+0000","last_peered":"2024-04-17T15:37:05.287129+0000","last_clean":"2024-04-17T15:37:05.287129+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:37:05.287129+0000","last_undegraded":"2024-04-17T15:37:05.287129+0000","last_fullsized":"2024-04-17T15:37:05.287129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299875+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:37:05.299875+0000","last_peered":"2024-04-17T15:37:05.299875+0000","last_clean":"2024-04-17T15:37:05.299875+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:37:05.299875+0000","last_undegraded":"2024-04-17T15:37:05.299875+0000","last_fullsized":"2024-04-17T15:37:05.299875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.912409+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:37:05.912409+0000","last_peered":"2024-04-17T15:37:05.912409+0000","last_clean":"2024-04-17T15:37:05.912409+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:37:05.912409+0000","last_undegraded":"2024-04-17T15:37:05.912409+0000","last_fullsized":"2024-04-17T15:37:05.912409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285040+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:37:05.285040+0000","last_peered":"2024-04-17T15:37:05.285040+0000","last_clean":"2024-04-17T15:37:05.285040+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:37:05.285040+0000","last_undegraded":"2024-04-17T15:37:05.285040+0000","last_fullsized":"2024-04-17T15:37:05.285040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.301061+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:37:05.301061+0000","last_peered":"2024-04-17T15:37:05.301061+0000","last_clean":"2024-04-17T15:37:05.301061+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:37:05.301061+0000","last_undegraded":"2024-04-17T15:37:05.301061+0000","last_fullsized":"2024-04-17T15:37:05.301061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293012+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:37:05.293012+0000","last_peered":"2024-04-17T15:37:05.293012+0000","last_clean":"2024-04-17T15:37:05.293012+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:37:05.293012+0000","last_undegraded":"2024-04-17T15:37:05.293012+0000","last_fullsized":"2024-04-17T15:37:05.293012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286625+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:37:05.286625+0000","last_peered":"2024-04-17T15:37:05.286625+0000","last_clean":"2024-04-17T15:37:05.286625+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:37:05.286625+0000","last_undegraded":"2024-04-17T15:37:05.286625+0000","last_fullsized":"2024-04-17T15:37:05.286625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.258667+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:37:06.258667+0000","last_peered":"2024-04-17T15:37:06.258667+0000","last_clean":"2024-04-17T15:37:06.258667+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:37:06.258667+0000","last_undegraded":"2024-04-17T15:37:06.258667+0000","last_fullsized":"2024-04-17T15:37:06.258667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282284+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:37:05.282284+0000","last_peered":"2024-04-17T15:37:05.282284+0000","last_clean":"2024-04-17T15:37:05.282284+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:37:05.282284+0000","last_undegraded":"2024-04-17T15:37:05.282284+0000","last_fullsized":"2024-04-17T15:37:05.282284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292416+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:37:05.292416+0000","last_peered":"2024-04-17T15:37:05.292416+0000","last_clean":"2024-04-17T15:37:05.292416+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:37:05.292416+0000","last_undegraded":"2024-04-17T15:37:05.292416+0000","last_fullsized":"2024-04-17T15:37:05.292416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286928+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:37:05.286928+0000","last_peered":"2024-04-17T15:37:05.286928+0000","last_clean":"2024-04-17T15:37:05.286928+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:37:05.286928+0000","last_undegraded":"2024-04-17T15:37:05.286928+0000","last_fullsized":"2024-04-17T15:37:05.286928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.269150+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:37:05.269150+0000","last_peered":"2024-04-17T15:37:05.269150+0000","last_clean":"2024-04-17T15:37:05.269150+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:37:05.269150+0000","last_undegraded":"2024-04-17T15:37:05.269150+0000","last_fullsized":"2024-04-17T15:37:05.269150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300837+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:37:05.300837+0000","last_peered":"2024-04-17T15:37:05.300837+0000","last_clean":"2024-04-17T15:37:05.300837+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:37:05.300837+0000","last_undegraded":"2024-04-17T15:37:05.300837+0000","last_fullsized":"2024-04-17T15:37:05.300837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.038016+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:37:06.038016+0000","last_peered":"2024-04-17T15:37:06.038016+0000","last_clean":"2024-04-17T15:37:06.038016+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:37:06.038016+0000","last_undegraded":"2024-04-17T15:37:06.038016+0000","last_fullsized":"2024-04-17T15:37:06.038016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.269631+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:37:05.269631+0000","last_peered":"2024-04-17T15:37:05.269631+0000","last_clean":"2024-04-17T15:37:05.269631+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:37:05.269631+0000","last_undegraded":"2024-04-17T15:37:05.269631+0000","last_fullsized":"2024-04-17T15:37:05.269631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299617+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:37:05.299617+0000","last_peered":"2024-04-17T15:37:05.299617+0000","last_clean":"2024-04-17T15:37:05.299617+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:37:05.299617+0000","last_undegraded":"2024-04-17T15:37:05.299617+0000","last_fullsized":"2024-04-17T15:37:05.299617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294000+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:37:05.294000+0000","last_peered":"2024-04-17T15:37:05.294000+0000","last_clean":"2024-04-17T15:37:05.294000+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:37:05.294000+0000","last_undegraded":"2024-04-17T15:37:05.294000+0000","last_fullsized":"2024-04-17T15:37:05.294000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272441+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:37:05.272441+0000","last_peered":"2024-04-17T15:37:05.272441+0000","last_clean":"2024-04-17T15:37:05.272441+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:37:05.272441+0000","last_undegraded":"2024-04-17T15:37:05.272441+0000","last_fullsized":"2024-04-17T15:37:05.272441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273310+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:37:05.273310+0000","last_peered":"2024-04-17T15:37:05.273310+0000","last_clean":"2024-04-17T15:37:05.273310+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:37:05.273310+0000","last_undegraded":"2024-04-17T15:37:05.273310+0000","last_fullsized":"2024-04-17T15:37:05.273310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.236358+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:37:06.236358+0000","last_peered":"2024-04-17T15:37:06.236358+0000","last_clean":"2024-04-17T15:37:06.236358+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:37:06.236358+0000","last_undegraded":"2024-04-17T15:37:06.236358+0000","last_fullsized":"2024-04-17T15:37:06.236358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270265+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:37:05.270265+0000","last_peered":"2024-04-17T15:37:05.270265+0000","last_clean":"2024-04-17T15:37:05.270265+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:37:05.270265+0000","last_undegraded":"2024-04-17T15:37:05.270265+0000","last_fullsized":"2024-04-17T15:37:05.270265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.280853+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:37:05.280853+0000","last_peered":"2024-04-17T15:37:05.280853+0000","last_clean":"2024-04-17T15:37:05.280853+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:37:05.280853+0000","last_undegraded":"2024-04-17T15:37:05.280853+0000","last_fullsized":"2024-04-17T15:37:05.280853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273036+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:37:05.273036+0000","last_peered":"2024-04-17T15:37:05.273036+0000","last_clean":"2024-04-17T15:37:05.273036+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:37:05.273036+0000","last_undegraded":"2024-04-17T15:37:05.273036+0000","last_fullsized":"2024-04-17T15:37:05.273036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285296+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:37:05.285296+0000","last_peered":"2024-04-17T15:37:05.285296+0000","last_clean":"2024-04-17T15:37:05.285296+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:37:05.285296+0000","last_undegraded":"2024-04-17T15:37:05.285296+0000","last_fullsized":"2024-04-17T15:37:05.285296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270160+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:37:05.270160+0000","last_peered":"2024-04-17T15:37:05.270160+0000","last_clean":"2024-04-17T15:37:05.270160+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:37:05.270160+0000","last_undegraded":"2024-04-17T15:37:05.270160+0000","last_fullsized":"2024-04-17T15:37:05.270160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.215850+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:37:06.215850+0000","last_peered":"2024-04-17T15:37:06.215850+0000","last_clean":"2024-04-17T15:37:06.215850+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:37:06.215850+0000","last_undegraded":"2024-04-17T15:37:06.215850+0000","last_fullsized":"2024-04-17T15:37:06.215850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300541+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:37:05.300541+0000","last_peered":"2024-04-17T15:37:05.300541+0000","last_clean":"2024-04-17T15:37:05.300541+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:37:05.300541+0000","last_undegraded":"2024-04-17T15:37:05.300541+0000","last_fullsized":"2024-04-17T15:37:05.300541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289216+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:37:05.289216+0000","last_peered":"2024-04-17T15:37:05.289216+0000","last_clean":"2024-04-17T15:37:05.289216+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:37:05.289216+0000","last_undegraded":"2024-04-17T15:37:05.289216+0000","last_fullsized":"2024-04-17T15:37:05.289216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271444+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:37:05.271444+0000","last_peered":"2024-04-17T15:37:05.271444+0000","last_clean":"2024-04-17T15:37:05.271444+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:37:05.271444+0000","last_undegraded":"2024-04-17T15:37:05.271444+0000","last_fullsized":"2024-04-17T15:37:05.271444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282872+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:37:05.282872+0000","last_peered":"2024-04-17T15:37:05.282872+0000","last_clean":"2024-04-17T15:37:05.282872+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:37:05.282872+0000","last_undegraded":"2024-04-17T15:37:05.282872+0000","last_fullsized":"2024-04-17T15:37:05.282872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289530+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:37:05.289530+0000","last_peered":"2024-04-17T15:37:05.289530+0000","last_clean":"2024-04-17T15:37:05.289530+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:37:05.289530+0000","last_undegraded":"2024-04-17T15:37:05.289530+0000","last_fullsized":"2024-04-17T15:37:05.289530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:06.251813+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:37:06.251813+0000","last_peered":"2024-04-17T15:37:06.251813+0000","last_clean":"2024-04-17T15:37:06.251813+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:37:06.251813+0000","last_undegraded":"2024-04-17T15:37:06.251813+0000","last_fullsized":"2024-04-17T15:37:06.251813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283154+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:37:05.283154+0000","last_peered":"2024-04-17T15:37:05.283154+0000","last_clean":"2024-04-17T15:37:05.283154+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:37:05.283154+0000","last_undegraded":"2024-04-17T15:37:05.283154+0000","last_fullsized":"2024-04-17T15:37:05.283154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291857+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:37:05.291857+0000","last_peered":"2024-04-17T15:37:05.291857+0000","last_clean":"2024-04-17T15:37:05.291857+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:37:05.291857+0000","last_undegraded":"2024-04-17T15:37:05.291857+0000","last_fullsized":"2024-04-17T15:37:05.291857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271883+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:37:05.271883+0000","last_peered":"2024-04-17T15:37:05.271883+0000","last_clean":"2024-04-17T15:37:05.271883+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:37:05.271883+0000","last_undegraded":"2024-04-17T15:37:05.271883+0000","last_fullsized":"2024-04-17T15:37:05.271883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282729+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:37:05.282729+0000","last_peered":"2024-04-17T15:37:05.282729+0000","last_clean":"2024-04-17T15:37:05.282729+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:37:05.282729+0000","last_undegraded":"2024-04-17T15:37:05.282729+0000","last_fullsized":"2024-04-17T15:37:05.282729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281074+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:37:05.281074+0000","last_peered":"2024-04-17T15:37:05.281074+0000","last_clean":"2024-04-17T15:37:05.281074+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:37:05.281074+0000","last_undegraded":"2024-04-17T15:37:05.281074+0000","last_fullsized":"2024-04-17T15:37:05.281074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.603229+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:37:05.603229+0000","last_peered":"2024-04-17T15:37:05.603229+0000","last_clean":"2024-04-17T15:37:05.603229+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:37:05.603229+0000","last_undegraded":"2024-04-17T15:37:05.603229+0000","last_fullsized":"2024-04-17T15:37:05.603229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299227+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:37:05.299227+0000","last_peered":"2024-04-17T15:37:05.299227+0000","last_clean":"2024-04-17T15:37:05.299227+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:37:05.299227+0000","last_undegraded":"2024-04-17T15:37:05.299227+0000","last_fullsized":"2024-04-17T15:37:05.299227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294494+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:37:05.294494+0000","last_peered":"2024-04-17T15:37:05.294494+0000","last_clean":"2024-04-17T15:37:05.294494+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:37:05.294494+0000","last_undegraded":"2024-04-17T15:37:05.294494+0000","last_fullsized":"2024-04-17T15:37:05.294494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292465+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:37:05.292465+0000","last_peered":"2024-04-17T15:37:05.292465+0000","last_clean":"2024-04-17T15:37:05.292465+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:37:05.292465+0000","last_undegraded":"2024-04-17T15:37:05.292465+0000","last_fullsized":"2024-04-17T15:37:05.292465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294763+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:37:05.294763+0000","last_peered":"2024-04-17T15:37:05.294763+0000","last_clean":"2024-04-17T15:37:05.294763+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:37:05.294763+0000","last_undegraded":"2024-04-17T15:37:05.294763+0000","last_fullsized":"2024-04-17T15:37:05.294763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270446+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:37:05.270446+0000","last_peered":"2024-04-17T15:37:05.270446+0000","last_clean":"2024-04-17T15:37:05.270446+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:37:05.270446+0000","last_undegraded":"2024-04-17T15:37:05.270446+0000","last_fullsized":"2024-04-17T15:37:05.270446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.860676+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:37:05.860676+0000","last_peered":"2024-04-17T15:37:05.860676+0000","last_clean":"2024-04-17T15:37:05.860676+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:37:05.860676+0000","last_undegraded":"2024-04-17T15:37:05.860676+0000","last_fullsized":"2024-04-17T15:37:05.860676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270830+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:37:05.270830+0000","last_peered":"2024-04-17T15:37:05.270830+0000","last_clean":"2024-04-17T15:37:05.270830+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:37:05.270830+0000","last_undegraded":"2024-04-17T15:37:05.270830+0000","last_fullsized":"2024-04-17T15:37:05.270830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291826+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:37:05.291826+0000","last_peered":"2024-04-17T15:37:05.291826+0000","last_clean":"2024-04-17T15:37:05.291826+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:37:05.291826+0000","last_undegraded":"2024-04-17T15:37:05.291826+0000","last_fullsized":"2024-04-17T15:37:05.291826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271079+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:37:05.271079+0000","last_peered":"2024-04-17T15:37:05.271079+0000","last_clean":"2024-04-17T15:37:05.271079+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:37:05.271079+0000","last_undegraded":"2024-04-17T15:37:05.271079+0000","last_fullsized":"2024-04-17T15:37:05.271079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286810+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:37:05.286810+0000","last_peered":"2024-04-17T15:37:05.286810+0000","last_clean":"2024-04-17T15:37:05.286810+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:37:05.286810+0000","last_undegraded":"2024-04-17T15:37:05.286810+0000","last_fullsized":"2024-04-17T15:37:05.286810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.267441+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:37:05.267441+0000","last_peered":"2024-04-17T15:37:05.267441+0000","last_clean":"2024-04-17T15:37:05.267441+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:37:05.267441+0000","last_undegraded":"2024-04-17T15:37:05.267441+0000","last_fullsized":"2024-04-17T15:37:05.267441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.933312+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:37:05.933312+0000","last_peered":"2024-04-17T15:37:05.933312+0000","last_clean":"2024-04-17T15:37:05.933312+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:37:05.933312+0000","last_undegraded":"2024-04-17T15:37:05.933312+0000","last_fullsized":"2024-04-17T15:37:05.933312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284884+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:37:05.284884+0000","last_peered":"2024-04-17T15:37:05.284884+0000","last_clean":"2024-04-17T15:37:05.284884+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:37:05.284884+0000","last_undegraded":"2024-04-17T15:37:05.284884+0000","last_fullsized":"2024-04-17T15:37:05.284884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273644+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:37:05.273644+0000","last_peered":"2024-04-17T15:37:05.273644+0000","last_clean":"2024-04-17T15:37:05.273644+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:37:05.273644+0000","last_undegraded":"2024-04-17T15:37:05.273644+0000","last_fullsized":"2024-04-17T15:37:05.273644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271453+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:37:05.271453+0000","last_peered":"2024-04-17T15:37:05.271453+0000","last_clean":"2024-04-17T15:37:05.271453+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:37:05.271453+0000","last_undegraded":"2024-04-17T15:37:05.271453+0000","last_fullsized":"2024-04-17T15:37:05.271453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299222+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:37:05.299222+0000","last_peered":"2024-04-17T15:37:05.299222+0000","last_clean":"2024-04-17T15:37:05.299222+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:37:05.299222+0000","last_undegraded":"2024-04-17T15:37:05.299222+0000","last_fullsized":"2024-04-17T15:37:05.299222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271518+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:37:05.271518+0000","last_peered":"2024-04-17T15:37:05.271518+0000","last_clean":"2024-04-17T15:37:05.271518+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:37:05.271518+0000","last_undegraded":"2024-04-17T15:37:05.271518+0000","last_fullsized":"2024-04-17T15:37:05.271518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.271043+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:37:05.271043+0000","last_peered":"2024-04-17T15:37:05.271043+0000","last_clean":"2024-04-17T15:37:05.271043+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:37:05.271043+0000","last_undegraded":"2024-04-17T15:37:05.271043+0000","last_fullsized":"2024-04-17T15:37:05.271043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282061+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:37:05.282061+0000","last_peered":"2024-04-17T15:37:05.282061+0000","last_clean":"2024-04-17T15:37:05.282061+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:37:05.282061+0000","last_undegraded":"2024-04-17T15:37:05.282061+0000","last_fullsized":"2024-04-17T15:37:05.282061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281561+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:37:05.281561+0000","last_peered":"2024-04-17T15:37:05.281561+0000","last_clean":"2024-04-17T15:37:05.281561+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:37:05.281561+0000","last_undegraded":"2024-04-17T15:37:05.281561+0000","last_fullsized":"2024-04-17T15:37:05.281561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268716+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:37:05.268716+0000","last_peered":"2024-04-17T15:37:05.268716+0000","last_clean":"2024-04-17T15:37:05.268716+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:37:05.268716+0000","last_undegraded":"2024-04-17T15:37:05.268716+0000","last_fullsized":"2024-04-17T15:37:05.268716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286631+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:37:05.286631+0000","last_peered":"2024-04-17T15:37:05.286631+0000","last_clean":"2024-04-17T15:37:05.286631+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:37:05.286631+0000","last_undegraded":"2024-04-17T15:37:05.286631+0000","last_fullsized":"2024-04-17T15:37:05.286631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.293550+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:37:05.293550+0000","last_peered":"2024-04-17T15:37:05.293550+0000","last_clean":"2024-04-17T15:37:05.293550+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:37:05.293550+0000","last_undegraded":"2024-04-17T15:37:05.293550+0000","last_fullsized":"2024-04-17T15:37:05.293550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.294330+0000","last_change":"2024-04-17T15:36:54.177547+0000","last_active":"2024-04-17T15:37:05.294330+0000","last_peered":"2024-04-17T15:37:05.294330+0000","last_clean":"2024-04-17T15:37:05.294330+0000","last_became_active":"2024-04-17T15:36:54.176327+0000","last_became_peered":"2024-04-17T15:36:54.176327+0000","last_unstale":"2024-04-17T15:37:05.294330+0000","last_undegraded":"2024-04-17T15:37:05.294330+0000","last_fullsized":"2024-04-17T15:37:05.294330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:54:55.766570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272191+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:37:05.272191+0000","last_peered":"2024-04-17T15:37:05.272191+0000","last_clean":"2024-04-17T15:37:05.272191+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:37:05.272191+0000","last_undegraded":"2024-04-17T15:37:05.272191+0000","last_fullsized":"2024-04-17T15:37:05.272191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.270608+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:37:05.270608+0000","last_peered":"2024-04-17T15:37:05.270608+0000","last_clean":"2024-04-17T15:37:05.270608+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:37:05.270608+0000","last_undegraded":"2024-04-17T15:37:05.270608+0000","last_fullsized":"2024-04-17T15:37:05.270608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292007+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:37:05.292007+0000","last_peered":"2024-04-17T15:37:05.292007+0000","last_clean":"2024-04-17T15:37:05.292007+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:37:05.292007+0000","last_undegraded":"2024-04-17T15:37:05.292007+0000","last_fullsized":"2024-04-17T15:37:05.292007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.301416+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:37:05.301416+0000","last_peered":"2024-04-17T15:37:05.301416+0000","last_clean":"2024-04-17T15:37:05.301416+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:37:05.301416+0000","last_undegraded":"2024-04-17T15:37:05.301416+0000","last_fullsized":"2024-04-17T15:37:05.301416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.299070+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:37:05.299070+0000","last_peered":"2024-04-17T15:37:05.299070+0000","last_clean":"2024-04-17T15:37:05.299070+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:37:05.299070+0000","last_undegraded":"2024-04-17T15:37:05.299070+0000","last_fullsized":"2024-04-17T15:37:05.299070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.295240+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:37:05.295240+0000","last_peered":"2024-04-17T15:37:05.295240+0000","last_clean":"2024-04-17T15:37:05.295240+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:37:05.295240+0000","last_undegraded":"2024-04-17T15:37:05.295240+0000","last_fullsized":"2024-04-17T15:37:05.295240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286818+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:37:05.286818+0000","last_peered":"2024-04-17T15:37:05.286818+0000","last_clean":"2024-04-17T15:37:05.286818+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:37:05.286818+0000","last_undegraded":"2024-04-17T15:37:05.286818+0000","last_fullsized":"2024-04-17T15:37:05.286818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281442+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:37:05.281442+0000","last_peered":"2024-04-17T15:37:05.281442+0000","last_clean":"2024-04-17T15:37:05.281442+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:37:05.281442+0000","last_undegraded":"2024-04-17T15:37:05.281442+0000","last_fullsized":"2024-04-17T15:37:05.281442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273407+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:37:05.273407+0000","last_peered":"2024-04-17T15:37:05.273407+0000","last_clean":"2024-04-17T15:37:05.273407+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:37:05.273407+0000","last_undegraded":"2024-04-17T15:37:05.273407+0000","last_fullsized":"2024-04-17T15:37:05.273407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292722+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:37:05.292722+0000","last_peered":"2024-04-17T15:37:05.292722+0000","last_clean":"2024-04-17T15:37:05.292722+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:37:05.292722+0000","last_undegraded":"2024-04-17T15:37:05.292722+0000","last_fullsized":"2024-04-17T15:37:05.292722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273174+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:37:05.273174+0000","last_peered":"2024-04-17T15:37:05.273174+0000","last_clean":"2024-04-17T15:37:05.273174+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:37:05.273174+0000","last_undegraded":"2024-04-17T15:37:05.273174+0000","last_fullsized":"2024-04-17T15:37:05.273174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281285+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:37:05.281285+0000","last_peered":"2024-04-17T15:37:05.281285+0000","last_clean":"2024-04-17T15:37:05.281285+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:37:05.281285+0000","last_undegraded":"2024-04-17T15:37:05.281285+0000","last_fullsized":"2024-04-17T15:37:05.281285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.272839+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:37:05.272839+0000","last_peered":"2024-04-17T15:37:05.272839+0000","last_clean":"2024-04-17T15:37:05.272839+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:37:05.272839+0000","last_undegraded":"2024-04-17T15:37:05.272839+0000","last_fullsized":"2024-04-17T15:37:05.272839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.285864+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:37:05.285864+0000","last_peered":"2024-04-17T15:37:05.285864+0000","last_clean":"2024-04-17T15:37:05.285864+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:37:05.285864+0000","last_undegraded":"2024-04-17T15:37:05.285864+0000","last_fullsized":"2024-04-17T15:37:05.285864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.290042+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:37:05.290042+0000","last_peered":"2024-04-17T15:37:05.290042+0000","last_clean":"2024-04-17T15:37:05.290042+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:37:05.290042+0000","last_undegraded":"2024-04-17T15:37:05.290042+0000","last_fullsized":"2024-04-17T15:37:05.290042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.300342+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:37:05.300342+0000","last_peered":"2024-04-17T15:37:05.300342+0000","last_clean":"2024-04-17T15:37:05.300342+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:37:05.300342+0000","last_undegraded":"2024-04-17T15:37:05.300342+0000","last_fullsized":"2024-04-17T15:37:05.300342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.284104+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:37:05.284104+0000","last_peered":"2024-04-17T15:37:05.284104+0000","last_clean":"2024-04-17T15:37:05.284104+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:37:05.284104+0000","last_undegraded":"2024-04-17T15:37:05.284104+0000","last_fullsized":"2024-04-17T15:37:05.284104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.292171+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:37:05.292171+0000","last_peered":"2024-04-17T15:37:05.292171+0000","last_clean":"2024-04-17T15:37:05.292171+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:37:05.292171+0000","last_undegraded":"2024-04-17T15:37:05.292171+0000","last_fullsized":"2024-04-17T15:37:05.292171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.291933+0000","last_change":"2024-04-17T15:36:56.190009+0000","last_active":"2024-04-17T15:37:05.291933+0000","last_peered":"2024-04-17T15:37:05.291933+0000","last_clean":"2024-04-17T15:37:05.291933+0000","last_became_active":"2024-04-17T15:36:56.189084+0000","last_became_peered":"2024-04-17T15:36:56.189084+0000","last_unstale":"2024-04-17T15:37:05.291933+0000","last_undegraded":"2024-04-17T15:37:05.291933+0000","last_fullsized":"2024-04-17T15:37:05.291933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:04:56.180628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.273700+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:37:05.273700+0000","last_peered":"2024-04-17T15:37:05.273700+0000","last_clean":"2024-04-17T15:37:05.273700+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:37:05.273700+0000","last_undegraded":"2024-04-17T15:37:05.273700+0000","last_fullsized":"2024-04-17T15:37:05.273700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.289277+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:37:05.289277+0000","last_peered":"2024-04-17T15:37:05.289277+0000","last_clean":"2024-04-17T15:37:05.289277+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:37:05.289277+0000","last_undegraded":"2024-04-17T15:37:05.289277+0000","last_fullsized":"2024-04-17T15:37:05.289277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.283324+0000","last_change":"2024-04-17T15:36:54.206097+0000","last_active":"2024-04-17T15:37:05.283324+0000","last_peered":"2024-04-17T15:37:05.283324+0000","last_clean":"2024-04-17T15:37:05.283324+0000","last_became_active":"2024-04-17T15:36:54.205139+0000","last_became_peered":"2024-04-17T15:36:54.205139+0000","last_unstale":"2024-04-17T15:37:05.283324+0000","last_undegraded":"2024-04-17T15:37:05.283324+0000","last_fullsized":"2024-04-17T15:37:05.283324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.281303+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:37:05.281303+0000","last_peered":"2024-04-17T15:37:05.281303+0000","last_clean":"2024-04-17T15:37:05.281303+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:37:05.281303+0000","last_undegraded":"2024-04-17T15:37:05.281303+0000","last_fullsized":"2024-04-17T15:37:05.281303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.286482+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:37:05.286482+0000","last_peered":"2024-04-17T15:37:05.286482+0000","last_clean":"2024-04-17T15:37:05.286482+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:37:05.286482+0000","last_undegraded":"2024-04-17T15:37:05.286482+0000","last_fullsized":"2024-04-17T15:37:05.286482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.268765+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:37:05.268765+0000","last_peered":"2024-04-17T15:37:05.268765+0000","last_clean":"2024-04-17T15:37:05.268765+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:37:05.268765+0000","last_undegraded":"2024-04-17T15:37:05.268765+0000","last_fullsized":"2024-04-17T15:37:05.268765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-17T15:37:05.282537+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:37:05.282537+0000","last_peered":"2024-04-17T15:37:05.282537+0000","last_clean":"2024-04-17T15:37:05.282537+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:37:05.282537+0000","last_undegraded":"2024-04-17T15:37:05.282537+0000","last_fullsized":"2024-04-17T15:37:05.282537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":146700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":147964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":146198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":372736,"data_stored":148089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":146262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":147386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":738127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:37:12.567 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T15:37:12.568 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-17T15:37:12.922 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 30 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:fsid b60ce601-dc23-41b0-bc9a-dbbec538ec02 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-04-17T15:36:35.284161+0000 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:modified 2024-04-17T15:37:05.251100+0000 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:crush_version 5 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:full_ratio 0.95 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:backfillfull_ratio 0.9 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:nearfull_ratio 0.85 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:require_min_compat_client luminous 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:min_compat_client jewel 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:require_osd_release squid 2024-04-17T15:37:12.923 INFO:teuthology.orchestra.run.smithi044.stdout:stretch_mode_enabled false 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:max_osd 8 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6824/4073594120,v1:172.21.15.44:6825/4073594120] [v2:172.21.15.44:6826/4073594120,v1:172.21.15.44:6827/4073594120] exists,up c841b259-219b-4f39-a952-8ef354c8a4d3 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6800/3956479268,v1:172.21.15.44:6801/3956479268] [v2:172.21.15.44:6802/3956479268,v1:172.21.15.44:6803/3956479268] exists,up daffe35c-9fda-4a02-81e2-b40855ff3e24 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 up in weight 1 up_from 14 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6808/2986857736,v1:172.21.15.44:6810/2986857736] [v2:172.21.15.44:6812/2986857736,v1:172.21.15.44:6814/2986857736] exists,up 653abe6b-68bd-4e83-b0a7-2691e1d0dd0d 2024-04-17T15:37:12.924 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6809/3785559761,v1:172.21.15.44:6811/3785559761] [v2:172.21.15.44:6813/3785559761,v1:172.21.15.44:6815/3785559761] exists,up 71cbfda2-d611-49da-b314-284be425b041 2024-04-17T15:37:12.925 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6819/466020694,v1:172.21.15.63:6821/466020694] [v2:172.21.15.63:6823/466020694,v1:172.21.15.63:6825/466020694] exists,up c68cb5c7-9093-418d-be3c-db3e3bd8eab2 2024-04-17T15:37:12.925 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6800/1787755738,v1:172.21.15.63:6802/1787755738] [v2:172.21.15.63:6804/1787755738,v1:172.21.15.63:6806/1787755738] exists,up 638215dd-8efa-4141-8ae7-3aa44152ab5e 2024-04-17T15:37:12.925 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6801/1209539994,v1:172.21.15.63:6803/1209539994] [v2:172.21.15.63:6805/1209539994,v1:172.21.15.63:6807/1209539994] exists,up b0cb7f79-bc86-4f01-9185-35d3b5166fc6 2024-04-17T15:37:12.925 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6816/573406477,v1:172.21.15.63:6817/573406477] [v2:172.21.15.63:6818/573406477,v1:172.21.15.63:6820/573406477] exists,up dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d 2024-04-17T15:37:12.941 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6824/4073594120,v1:172.21.15.44:6825/4073594120] [v2:172.21.15.44:6826/4073594120,v1:172.21.15.44:6827/4073594120] exists,up c841b259-219b-4f39-a952-8ef354c8a4d3', 'osd.1 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6800/3956479268,v1:172.21.15.44:6801/3956479268] [v2:172.21.15.44:6802/3956479268,v1:172.21.15.44:6803/3956479268] exists,up daffe35c-9fda-4a02-81e2-b40855ff3e24', 'osd.2 up in weight 1 up_from 14 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6808/2986857736,v1:172.21.15.44:6810/2986857736] [v2:172.21.15.44:6812/2986857736,v1:172.21.15.44:6814/2986857736] exists,up 653abe6b-68bd-4e83-b0a7-2691e1d0dd0d', 'osd.3 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6809/3785559761,v1:172.21.15.44:6811/3785559761] [v2:172.21.15.44:6813/3785559761,v1:172.21.15.44:6815/3785559761] exists,up 71cbfda2-d611-49da-b314-284be425b041', 'osd.4 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6819/466020694,v1:172.21.15.63:6821/466020694] [v2:172.21.15.63:6823/466020694,v1:172.21.15.63:6825/466020694] exists,up c68cb5c7-9093-418d-be3c-db3e3bd8eab2', 'osd.5 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6800/1787755738,v1:172.21.15.63:6802/1787755738] [v2:172.21.15.63:6804/1787755738,v1:172.21.15.63:6806/1787755738] exists,up 638215dd-8efa-4141-8ae7-3aa44152ab5e', 'osd.6 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6801/1209539994,v1:172.21.15.63:6803/1209539994] [v2:172.21.15.63:6805/1209539994,v1:172.21.15.63:6807/1209539994] exists,up b0cb7f79-bc86-4f01-9185-35d3b5166fc6', 'osd.7 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6816/573406477,v1:172.21.15.63:6817/573406477] [v2:172.21.15.63:6818/573406477,v1:172.21.15.63:6820/573406477] exists,up dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d'] 2024-04-17T15:37:12.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-17T15:37:13.057 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mon.a", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster": "ceph", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "admin_socket_mode": "", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_client_required": "cephx, none", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_cluster_required": "cephx", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_debug": "true", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_service_required": "cephx", 2024-04-17T15:37:13.058 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_supported": "cephx", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_aio": "true", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_aio_poll_ms": "250", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_aio_reap_max": "16", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_async_discard_threads": "0", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_block_size": "4096", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_debug_aio": "false", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-17T15:37:13.059 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_debug_inflight_ios": "false", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_enable_discard": "false", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_flock_retry": "3", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_inject_crash": "0", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_ioring": "false", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_ioring_hipri": "false", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_type": "", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_alloc_size": "1048576", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_allocator": "hybrid", 2024-04-17T15:37:13.060 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_buffered_io": "true", 2024-04-17T15:37:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_check_for_zeros": "false", 2024-04-17T15:37:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-17T15:37:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-17T15:37:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_compact_log_sync": "false", 2024-04-17T15:37:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-17T15:37:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-17T15:37:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-17T15:37:13.061 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-17T15:37:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_max_log_runway": "4194304", 2024-04-17T15:37:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_max_prefetch": "1048576", 2024-04-17T15:37:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_min_flush_size": "524288", 2024-04-17T15:37:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_min_log_runway": "1048576", 2024-04-17T15:37:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_replay_recovery": "false", 2024-04-17T15:37:13.062 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-17T15:37:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-17T15:37:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_sync_write": "false", 2024-04-17T15:37:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-17T15:37:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-17T15:37:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-17T15:37:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_allocation_from_file": "true", 2024-04-17T15:37:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_allocator": "hybrid", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_create": "true", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_db_create": "false", 2024-04-17T15:37:13.064 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_db_path": "", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_db_size": "0", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_path": "", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_preallocate_file": "false", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_size": "107374182400", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_wal_create": "false", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_wal_path": "", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_wal_size": "100663296", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bluefs": "true", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-17T15:37:13.065 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_autotune": "true", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_size": "0", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-17T15:37:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_type": "2q", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_clone_cow": "true", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-17T15:37:13.067 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_mode": "none", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_csum_type": "crc32c", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_freelist": "false", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-17T15:37:13.068 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_small_allocations": "0", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_default_buffered_read": "true", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_default_buffered_write": "false", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-17T15:37:13.069 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fail_eio": "false", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_mount": "false", 2024-04-17T15:37:13.070 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_umount": "false", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_ignore_data_csum": "false", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-17T15:37:13.071 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_log_op_age": "5.000000", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_alloc_size": "0", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_blob_size": "0", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_deferred_txc": "32", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_min_alloc_size": "0", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_nid_prealloc": "1024", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-17T15:37:13.072 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_retry_disk_reads": "3", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_rocksdb_cf": "true", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_spdk_mem": "512", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-17T15:37:13.073 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_tracing": "false", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-17T15:37:13.074 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_zero_block_detection": "false", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-17T15:37:13.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_cluster_require_signatures": "false", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_cluster_require_version": "2", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_require_signatures": "false", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_require_version": "2", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_service_require_signatures": "false", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_service_require_version": "2", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_sign_messages": "true", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "chdir": "", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "client_acl_type": "", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "client_asio_thread_count": "2", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "client_cache_mid": "0.750000", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "client_cache_size": "16384", 2024-04-17T15:37:13.076 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps_release_delay": "5", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_check_pool_perm": "true", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_debug_force_sync_read": "false", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_debug_getattr_caps": "false", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_debug_inject_tick_delay": "0", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_die_on_failed_remount": "false", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_dirsize_rbytes": "true", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_force_lazyio": "false", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_fs": "", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_inject_release_failure": "false", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_max_inline_size": "4096", 2024-04-17T15:37:13.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mds_namespace": "", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_metadata": "", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mount_gid": "-1", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mount_timeout": "300", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mount_uid": "-1", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mountpoint": "/", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_notify_timeout": "10", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc": "true", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_max_dirty": "104857600", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_max_objects": "1000", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_size": "209715200", 2024-04-17T15:37:13.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_target_dirty": "8388608", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_permissions": "true", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_quota": "true", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_quota_df": "true", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_readahead_max_bytes": "0", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_readahead_max_periods": "4", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_readahead_min": "131072", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_reconnect_stale": "false", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_shutdown_timeout": "30", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_snapdir": ".snap", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_tick_interval": "1", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_trace": "", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_try_dentry_invalidate": "false", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_use_faked_inos": "false", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "client_use_random_mds": "false", 2024-04-17T15:37:13.079 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_graylog": "false", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_graylog_port": "12201", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_monitors": "default=true", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_syslog": "false", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_syslog_level": "info", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "-", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_network": "", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_network_interface": "", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "compressor_zlib_isal": "false", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "compressor_zlib_level": "5", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "compressor_zlib_winsize": "-15", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "compressor_zstd_level": "1", 2024-04-17T15:37:13.080 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_alien_op_num_threads": "6", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_osd_stat_interval": "0", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_seastar_cpu_cores": "", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location_hook": "", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location_hook_timeout": "10", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "daemonize": "false", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "daos_pool": "tank", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-17T15:37:13.081 INFO:teuthology.orchestra.run.smithi044.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_alienstore": "0/5", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_allow_any_pool_priority": "false", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_asok": "1/5", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_asok_assert_abort": "false", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_asserts_on_shutdown": "true", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_auth": "20/20", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_bdev": "1/3", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_bluefs": "1/5", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_bluestore": "1/5", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_buffer": "0/1", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_ceph_exporter": "1/5", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_cephfs_mirror": "0/5", 2024-04-17T15:37:13.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_cephsqlite": "0/5", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_client": "0/5", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_compressor": "1/5", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_context": "0/1", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_crimson_interrupt": "0/5", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_crush": "1/1", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_crypto": "1/5", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_cyanstore": "0/5", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_deliberately_leak_memory": "false", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_disable_randomized_ping": "false", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_dpdk": "1/5", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_eventtrace": "1/5", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_filer": "0/1", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_filestore": "1/3", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_finisher": "1/1", 2024-04-17T15:37:13.083 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_fuse": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_heartbeat_testing_span": "0", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_heartbeatmap": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_javaclient": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_journal": "1/3", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_journaler": "0/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_kstore": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_lockdep": "0/1", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mclock": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_balancer": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_locker": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_log": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_log_expire": "1/5", 2024-04-17T15:37:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_migrator": "1/5", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_quiesce": "3/5", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_memstore": "1/5", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mgr": "2/5", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mgrc": "1/5", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mon": "20/20", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_monc": "0/10", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_ms": "1/1", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_none": "0/5", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_objclass": "0/5", 2024-04-17T15:37:13.085 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_objectcacher": "0/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_objecter": "0/1", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_optracker": "0/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_osd": "1/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_paxos": "20/20", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_perfcounter": "1/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_prioritycache": "1/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rados": "0/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rbd": "0/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rbd_mirror": "0/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rbd_pwl": "0/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rbd_replay": "0/5", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_refs": "0/0", 2024-04-17T15:37:13.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_reserver": "1/1", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw": "1/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_access": "1/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_datacache": "1/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_dbstore": "1/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_flight": "1/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_notification": "1/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_sync": "1/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rocksdb": "4/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore": "0/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_backref": "0/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_cache": "0/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_cleaner": "0/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_device": "0/5", 2024-04-17T15:37:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_epm": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_journal": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_lba": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_odata": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_omap": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_onode": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_t": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_tm": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_striper": "0/1", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_test": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_throttle": "1/1", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_timer": "0/1", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_tp": "0/5", 2024-04-17T15:37:13.088 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_trace": "1/5", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "device_failure_prediction_mode": "none", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "err_to_graylog": "false", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "err_to_journald": "false", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "err_to_stderr": "true", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "err_to_syslog": "false", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event_tracing": "false", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_addr": "0.0.0.0", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_http_port": "9926", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_prio_limit": "5", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-17T15:37:13.089 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_sort_metrics": "true", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_stats_period": "5", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "fake_statfs_for_testing": "0", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "fatal_signal_handlers": "true", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filer_max_purge_ops": "10", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filer_max_truncate_ops": "128", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_apply_finisher_threads": "1", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_blackhole": "false", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_btrfs_clone_range": "true", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_btrfs_snap": "true", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_caller_concurrency": "10", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_collect_device_partition_information": "true", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_commit_timeout": "600.000000", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_debug_inject_read_err": "false", 2024-04-17T15:37:13.090 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_debug_omap_check": "false", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_debug_verify_split": "false", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_dump_file": "", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fadvise": "true", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fail_eio": "true", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fd_cache_shards": "16", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fd_cache_size": "128", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fiemap": "false", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fiemap_threshold": "4096", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-17T15:37:13.091 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_inject_stall": "0", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_journal_parallel": "false", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_journal_trailing": "false", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_journal_writeahead": "false", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_kill_at": "0", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattrs": "0", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-17T15:37:13.092 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_xattr_value_size": "0", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_merge_threshold": "-10", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_odsync_write": "false", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_omap_backend": "rocksdb", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_omap_backend_path": "", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_op_thread_timeout": "60", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_op_threads": "2", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_punch_hole": "false", 2024-04-17T15:37:13.093 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_ops": "50", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_seek_data_hole": "false", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_sloppy_crc": "false", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-17T15:37:13.094 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_splice": "false", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_split_multiple": "2", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_split_rand_factor": "20", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_update_to": "1000", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_enable": "true", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-17T15:37:13.095 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_xfs_extsize": "false", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_zfs_snap": "false", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fio_dir": "/tmp/fio", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "b60ce601-dc23-41b0-bc9a-dbbec538ec02", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_allow_other": "true", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_atomic_o_trunc": "true", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_big_writes": "true", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_debug": "false", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_default_permissions": "false", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_disable_pagecache": "false", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_max_write": "0", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_multithreaded": "true", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_require_active_mds": "true", 2024-04-17T15:37:13.096 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_set_user_groups": "true", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_splice_move": "true", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_splice_read": "true", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_splice_write": "true", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_use_invalidate_cb": "true", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "gss_target_name": "ceph", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_file": "", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_inject_failure": "0", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_interval": "5", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "host": "smithi044", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-17T15:37:13.097 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "inject_early_sigterm": "false", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "jaeger_agent_port": "6799", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "jaeger_tracing_enable": "false", 2024-04-17T15:37:13.098 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_aio": "true", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_align_min_size": "65536", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_block_align": "true", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_block_size": "4096", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_dio": "true", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_discard": "false", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_force_aio": "false", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_ignore_corruption": "false", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_max_write_bytes": "10485760", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_max_write_entries": "100", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_replay_from": "0", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-17T15:37:13.099 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_write_header_frequency": "0", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_zero_on_create": "false", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "journaler_prefetch_periods": "10", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "journaler_prezero_periods": "5", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "journaler_write_head_interval": "15", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "keyfile": "", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_backend": "rocksdb", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_default_stripe_size": "65536", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_fsck_on_mount": "false", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_max_bytes": "67108864", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_max_ops": "512", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_nid_prealloc": "1024", 2024-04-17T15:37:13.100 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_onode_map_size": "1024", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_sync_submit_transaction": "false", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_sync_transaction": "false", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "librados_thread_count": "2", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "lockdep": "false", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "lockdep_force_backtrace": "false", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "log_coarse_timestamps": "true", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "log_flush_on_exit": "false", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "log_graylog_host": "127.0.0.1", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "log_graylog_port": "12201", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "log_max_new": "1000", 2024-04-17T15:37:13.101 INFO:teuthology.orchestra.run.smithi044.stdout: "log_max_recent": "10000", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "log_stderr_prefix": "", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "log_stop_at_utilization": "0.970000", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": "true", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_graylog": "false", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_journald": "false", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_stderr": "false", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_syslog": "false", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "max_rotating_auth_attempts": "10", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_action_on_write_error": "1", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_alternate_name_max": "8192", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_asio_thread_count": "2", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_export_pin": "true", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_fragment_dirs": "true", 2024-04-17T15:37:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_fragment_interval": "5", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_interval": "10", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_max": "-1", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_max_until": "-1", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_merge_size": "50", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_midchunk": "0.300000", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_min_start": "0.200000", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_minchunk": "0.001000", 2024-04-17T15:37:13.103 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_mode": "0", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_need_max": "1.200000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_need_min": "0.800000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_overload_epochs": "2", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_split_bits": "3", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_split_size": "10000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_target_decay": "10.000000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_beacon_grace": "15.000000", 2024-04-17T15:37:13.104 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_beacon_interval": "4.000000", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_mid": "0.700000", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_delay": "0", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_release_free_interval": "10", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_reservation": "0.050000", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_trim_interval": "1", 2024-04-17T15:37:13.105 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_trim_threshold": "262144", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_client_prealloc_inos": "1000", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_connect_bootstrapping": "false", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_damage_table_max_entries": "10000", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_debug_auth_pins": "false", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_debug_frag": "false", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_debug_scatterstat": "false", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_debug_subtrees": "false", 2024-04-17T15:37:13.106 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_decay_halflife": "5.000000", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_default_dir_hash": "2", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_defer_session_stale": "true", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_deny_all_reconnect": "false", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dir_keys_per_op": "16384", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dir_max_commit_size": "10", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dir_max_entries": "0", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dir_prefetch": "true", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dump_cache_on_map": "false", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_early_reply": "true", 2024-04-17T15:37:13.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_enable_op_tracker": "true", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_enforce_unique_name": "true", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_export_ephemeral_random": "true", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_health_summarize_threshold": "10", 2024-04-17T15:37:13.108 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_health_dummy": "false", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_migrator_session_race": "false", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_join_fs": "", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_journal_format": "1", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_create_at": "0", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_export_at": "0", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_import_at": "0", 2024-04-17T15:37:13.109 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_journal_at": "0", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_journal_expire_at": "0", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_journal_replay_at": "0", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_link_at": "0", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_mdstable_at": "0", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_openc_at": "0", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_rename_at": "0", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_shutdown_at": "0", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-17T15:37:13.110 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_event_large_threshold": "524288", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_events_per_segment": "1024", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_max_events": "-1", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_max_segments": "128", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_pause": "false", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_segment_size": "0", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_trim_threshold": "128", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_warn_factor": "2.000000", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_caps_per_client": "1048576", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_completed_flushes": "100000", 2024-04-17T15:37:13.111 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_completed_requests": "100000", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_export_size": "20971520", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_file_recover": "32", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_purge_files": "64", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_purge_ops": "8192", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_snaps_per_dir": "100", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_metrics_update_interval": "2", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_min_caps_per_client": "100", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_min_caps_working_set": "10000", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_numa_node": "-1", 2024-04-17T15:37:13.112 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_complaint_time": "30.000000", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_history_duration": "600", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_history_size": "20", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_history_slow_op_size": "20", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_log_threshold": "5", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_ping_grace": "15", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_ping_interval": "5", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_max_caps": "30000", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-17T15:37:13.113 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_warning_threshold": "262144", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_replay_interval": "1.000000", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_root_ino_gid": "0", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_root_ino_uid": "0", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-17T15:37:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_shutdown_check": "0", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_skip_ino": "0", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_snap_max_uid": "4294967294", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_snap_min_uid": "0", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_snap_rstat": "false", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_standby_replay_damaged": "false", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_symlink_recovery": "true", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_thrash_exports": "0", 2024-04-17T15:37:13.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_thrash_fragments": "0", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_tick_interval": "5.000000", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_valgrind_exit": "false", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_verify_backtrace": "1", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_verify_scatter": "false", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_wipe_sessions": "false", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool_debug": "false", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "memstore_device_bytes": "1073741824", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "memstore_page_set": "false", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "memstore_page_size": "65536", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_client_bytes": "134217728", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_client_messages": "512", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-17T15:37:13.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_disabled_modules": "", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_max_pg_creating": "1024", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_max_pg_num_change": "128", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_mds_bytes": "134217728", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_mds_messages": "128", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_mon_bytes": "134217728", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_mon_messages": "128", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_osd_bytes": "536870912", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_osd_messages": "8192", 2024-04-17T15:37:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_pool": "true", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_standby_modules": "true", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_stats_period": "5", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_stats_threshold": "5", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_tick_period": "2", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_allow_pool_delete": "true", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_allow_pool_size_one": "true", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_auth_validate_all_caps": "true", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_bytes": "104857600", 2024-04-17T15:37:13.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_directed_command_retry": "2", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_parallel": "3", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_log_interval": "1.000000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_ping_interval": "10.000000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_target_rank": "-1", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_file_level": "debug", 2024-04-17T15:37:13.119 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_file": "true", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_journald": "false", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_compact_on_bootstrap": "false", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_compact_on_start": "false", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_compact_on_trim": "true", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-17T15:37:13.120 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cpu_threads": "4", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_crush_min_required_version": "hammer", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_daemon_bytes": "419430400", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_data_avail_crit": "5", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_data_avail_warn": "5", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_data_size_warn": "16106127360", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_dump_json": "false", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_dump_transactions": "false", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_extra_checks": "false", 2024-04-17T15:37:13.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_no_require_reef": "false", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_no_require_squid": "false", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_down_mkfs_grace": "120", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_down_uptime_grace": "60", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_election_default_strategy": "1", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_election_timeout": "5.000000", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_elector_ping_divisor": "2", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-17T15:37:13.122 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_enable_op_tracker": "true", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_fake_pool_delete": "false", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_force_quorum_join": "false", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_globalid_prealloc": "10000", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_detail_to_clog": "false", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_log_update_period": "5", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_max_detail": "50", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_to_clog": "true", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_to_clog_interval": "600", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_host": "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],172.21.15.63", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_host_override": "", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_initial_members": "", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-17T15:37:13.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_lease": "5.000000", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_log_full_interval": "50", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_log_max": "10000", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_log_max_summary": "50", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_log_epochs": "500", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-17T15:37:13.124 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_osd": "10000", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_pg_per_osd": "10000", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_pool_pg_num": "65536", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mds_force_trim_to": "0", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mds_skip_sanity": "false", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_memory_autotune": "true", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_memory_target": "2147483648", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_beacon_grace": "30", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_digest_period": "5", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_inactive_grace": "60", 2024-04-17T15:37:13.125 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_min_osdmap_epochs": "500", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_complaint_time": "30", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_history_duration": "600", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_history_size": "20", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_history_slow_op_size": "20", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_log_threshold": "5", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_auto_mark_in": "false", 2024-04-17T15:37:13.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_cache_size": "500", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_down_out_interval": "600", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_force_trim_to": "0", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-17T15:37:13.127 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_min_down_reporters": "2", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-17T15:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_report_timeout": "900", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_stuck_threshold": "60", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-17T15:37:13.129 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_probe_timeout": "2.000000", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_reweight_max_change": "0.050000", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_reweight_max_osds": "4", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_interval": "86400", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_max_keys": "100", 2024-04-17T15:37:13.130 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_timeout": "300", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_session_timeout": "300", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_smart_report_timeout": "5", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stat_smooth_intervals": "6", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stretch_pool_min_size": "2", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stretch_pool_size": "4", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_debug": "false", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_provider_kill_at": "0", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_requester_kill_at": "0", 2024-04-17T15:37:13.131 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_timeout": "60.000000", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_target_pg_per_osd": "100", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_tick_interval": "5", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_timecheck_interval": "300.000000", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_use_min_delay_socket": "false", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_older_version_delay": "604800", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-17T15:37:13.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_misplaced": "false", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_older_version": "true", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": "", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-17T15:37:13.133 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_tracing_enabled": "false", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_op_threads": "3", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_cm": "false", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_device_name": "", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_dscp": "96", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-17T15:37:13.134 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_local_gid": "", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_port_num": "1", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_sl": "3", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_support_srq": "true", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_type": "ib", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_reap_threshold": "5", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_before_connect": "false", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_ipv4": "true", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_ipv6": "false", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_msgr1": "true", 2024-04-17T15:37:13.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_msgr2": "true", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_port_max": "7568", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_port_min": "6800", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_retry_count": "3", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_retry_delay": "5", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_client": "false", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_mds": "false", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_mgr": "false", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_mon": "false", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_osd": "false", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_client_mode": "crc secure", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_cluster_mode": "crc secure", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_cluster_type": "", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_compress_secure": "false", 2024-04-17T15:37:13.136 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_connection_idle_timeout": "900", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_connection_ready_timeout": "10", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_crc_data": "true", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_crc_header": "true", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_bad_msg": "false", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_bug": "true", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_old_message": "true", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_skipped_message": "false", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_coremask": "0xF", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_enable_tso": "true", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-17T15:37:13.137 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_hugepages": "", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_lro": "true", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_memory_channel": "4", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_pmd": "", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_port_id": "0", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dump_on_send": "false", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_initial_backoff": "0.200000", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_delay_max": "1.000000", 2024-04-17T15:37:13.138 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_delay_type": "", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_network_congestion": "0", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_socket_failures": "0", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_learn_addr_from_peer": "true", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_max_accept_failures": "4", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_max_backoff": "15.000000", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_mon_client_mode": "secure crc", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_mon_service_mode": "secure crc", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_osd_compress_min_size": "1024", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_osd_compress_mode": "none", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_pq_min_cost": "65536", 2024-04-17T15:37:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_public_type": "", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_service_mode": "crc secure", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_tcp_listen_backlog": "512", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_tcp_nodelay": "true", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_tcp_rcvbuf": "0", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_type": "async+posix", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "no_config_file": "false", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_completion_locks_per_session": "32", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_inflight_ops": "1024", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_tick_interval": "5.000000", 2024-04-17T15:37:13.140 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_timeout": "10.000000", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "objectstore_blackhole": "false", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "openssl_engine_opts": "", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_delay_time": "5.000000", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_hist_halflife": "1000", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_max_low_ops": "2", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_max_ops": "4", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_slop": "0.020000", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_asio_thread_count": "2", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_async_recovery_min_cost": "100", 2024-04-17T15:37:13.141 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backfill_scan_max": "512", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backfill_scan_min": "64", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backoff_on_degraded": "false", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backoff_on_peering": "false", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backoff_on_unfound": "true", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_beacon_report_interval": "300", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bench_duration": "30", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bench_max_block_size": "67108864", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_blkin_trace_all": "false", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-17T15:37:13.142 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_check_for_log_corruption": "false", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_class_update_on_start": "true", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_client_message_cap": "256", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_client_message_size_cap": "524288000", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_client_op_priority": "63", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_client_watch_timeout": "30", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_command_max_records": "256", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_compact_on_start": "false", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-17T15:37:13.143 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_crush_update_on_start": "true", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_crush_update_weight_set": "true", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_feed_pullee": "-1", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_misdirected_ops": "false", 2024-04-17T15:37:13.144 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_no_acting_change": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_no_purge_strays": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_op_order": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_shutdown": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_trim_objects": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_verify_snaps": "false", 2024-04-17T15:37:13.145 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_keys": "1024", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_stride": "524288", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_default_notify_timeout": "30", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_delete_sleep": "0.000000", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-17T15:37:13.146 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_discard_disconnected_ops": "true", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_enable_op_tracker": "true", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_info": "true", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_shutdown": "true", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_function_tracing": "false", 2024-04-17T15:37:13.147 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_grace": "20", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_interval": "6", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_min_peers": "10", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_min_size": "2000", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_stale": "600", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_hit_set_max_size": "100000", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_hit_set_min_size": "1000", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-17T15:37:13.148 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_journal_size": "5120", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_kill_backfill_at": "0", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_cache_size": "50", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_dedup": "true", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_message_max": "40", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_share_max_epochs": "40", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_attr_name_len": "100", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_attr_size": "0", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_backfills": "1", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_markdown_count": "5", 2024-04-17T15:37:13.149 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_markdown_period": "600", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_object_name_len": "2048", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_object_namespace_len": "256", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_object_size": "134217728", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_pg_blocked_by": "16", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_pg_log_entries": "10000", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_pgls": "1024", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_push_cost": "8388608", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_push_objects": "10", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_scrubs": "3", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-17T15:37:13.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_trimming_pgs": "2", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_write_op_reply_len": "64", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_write_size": "90", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_profile": "balanced", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-17T15:37:13.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_base": "805306368", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_cache_min": "134217728", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_target": "4294967296", 2024-04-17T15:37:13.152 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_target_autotune": "false", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_min_pg_log_entries": "250", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_min_recovery_priority": "0", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_report_interval": "5", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_num_cache_shards": "32", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_num_op_tracker_shard": "32", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_numa_auto_affinity": "true", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_numa_node": "-1", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_numa_prefer_iface": "true", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-17T15:37:13.153 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_objecter_finishers": "1", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_objectstore": "bluestore", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_objectstore_fuse": "false", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_objectstore_tracing": "false", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_complaint_time": "30.000000", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_history_duration": "600", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_history_size": "20", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_history_slow_op_size": "20", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_log_threshold": "5", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_shards": "0", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_shards_hdd": "5", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_shards_ssd": "8", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-17T15:37:13.154 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_pq_min_cost": "65536", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_queue_cut_off": "high", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_thread_timeout": "15", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_open_classes_on_start": "true", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_os_flags": "0", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_peering_op_priority": "255", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_delete_cost": "1048576", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_delete_priority": "5", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-17T15:37:13.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_log_trim_max": "10000", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_log_trim_min": "100", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_crimson": "false", 2024-04-17T15:37:13.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flags": "0", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_min_size": "0", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_pg_num": "32", 2024-04-17T15:37:13.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_pgp_num": "0", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_read_ratio": "70", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_size": "2", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_type": "replicated", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_push_per_object_cost": "1000", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recover_clone_overlap": "true", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_cost": "20971520", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_active": "0", 2024-04-17T15:37:13.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_single_start": "1", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_op_priority": "3", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_priority": "5", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_sleep": "0.000000", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-17T15:37:13.159 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_repair_during_recovery": "false", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_requested_scrub_priority": "120", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_auto_repair": "false", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_begin_hour": "0", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_begin_week_day": "0", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_chunk_max": "25", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_chunk_min": "5", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_cost": "52428800", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-17T15:37:13.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_during_recovery": "false", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_end_hour": "0", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_end_week_day": "0", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_event_cost": "4096", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_invalid_stats": "true", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_max_preemptions": "5", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_priority": "5", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_sleep": "0.000000", 2024-04-17T15:37:13.161 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_skip_data_digest": "false", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_smart_report_timeout": "5", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_cost": "1048576", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_priority": "5", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-17T15:37:13.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_target_transaction_size": "30", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tracing": "false", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_use_stale_snap": "false", 2024-04-17T15:37:13.163 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "osdc_blkin_trace_all": "false", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_kill_at": "0", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_max_join_drift": "10", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_min": "500", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_min_wait": "0.050000", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_propose_interval": "1.000000", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_service_trim_max": "500", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-17T15:37:13.164 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_service_trim_min": "250", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_stash_full_interval": "25", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_trim_max": "500", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_trim_min": "250", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "perf": "true", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "-", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrv": "", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "public_bind_addr": "-", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "public_network": "", 2024-04-17T15:37:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: "public_network_interface": "", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "qat_compressor_enabled": "false", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "qat_compressor_session_max_number": "256", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rados_mon_op_timeout": "0", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rados_osd_op_timeout": "0", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rados_tracing": "false", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_atime_update_interval": "60", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_balance_parent_reads": "false", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_balance_snap_reads": "false", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_blkin_trace_all": "false", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache": "true", 2024-04-17T15:37:13.166 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_policy": "writearound", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_size": "33554432", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_clone_copy_on_read": "false", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_compression_hint": "none", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_concurrent_management_ops": "10", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_clone_format": "auto", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_data_pool": "", 2024-04-17T15:37:13.167 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_features": "61", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_format": "2", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_map_options": "", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_order": "22", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_pool": "rbd", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_stripe_count": "0", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_stripe_unit": "0", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_enable_alloc_hint": "true", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-17T15:37:13.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_io_scheduler": "simple", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_order": "24", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_pool": "", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_splay_width": "4", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_localize_parent_reads": "false", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_localize_snap_reads": "false", 2024-04-17T15:37:13.169 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-17T15:37:13.170 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-17T15:37:13.171 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mtime_update_interval": "60", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_non_blocking_aio": "true", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_op_thread_timeout": "60", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_op_threads": "1", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_parent_cache_enabled": "false", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_plugins": "", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_bps_burst": "0", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-17T15:37:13.172 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_bps_limit": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_exclude_ops": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_iops_burst": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_iops_limit": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-17T15:37:13.173 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_read_from_replica_policy": "default", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_skip_partial_discard": "true", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_tracing": "false", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_validate_names": "true", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_validate_pool": "true", 2024-04-17T15:37:13.174 INFO:teuthology.orchestra.run.smithi044.stdout: "restapi_base_url": "", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "restapi_log_level": "", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_acl_grants_max_num": "100", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_admin_entry": "admin", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_backend_store": "rados", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_barbican_url": "", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_beast_enable_async": "true", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_counters_cache": "false", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-17T15:37:13.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cache_enabled": "true", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cache_expiry_interval": "900", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cache_lru_size": "10000", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_config_store": "rados", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_content_length_compat": "false", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_copy_obj_progress": "true", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cors_rules_max_num": "100", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cross_domain_policy": "", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_addr": "", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-17T15:37:13.176 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_password": "", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_username": "", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_require_ssl": "true", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-17T15:37:13.177 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_addr": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_auth": "token", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_namespace": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_prefix": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-17T15:37:13.178 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_token_file": "", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_buffersize": "524288", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_low_speed_time": "300", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-17T15:37:13.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_l1_fadvise": "4", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_port": "6379", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_log_changes_size": "1000", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_log_num_shards": "128", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_log_window": "30", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-17T15:37:13.180 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dns_name": "", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dns_s3website_name": "", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dynamic_resharding": "true", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_gc_threads": "true", 2024-04-17T15:37:13.182 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_lc_threads": "true", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_ops_log": "false", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_quota_threads": "true", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_static_website": "false", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_usage_log": "false", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enforce_swift_acls": "true", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_exit_timeout_secs": "120", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_expose_bucket": "false", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_extended_http_attrs": "", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_filter": "none", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_frontends": "beast port=7480", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_deferred": "50", 2024-04-17T15:37:13.183 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_objs": "32", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_processor_period": "3600", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_init_timeout": "300", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-17T15:37:13.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_kafka_connection_idle": "300", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_domain": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_password": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_password_path": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_project": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_tenant": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_token": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_token_path": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_user": "", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_api_version": "2", 2024-04-17T15:37:13.185 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_domain": "", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_password": "", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_project": "", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_user": "", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_url": "", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_debug_interval": "-1", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_lock_max_time": "90", 2024-04-17T15:37:13.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_max_objs": "32", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_max_rules": "1000", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_max_worker": "3", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_thread_delay": "0", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_dnattr": "uid", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_searchfilter": "", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_uri": "", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lfuda_sync_frequency": "60", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-17T15:37:13.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_log_http_headers": "", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_log_object_name_utc": "false", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_attr_name_len": "0", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_attr_size": "0", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_chunk_size": "4194304", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_listing_results": "1000", 2024-04-17T15:37:13.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_notify_retries": "10", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_put_param_size": "1048576", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_put_size": "5368709120", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_slo_entries": "1000", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_md_log_max_shards": "64", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_mp_lock_max_time": "600", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-17T15:37:13.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_max_gc": "300", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_num_async_rados_threads": "32", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_num_control_oids": "8", 2024-04-17T15:37:13.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_numa_node": "-1", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_objexp_chunk_size": "100", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_objexp_gc_interval": "600", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_op_thread_timeout": "600", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_op_tracing": "false", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_opa_token": "", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_opa_url": "", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_opa_verify_ssl": "true", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-17T15:37:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ops_log_rados": "false", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ops_log_socket_path": "", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_period_push_interval": "2.000000", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_cache_lanes": "3", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-17T15:37:13.192 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_cache_partitions": "3", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_print_continue": "true", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_rados_tracing": "false", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_realm": "", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_realm_id": "", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_region": "", 2024-04-17T15:37:13.193 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_request_uri": "", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_batch_size": "64", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_max_aio": "128", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_num_logs": "16", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_thread_interval": "600", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_resolve_cname": "false", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_run_sync_thread": "true", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-17T15:37:13.194 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_scheduler_type": "throttler", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_script_uri": "", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_service_provider_name": "", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_client_id": "", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_client_secret": "", 2024-04-17T15:37:13.195 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_entry": "sts", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_key": "sts", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_min_session_duration": "900", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_token_introspection_url": "", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_account_in_url": "false", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_auth_entry": "auth", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_auth_url": "", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_custom_header": "", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_need_stats": "true", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_tenant_name": "", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_token_expiration": "86400", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_url": "", 2024-04-17T15:37:13.196 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_url_prefix": "swift", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_lease_period": "120", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-17T15:37:13.197 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_thread_pool_size": "512", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_comment": "", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_createby": "", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_encoding": "", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_flag": "false", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_origin": "", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_tracker": "", 2024-04-17T15:37:13.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_trust_forwarded_https": "false", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_usage_max_shards": "32", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_usage_max_user_shards": "1", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_use_opa_authz": "false", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_counters_cache": "false", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_max_buckets": "1000", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_policies_max_num": "100", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-17T15:37:13.199 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_unique_email": "true", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_verify_ssl": "true", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zone": "", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zone_id": "", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zonegroup": "", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zonegroup_id": "", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgwlc_auto_session_clear": "true", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_block_size": "4096", 2024-04-17T15:37:13.200 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_size": "536870912", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-17T15:37:13.201 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_index_type": "binary_search", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_partition_filters": "false", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_perf": "false", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "run_dir": "/var/run/ceph", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_block_create": "true", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_cache_lru_size": "67108864", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-17T15:37:13.202 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_default_max_object_size": "16777216", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_device_size": "53687091200", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_journal_batch_capacity": "16", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_main_device_type": "SSD", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-17T15:37:13.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-17T15:37:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-17T15:37:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_segment_size": "67108864", 2024-04-17T15:37:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: "set_keepcaps": "false", 2024-04-17T15:37:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: "setgroup": "", 2024-04-17T15:37:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: "setuser": "", 2024-04-17T15:37:13.204 INFO:teuthology.orchestra.run.smithi044.stdout: "setuser_match_path": "", 2024-04-17T15:37:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-17T15:37:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: "thp": "false", 2024-04-17T15:37:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: "threadpool_default_timeout": "60", 2024-04-17T15:37:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-17T15:37:13.205 INFO:teuthology.orchestra.run.smithi044.stdout: "throttler_perf_counter": "true" 2024-04-17T15:37:13.205 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:13.207 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-17T15:37:13.354 INFO:teuthology.orchestra.run.smithi044.stdout:mon.a: {} 2024-04-17T15:37:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-17T15:37:13.367 INFO:teuthology.orchestra.run.smithi044.stdout:mon.b: {} 2024-04-17T15:37:13.367 INFO:teuthology.orchestra.run.smithi044.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-17T15:37:13.377 INFO:teuthology.orchestra.run.smithi044.stdout:mon.c: {} 2024-04-17T15:37:13.377 INFO:teuthology.orchestra.run.smithi044.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-17T15:37:13.394 DEBUG:teuthology.orchestra.run.smithi044:> type ceph-objectstore-tool 2024-04-17T15:37:13.398 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-17T15:37:13.399 DEBUG:teuthology.orchestra.run.smithi063:> type ceph-objectstore-tool 2024-04-17T15:37:13.405 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-17T15:37:13.405 INFO:teuthology.run_tasks:Running task workunit... 2024-04-17T15:37:13.418 INFO:tasks.workunit:Pulling workunits from ref 5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-17T15:37:13.418 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-17T15:37:13.419 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-17T15:37:13.419 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-17T15:37:13.420 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-17T15:37:13.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-17T15:37:13.420 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-17T15:37:13.420 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-17T15:37:13.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:13.421 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-17T15:37:13.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:13.421 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-17T15:37:13.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:37:13.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:37:13.449 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-17T15:37:13.449 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-17T15:37:13.449 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:13.447+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:13.497 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-17T15:37:13.498 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-17T15:37:13.522 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:13.523+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:13.545 INFO:tasks.workunit:timeout=3h 2024-04-17T15:37:13.545 INFO:tasks.workunit:cleanup=True 2024-04-17T15:37:13.546 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/samarahu/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5bf3b3a9b161d70b9aa7806055bdae202e03111c 2024-04-17T15:37:13.575 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:13.575 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:13.580 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-17T15:37:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:13.599 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:13.613 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:13.629 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:13.630 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:13.630+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:13.646 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:13.666 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:13.687 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:13.687 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:13.707 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:13.707 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:13.723 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:13.722+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:13.726 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:13.727 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:13.742 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:37:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-17T15:37:13.825 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:13.823+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:13.826 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-17T15:37:13.905 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:13.905 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:13.919 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:13.925 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:13.923+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:14.026 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:14.026+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:14.079 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:14.079 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:14.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:14.137 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:14.138+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:14.228 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:14.226+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:14.251 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:14.252 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:14.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:14.330 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:14.327+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:14.426 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:14.427 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:14.431 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:14.430+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:14.440 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:14.532 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:14.535+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:14.608 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:14.608 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:14.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:14.665 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:14.666+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:14.734 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:14.734+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:14.748 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:14.762 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-17T15:37:14.829 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-17T15:37:14.877 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:14.878+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:14.925 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:14.926 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:14.937 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:14.935+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:14.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:15.038 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:15.038+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:15.058 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:15.058 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:15.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:15.161 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:15.162+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:15.228 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:15.229 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:15.239 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:15.239+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:15.243 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:15.341 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:15.339+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:15.431 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:15.431 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:15.442 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:15.442+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:15.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:15.542 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:15.539+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:15.583 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:15.583 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:15.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:15.687 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:15.687+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:15.744 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:15.742+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:15.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:15.766 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:15.767 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:15.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:15.816 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-17T15:37:15.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:37:15.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-17T15:37:15.867 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:15.867+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:15.911 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:15.911 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:15.945 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:15.946+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:15.946 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:15.946 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:15.950 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:15.950 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:15.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:15.970 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:15.988 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:15.989 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:16.010 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:16.028 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:16.029 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:16.052 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:16.053 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:16.055 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:16.055+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:16.070 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:16.136 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:16.136 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:16.137 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:16.137 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:16.147 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:16.146+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:16.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:16.249 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:16.246+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:16.318 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:16.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:16.319 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:16.319 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:16.319 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:16.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:16.350 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:16.350+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:16.451 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:16.447+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:16.463 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:16.463 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:16.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:16.463 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:16.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.194428763000001, 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.183664177000001, 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.469 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.17949467, 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:37:16.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:37:16.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:37:16.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.480 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.172367245, 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:37:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:37:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:37:16.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:37:16.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.186327819000001, 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.486 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:37:16.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:37:16.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:37:16.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.125422387, 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.492 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.10728961, 2024-04-17T15:37:16.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.502 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.103615478, 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:37:16.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:37:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.074500196000001, 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:37:16.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:37:16.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.040467408, 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.515 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:37:16.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:37:16.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:37:16.520 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.004471301000001, 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:37:16.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:37:16.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:37:16.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:37:16.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.917054917, 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:37:16.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:37:16.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:37:16.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:37:16.534 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.914516847, 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:37:16.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:37:16.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:37:16.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:37:16.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:37:16.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:37:16.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:37:16.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.662158152, 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:37:16.540 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:37:16.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:37:16.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:37:16.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:37:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.639856062, 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:37:16.547 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:37:16.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:37:16.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:37:16.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:37:16.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:37:16.553 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.568083186999999, 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:37:16.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:37:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:37:16.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.373852986999999, 2024-04-17T15:37:16.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:37:16.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:37:16.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.334577663999999, 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:37:16.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:37:16.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.572 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.213891959, 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:37:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.209239012999999, 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:37:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:37:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:37:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:37:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:16.585 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:16.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:16.587 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:16.587+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:16.687 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:16.687+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:16.762 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:16.762 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:16.762 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:16.762 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:16.776 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:16.815 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.3 to 1 (10000) 2024-04-17T15:37:16.819 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:16.819+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:16.821 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:37:16.849 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-17T15:37:16.893 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:16.894+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:16.943 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:16.944 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:16.944 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:16.944 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:16.944 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:16.958 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:17.003 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:17.003+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:17.091 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:17.090+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:17.094 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:17.094 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:17.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:17.094 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:17.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.843316042, 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:17.101 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.811345736, 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:17.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:37:17.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:37:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.106 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.79400972, 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:17.107 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.112 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.791475077999999, 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:17.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.690921453, 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:37:17.118 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:17.122 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.797856723000001, 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:17.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:37:17.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:37:17.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.774724028, 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:37:17.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.734490542, 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.679956512, 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.135 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:37:17.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:37:17.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.142 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.659174889999999, 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:17.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:37:17.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:37:17.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:37:17.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.658763701, 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.656372297000001, 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.151 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:37:17.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:37:17.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:37:17.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.656274238, 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.155 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:37:17.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:37:17.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:37:17.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:37:17.160 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.65356841, 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:37:17.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:37:17.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.620832869999999, 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.165 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:37:17.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:37:17.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:37:17.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:37:17.169 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.611812711000001, 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.607197363999999, 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.174 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:37:17.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:37:17.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:37:17.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.597804132, 2024-04-17T15:37:17.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:17.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.564461437, 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.183 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:37:17.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:37:17.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:37:17.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.504701667999999, 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:37:17.187 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.191 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:17.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:17.193 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:17.194+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:17.293 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:17.291+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:17.368 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:17.368 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:17.368 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:17.368 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:17.382 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:17.394 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:17.394+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:17.495 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:17.491+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:17.550 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:17.551 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:17.565 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:17.595 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:17.594+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:17.696 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:17.695+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:17.738 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.664173545000001, 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.739 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:37:17.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:37:17.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:37:17.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:37:17.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.382075558, 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.748 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:17.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.754 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.381903403999999, 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:37:17.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:37:17.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:37:17.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:37:17.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.762 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.381864574000002, 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:17.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:37:17.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:37:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.767 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.172448383999999, 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.768 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:37:17.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:37:17.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:37:17.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.172386900999999, 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.773 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:17.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:37:17.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:37:17.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:37:17.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:37:17.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.172180322999999, 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:37:17.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:37:17.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.172140374000001, 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.785 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:17.790 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.172101451, 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.171901868999999, 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.796 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:37:17.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:37:17.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:37:17.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:37:17.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.171856637000001, 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:37:17.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:37:17.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:37:17.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.945791259, 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.807 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:37:17.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.94566755, 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.813 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:37:17.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:37:17.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:37:17.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.945566395, 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:37:17.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:37:17.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:37:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.945543179000001, 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:37:17.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:37:17.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:37:17.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:37:17.829 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.945521768999999, 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.830 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:37:17.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:37:17.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:37:17.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.835 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.945415805, 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:37:17.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:37:17.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:37:17.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:37:17.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.945391103999999, 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:37:17.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:37:17.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:37:17.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.945370087000001, 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.847 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:37:17.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:37:17.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:37:17.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.945255563, 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:17.853 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:17.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:17.858 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:17.860 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.4 to 1 (10000) 2024-04-17T15:37:17.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-17T15:37:17.861 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:17.858+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:17.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:17.961 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:17.959+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:18.020 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:18.021 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:18.021 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:18.034 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:18.086 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:18.086+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:18.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:18.163 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:18.162+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:18.167 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:18.167 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:18.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:18.235 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:18.235 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:18.255 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:18.255 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:18.263 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:18.263+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:18.274 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:18.274 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:18.293 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:18.317 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:18.317 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:18.339 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:18.339 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:18.342 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:18.354 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:18.363 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:18.365 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:18.363+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:18.384 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:18.384 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:18.466 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:18.466+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:18.473 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:18.473 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:18.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:18.577 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:18.578+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:18.654 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:18.654 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:18.667 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:18.709 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:18.710+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:18.770 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:18.771+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.5 to 1 (10000) 2024-04-17T15:37:18.840 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:18.840 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:18.849 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:37:18.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:18.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-17T15:37:18.873 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:18.871+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:18.973 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:18.974+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:19.028 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:19.028 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:19.044 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:19.074 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:19.071+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:19.175 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:19.175+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:19.205 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:19.205 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:19.218 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:19.277 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:19.275+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:19.358 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:19.359 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:19.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:19.376 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:19.378+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:19.478 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:19.478+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:19.489 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:19.503 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:19.579 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:19.575+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:19.680 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:19.679+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:19.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:19.781 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:19.783+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:19.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:19.827 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:19.857 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.6 to 1 (10000) 2024-04-17T15:37:19.857 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:37:19.878 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-17T15:37:19.884 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:19.882+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:19.965 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:19.965 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:19.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:19.983 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:19.979+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:20.084 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:20.083+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:20.104 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:20.104 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:20.119 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:20.207 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:20.207+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:20.286 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:20.286+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:20.297 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:20.298 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:20.312 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:20.388 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:20.386+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:20.401 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:20.482 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:20.482 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:20.488 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:20.490+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:20.496 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:20.575 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:20.590 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:20.587+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:20.594 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:20.610 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:20.610 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:20.626 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:20.626 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:20.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:20.645 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:20.645 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:20.666 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:20.666 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:20.686 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:20.709 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:20.709 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:20.723 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:20.723+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:20.791 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:20.790+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:20.808 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:20.808 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.542166594000001, 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:20.809 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:20.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:37:20.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.531402008000001, 2024-04-17T15:37:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:37:20.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:37:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:37:20.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:37:20.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:37:20.820 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.527232501, 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.821 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:37:20.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:37:20.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:37:20.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:37:20.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:37:20.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:37:20.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.520105076, 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.829 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:37:20.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:37:20.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.836 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.836 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.836 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.534065650000001, 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.837 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:37:20.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:37:20.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:37:20.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:37:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.473160218, 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.455027441, 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.451353309, 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.854 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:37:20.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:37:20.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:37:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:37:20.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.422238027000001, 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.388205238999999, 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.865 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:37:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.352209132, 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.871 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:37:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:37:20.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:37:20.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:37:20.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.264792748, 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.262254678, 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.009895983, 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.987593893, 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.915821018000001, 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:37:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:37:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:37:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.721590817999999, 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.682315494999999, 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.907 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:37:20.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:37:20.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:37:20.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:37:20.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.912 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.56162979, 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:37:20.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:37:20.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:37:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.556976843999999, 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:37:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:37:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:37:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:37:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:20.923 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:20.925 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.7 to 1 (10000) 2024-04-17T15:37:20.925 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:20.926 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:20.923+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:20.926 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-17T15:37:20.926 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:37:21.026 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:21.026+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:21.097 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:21.097 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:21.098 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:21.098 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:21.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:21.155 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:21.155+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:21.228 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:21.227+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:21.237 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:21.238 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:21.238 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:21.252 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:37:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:37:21.303 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-04-17T15:37:20.859766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224508,"kb_used_data":4176,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750212,"statfs":{"total":773094113280,"available":772864217088,"internally_reserved":0,"allocated":4276224,"data_stored":2465442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.037649"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247667+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:37:14.247667+0000","last_peered":"2024-04-17T15:37:14.247667+0000","last_clean":"2024-04-17T15:37:14.247667+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:37:14.247667+0000","last_undegraded":"2024-04-17T15:37:14.247667+0000","last_fullsized":"2024-04-17T15:37:14.247667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819686+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:37:15.819686+0000","last_peered":"2024-04-17T15:37:15.819686+0000","last_clean":"2024-04-17T15:37:15.819686+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:37:15.819686+0000","last_undegraded":"2024-04-17T15:37:15.819686+0000","last_fullsized":"2024-04-17T15:37:15.819686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823504+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:37:15.823504+0000","last_peered":"2024-04-17T15:37:15.823504+0000","last_clean":"2024-04-17T15:37:15.823504+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:37:15.823504+0000","last_undegraded":"2024-04-17T15:37:15.823504+0000","last_fullsized":"2024-04-17T15:37:15.823504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244367+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:37:14.244367+0000","last_peered":"2024-04-17T15:37:14.244367+0000","last_clean":"2024-04-17T15:37:14.244367+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:37:14.244367+0000","last_undegraded":"2024-04-17T15:37:14.244367+0000","last_fullsized":"2024-04-17T15:37:14.244367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807509+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:37:14.807509+0000","last_peered":"2024-04-17T15:37:14.807509+0000","last_clean":"2024-04-17T15:37:14.807509+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:37:14.807509+0000","last_undegraded":"2024-04-17T15:37:14.807509+0000","last_fullsized":"2024-04-17T15:37:14.807509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822874+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:37:15.822874+0000","last_peered":"2024-04-17T15:37:15.822874+0000","last_clean":"2024-04-17T15:37:15.822874+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:37:15.822874+0000","last_undegraded":"2024-04-17T15:37:15.822874+0000","last_fullsized":"2024-04-17T15:37:15.822874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820615+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:37:15.820615+0000","last_peered":"2024-04-17T15:37:15.820615+0000","last_clean":"2024-04-17T15:37:15.820615+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:37:15.820615+0000","last_undegraded":"2024-04-17T15:37:15.820615+0000","last_fullsized":"2024-04-17T15:37:15.820615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808434+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:37:14.808434+0000","last_peered":"2024-04-17T15:37:14.808434+0000","last_clean":"2024-04-17T15:37:14.808434+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:37:14.808434+0000","last_undegraded":"2024-04-17T15:37:14.808434+0000","last_fullsized":"2024-04-17T15:37:14.808434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246554+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:37:14.246554+0000","last_peered":"2024-04-17T15:37:14.246554+0000","last_clean":"2024-04-17T15:37:14.246554+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:37:14.246554+0000","last_undegraded":"2024-04-17T15:37:14.246554+0000","last_fullsized":"2024-04-17T15:37:14.246554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244845+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:37:14.244845+0000","last_peered":"2024-04-17T15:37:14.244845+0000","last_clean":"2024-04-17T15:37:14.244845+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:37:14.244845+0000","last_undegraded":"2024-04-17T15:37:14.244845+0000","last_fullsized":"2024-04-17T15:37:14.244845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820013+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:37:15.820013+0000","last_peered":"2024-04-17T15:37:15.820013+0000","last_clean":"2024-04-17T15:37:15.820013+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:37:15.820013+0000","last_undegraded":"2024-04-17T15:37:15.820013+0000","last_fullsized":"2024-04-17T15:37:15.820013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823193+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:37:15.823193+0000","last_peered":"2024-04-17T15:37:15.823193+0000","last_clean":"2024-04-17T15:37:15.823193+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:37:15.823193+0000","last_undegraded":"2024-04-17T15:37:15.823193+0000","last_fullsized":"2024-04-17T15:37:15.823193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244825+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:37:14.244825+0000","last_peered":"2024-04-17T15:37:14.244825+0000","last_clean":"2024-04-17T15:37:14.244825+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:37:14.244825+0000","last_undegraded":"2024-04-17T15:37:14.244825+0000","last_fullsized":"2024-04-17T15:37:14.244825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821951+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:37:15.821951+0000","last_peered":"2024-04-17T15:37:15.821951+0000","last_clean":"2024-04-17T15:37:15.821951+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:37:15.821951+0000","last_undegraded":"2024-04-17T15:37:15.821951+0000","last_fullsized":"2024-04-17T15:37:15.821951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240369+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:37:14.240369+0000","last_peered":"2024-04-17T15:37:14.240369+0000","last_clean":"2024-04-17T15:37:14.240369+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:37:14.240369+0000","last_undegraded":"2024-04-17T15:37:14.240369+0000","last_fullsized":"2024-04-17T15:37:14.240369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239361+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:37:14.239361+0000","last_peered":"2024-04-17T15:37:14.239361+0000","last_clean":"2024-04-17T15:37:14.239361+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:37:14.239361+0000","last_undegraded":"2024-04-17T15:37:14.239361+0000","last_fullsized":"2024-04-17T15:37:14.239361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821567+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:37:15.821567+0000","last_peered":"2024-04-17T15:37:15.821567+0000","last_clean":"2024-04-17T15:37:15.821567+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:37:15.821567+0000","last_undegraded":"2024-04-17T15:37:15.821567+0000","last_fullsized":"2024-04-17T15:37:15.821567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247807+0000","last_change":"2024-04-17T15:36:54.210516+0000","last_active":"2024-04-17T15:37:14.247807+0000","last_peered":"2024-04-17T15:37:14.247807+0000","last_clean":"2024-04-17T15:37:14.247807+0000","last_became_active":"2024-04-17T15:36:54.208488+0000","last_became_peered":"2024-04-17T15:36:54.208488+0000","last_unstale":"2024-04-17T15:37:14.247807+0000","last_undegraded":"2024-04-17T15:37:14.247807+0000","last_fullsized":"2024-04-17T15:37:14.247807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:43.263883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244601+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:37:14.244601+0000","last_peered":"2024-04-17T15:37:14.244601+0000","last_clean":"2024-04-17T15:37:14.244601+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:37:14.244601+0000","last_undegraded":"2024-04-17T15:37:14.244601+0000","last_fullsized":"2024-04-17T15:37:14.244601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244365+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:37:14.244365+0000","last_peered":"2024-04-17T15:37:14.244365+0000","last_clean":"2024-04-17T15:37:14.244365+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:37:14.244365+0000","last_undegraded":"2024-04-17T15:37:14.244365+0000","last_fullsized":"2024-04-17T15:37:14.244365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820178+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:37:15.820178+0000","last_peered":"2024-04-17T15:37:15.820178+0000","last_clean":"2024-04-17T15:37:15.820178+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:37:15.820178+0000","last_undegraded":"2024-04-17T15:37:15.820178+0000","last_fullsized":"2024-04-17T15:37:15.820178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244231+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:37:14.244231+0000","last_peered":"2024-04-17T15:37:14.244231+0000","last_clean":"2024-04-17T15:37:14.244231+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:37:14.244231+0000","last_undegraded":"2024-04-17T15:37:14.244231+0000","last_fullsized":"2024-04-17T15:37:14.244231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239934+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:37:14.239934+0000","last_peered":"2024-04-17T15:37:14.239934+0000","last_clean":"2024-04-17T15:37:14.239934+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:37:14.239934+0000","last_undegraded":"2024-04-17T15:37:14.239934+0000","last_fullsized":"2024-04-17T15:37:14.239934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822902+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:37:15.822902+0000","last_peered":"2024-04-17T15:37:15.822902+0000","last_clean":"2024-04-17T15:37:15.822902+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:37:15.822902+0000","last_undegraded":"2024-04-17T15:37:15.822902+0000","last_fullsized":"2024-04-17T15:37:15.822902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238903+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:37:14.238903+0000","last_peered":"2024-04-17T15:37:14.238903+0000","last_clean":"2024-04-17T15:37:14.238903+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:37:14.238903+0000","last_undegraded":"2024-04-17T15:37:14.238903+0000","last_fullsized":"2024-04-17T15:37:14.238903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238953+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:37:14.238953+0000","last_peered":"2024-04-17T15:37:14.238953+0000","last_clean":"2024-04-17T15:37:14.238953+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:37:14.238953+0000","last_undegraded":"2024-04-17T15:37:14.238953+0000","last_fullsized":"2024-04-17T15:37:14.238953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823333+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:37:15.823333+0000","last_peered":"2024-04-17T15:37:15.823333+0000","last_clean":"2024-04-17T15:37:15.823333+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:37:15.823333+0000","last_undegraded":"2024-04-17T15:37:15.823333+0000","last_fullsized":"2024-04-17T15:37:15.823333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.810210+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:37:14.810210+0000","last_peered":"2024-04-17T15:37:14.810210+0000","last_clean":"2024-04-17T15:37:14.810210+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:37:14.810210+0000","last_undegraded":"2024-04-17T15:37:14.810210+0000","last_fullsized":"2024-04-17T15:37:14.810210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821254+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:37:15.821254+0000","last_peered":"2024-04-17T15:37:15.821254+0000","last_clean":"2024-04-17T15:37:15.821254+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:37:15.821254+0000","last_undegraded":"2024-04-17T15:37:15.821254+0000","last_fullsized":"2024-04-17T15:37:15.821254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240604+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:37:14.240604+0000","last_peered":"2024-04-17T15:37:14.240604+0000","last_clean":"2024-04-17T15:37:14.240604+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:37:14.240604+0000","last_undegraded":"2024-04-17T15:37:14.240604+0000","last_fullsized":"2024-04-17T15:37:14.240604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246741+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:37:14.246741+0000","last_peered":"2024-04-17T15:37:14.246741+0000","last_clean":"2024-04-17T15:37:14.246741+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:37:14.246741+0000","last_undegraded":"2024-04-17T15:37:14.246741+0000","last_fullsized":"2024-04-17T15:37:14.246741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820709+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:37:15.820709+0000","last_peered":"2024-04-17T15:37:15.820709+0000","last_clean":"2024-04-17T15:37:15.820709+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:37:15.820709+0000","last_undegraded":"2024-04-17T15:37:15.820709+0000","last_fullsized":"2024-04-17T15:37:15.820709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807718+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:37:14.807718+0000","last_peered":"2024-04-17T15:37:14.807718+0000","last_clean":"2024-04-17T15:37:14.807718+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:37:14.807718+0000","last_undegraded":"2024-04-17T15:37:14.807718+0000","last_fullsized":"2024-04-17T15:37:14.807718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247383+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:37:14.247383+0000","last_peered":"2024-04-17T15:37:14.247383+0000","last_clean":"2024-04-17T15:37:14.247383+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:37:14.247383+0000","last_undegraded":"2024-04-17T15:37:14.247383+0000","last_fullsized":"2024-04-17T15:37:14.247383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819536+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:37:15.819536+0000","last_peered":"2024-04-17T15:37:15.819536+0000","last_clean":"2024-04-17T15:37:15.819536+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:37:15.819536+0000","last_undegraded":"2024-04-17T15:37:15.819536+0000","last_fullsized":"2024-04-17T15:37:15.819536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821242+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:37:15.821242+0000","last_peered":"2024-04-17T15:37:15.821242+0000","last_clean":"2024-04-17T15:37:15.821242+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:37:15.821242+0000","last_undegraded":"2024-04-17T15:37:15.821242+0000","last_fullsized":"2024-04-17T15:37:15.821242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.810296+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:37:14.810296+0000","last_peered":"2024-04-17T15:37:14.810296+0000","last_clean":"2024-04-17T15:37:14.810296+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:37:14.810296+0000","last_undegraded":"2024-04-17T15:37:14.810296+0000","last_fullsized":"2024-04-17T15:37:14.810296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240526+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:37:14.240526+0000","last_peered":"2024-04-17T15:37:14.240526+0000","last_clean":"2024-04-17T15:37:14.240526+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:37:14.240526+0000","last_undegraded":"2024-04-17T15:37:14.240526+0000","last_fullsized":"2024-04-17T15:37:14.240526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823805+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:37:15.823805+0000","last_peered":"2024-04-17T15:37:15.823805+0000","last_clean":"2024-04-17T15:37:15.823805+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:37:15.823805+0000","last_undegraded":"2024-04-17T15:37:15.823805+0000","last_fullsized":"2024-04-17T15:37:15.823805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823319+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:37:15.823319+0000","last_peered":"2024-04-17T15:37:15.823319+0000","last_clean":"2024-04-17T15:37:15.823319+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:37:15.823319+0000","last_undegraded":"2024-04-17T15:37:15.823319+0000","last_fullsized":"2024-04-17T15:37:15.823319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.810393+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:37:14.810393+0000","last_peered":"2024-04-17T15:37:14.810393+0000","last_clean":"2024-04-17T15:37:14.810393+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:37:14.810393+0000","last_undegraded":"2024-04-17T15:37:14.810393+0000","last_fullsized":"2024-04-17T15:37:14.810393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808040+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:37:14.808040+0000","last_peered":"2024-04-17T15:37:14.808040+0000","last_clean":"2024-04-17T15:37:14.808040+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:37:14.808040+0000","last_undegraded":"2024-04-17T15:37:14.808040+0000","last_fullsized":"2024-04-17T15:37:14.808040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.245033+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:37:14.245033+0000","last_peered":"2024-04-17T15:37:14.245033+0000","last_clean":"2024-04-17T15:37:14.245033+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:37:14.245033+0000","last_undegraded":"2024-04-17T15:37:14.245033+0000","last_fullsized":"2024-04-17T15:37:14.245033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239989+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:37:14.239989+0000","last_peered":"2024-04-17T15:37:14.239989+0000","last_clean":"2024-04-17T15:37:14.239989+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:37:14.239989+0000","last_undegraded":"2024-04-17T15:37:14.239989+0000","last_fullsized":"2024-04-17T15:37:14.239989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238716+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:37:14.238716+0000","last_peered":"2024-04-17T15:37:14.238716+0000","last_clean":"2024-04-17T15:37:14.238716+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:37:14.238716+0000","last_undegraded":"2024-04-17T15:37:14.238716+0000","last_fullsized":"2024-04-17T15:37:14.238716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246755+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:37:14.246755+0000","last_peered":"2024-04-17T15:37:14.246755+0000","last_clean":"2024-04-17T15:37:14.246755+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:37:14.246755+0000","last_undegraded":"2024-04-17T15:37:14.246755+0000","last_fullsized":"2024-04-17T15:37:14.246755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822698+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:37:15.822698+0000","last_peered":"2024-04-17T15:37:15.822698+0000","last_clean":"2024-04-17T15:37:15.822698+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:37:15.822698+0000","last_undegraded":"2024-04-17T15:37:15.822698+0000","last_fullsized":"2024-04-17T15:37:15.822698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240341+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:37:14.240341+0000","last_peered":"2024-04-17T15:37:14.240341+0000","last_clean":"2024-04-17T15:37:14.240341+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:37:14.240341+0000","last_undegraded":"2024-04-17T15:37:14.240341+0000","last_fullsized":"2024-04-17T15:37:14.240341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242109+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:37:14.242109+0000","last_peered":"2024-04-17T15:37:14.242109+0000","last_clean":"2024-04-17T15:37:14.242109+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:37:14.242109+0000","last_undegraded":"2024-04-17T15:37:14.242109+0000","last_fullsized":"2024-04-17T15:37:14.242109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821827+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:37:15.821827+0000","last_peered":"2024-04-17T15:37:15.821827+0000","last_clean":"2024-04-17T15:37:15.821827+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:37:15.821827+0000","last_undegraded":"2024-04-17T15:37:15.821827+0000","last_fullsized":"2024-04-17T15:37:15.821827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247020+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:37:14.247020+0000","last_peered":"2024-04-17T15:37:14.247020+0000","last_clean":"2024-04-17T15:37:14.247020+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:37:14.247020+0000","last_undegraded":"2024-04-17T15:37:14.247020+0000","last_fullsized":"2024-04-17T15:37:14.247020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240364+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:37:14.240364+0000","last_peered":"2024-04-17T15:37:14.240364+0000","last_clean":"2024-04-17T15:37:14.240364+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:37:14.240364+0000","last_undegraded":"2024-04-17T15:37:14.240364+0000","last_fullsized":"2024-04-17T15:37:14.240364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819915+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:37:15.819915+0000","last_peered":"2024-04-17T15:37:15.819915+0000","last_clean":"2024-04-17T15:37:15.819915+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:37:15.819915+0000","last_undegraded":"2024-04-17T15:37:15.819915+0000","last_fullsized":"2024-04-17T15:37:15.819915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247912+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:37:14.247912+0000","last_peered":"2024-04-17T15:37:14.247912+0000","last_clean":"2024-04-17T15:37:14.247912+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:37:14.247912+0000","last_undegraded":"2024-04-17T15:37:14.247912+0000","last_fullsized":"2024-04-17T15:37:14.247912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243786+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:37:14.243786+0000","last_peered":"2024-04-17T15:37:14.243786+0000","last_clean":"2024-04-17T15:37:14.243786+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:37:14.243786+0000","last_undegraded":"2024-04-17T15:37:14.243786+0000","last_fullsized":"2024-04-17T15:37:14.243786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819737+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:37:15.819737+0000","last_peered":"2024-04-17T15:37:15.819737+0000","last_clean":"2024-04-17T15:37:15.819737+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:37:15.819737+0000","last_undegraded":"2024-04-17T15:37:15.819737+0000","last_fullsized":"2024-04-17T15:37:15.819737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820054+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:37:15.820054+0000","last_peered":"2024-04-17T15:37:15.820054+0000","last_clean":"2024-04-17T15:37:15.820054+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:37:15.820054+0000","last_undegraded":"2024-04-17T15:37:15.820054+0000","last_fullsized":"2024-04-17T15:37:15.820054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820080+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:37:15.820080+0000","last_peered":"2024-04-17T15:37:15.820080+0000","last_clean":"2024-04-17T15:37:15.820080+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:37:15.820080+0000","last_undegraded":"2024-04-17T15:37:15.820080+0000","last_fullsized":"2024-04-17T15:37:15.820080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822525+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:37:15.822525+0000","last_peered":"2024-04-17T15:37:15.822525+0000","last_clean":"2024-04-17T15:37:15.822525+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:37:15.822525+0000","last_undegraded":"2024-04-17T15:37:15.822525+0000","last_fullsized":"2024-04-17T15:37:15.822525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247682+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:37:14.247682+0000","last_peered":"2024-04-17T15:37:14.247682+0000","last_clean":"2024-04-17T15:37:14.247682+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:37:14.247682+0000","last_undegraded":"2024-04-17T15:37:14.247682+0000","last_fullsized":"2024-04-17T15:37:14.247682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240464+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:37:14.240464+0000","last_peered":"2024-04-17T15:37:14.240464+0000","last_clean":"2024-04-17T15:37:14.240464+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:37:14.240464+0000","last_undegraded":"2024-04-17T15:37:14.240464+0000","last_fullsized":"2024-04-17T15:37:14.240464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239398+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:37:14.239398+0000","last_peered":"2024-04-17T15:37:14.239398+0000","last_clean":"2024-04-17T15:37:14.239398+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:37:14.239398+0000","last_undegraded":"2024-04-17T15:37:14.239398+0000","last_fullsized":"2024-04-17T15:37:14.239398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238389+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:37:14.238389+0000","last_peered":"2024-04-17T15:37:14.238389+0000","last_clean":"2024-04-17T15:37:14.238389+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:37:14.238389+0000","last_undegraded":"2024-04-17T15:37:14.238389+0000","last_fullsized":"2024-04-17T15:37:14.238389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243445+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:37:14.243445+0000","last_peered":"2024-04-17T15:37:14.243445+0000","last_clean":"2024-04-17T15:37:14.243445+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:37:14.243445+0000","last_undegraded":"2024-04-17T15:37:14.243445+0000","last_fullsized":"2024-04-17T15:37:14.243445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242808+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:37:14.242808+0000","last_peered":"2024-04-17T15:37:14.242808+0000","last_clean":"2024-04-17T15:37:14.242808+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:37:14.242808+0000","last_undegraded":"2024-04-17T15:37:14.242808+0000","last_fullsized":"2024-04-17T15:37:14.242808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247698+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:37:14.247698+0000","last_peered":"2024-04-17T15:37:14.247698+0000","last_clean":"2024-04-17T15:37:14.247698+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:37:14.247698+0000","last_undegraded":"2024-04-17T15:37:14.247698+0000","last_fullsized":"2024-04-17T15:37:14.247698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240179+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:37:14.240179+0000","last_peered":"2024-04-17T15:37:14.240179+0000","last_clean":"2024-04-17T15:37:14.240179+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:37:14.240179+0000","last_undegraded":"2024-04-17T15:37:14.240179+0000","last_fullsized":"2024-04-17T15:37:14.240179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243950+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:37:14.243950+0000","last_peered":"2024-04-17T15:37:14.243950+0000","last_clean":"2024-04-17T15:37:14.243950+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:37:14.243950+0000","last_undegraded":"2024-04-17T15:37:14.243950+0000","last_fullsized":"2024-04-17T15:37:14.243950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806439+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:37:14.806439+0000","last_peered":"2024-04-17T15:37:14.806439+0000","last_clean":"2024-04-17T15:37:14.806439+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:37:14.806439+0000","last_undegraded":"2024-04-17T15:37:14.806439+0000","last_fullsized":"2024-04-17T15:37:14.806439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807764+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:37:14.807764+0000","last_peered":"2024-04-17T15:37:14.807764+0000","last_clean":"2024-04-17T15:37:14.807764+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:37:14.807764+0000","last_undegraded":"2024-04-17T15:37:14.807764+0000","last_fullsized":"2024-04-17T15:37:14.807764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.809555+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:37:14.809555+0000","last_peered":"2024-04-17T15:37:14.809555+0000","last_clean":"2024-04-17T15:37:14.809555+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:37:14.809555+0000","last_undegraded":"2024-04-17T15:37:14.809555+0000","last_fullsized":"2024-04-17T15:37:14.809555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820905+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:37:15.820905+0000","last_peered":"2024-04-17T15:37:15.820905+0000","last_clean":"2024-04-17T15:37:15.820905+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:37:15.820905+0000","last_undegraded":"2024-04-17T15:37:15.820905+0000","last_fullsized":"2024-04-17T15:37:15.820905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240702+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:37:14.240702+0000","last_peered":"2024-04-17T15:37:14.240702+0000","last_clean":"2024-04-17T15:37:14.240702+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:37:14.240702+0000","last_undegraded":"2024-04-17T15:37:14.240702+0000","last_fullsized":"2024-04-17T15:37:14.240702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806710+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:37:14.806710+0000","last_peered":"2024-04-17T15:37:14.806710+0000","last_clean":"2024-04-17T15:37:14.806710+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:37:14.806710+0000","last_undegraded":"2024-04-17T15:37:14.806710+0000","last_fullsized":"2024-04-17T15:37:14.806710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240322+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:37:14.240322+0000","last_peered":"2024-04-17T15:37:14.240322+0000","last_clean":"2024-04-17T15:37:14.240322+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:37:14.240322+0000","last_undegraded":"2024-04-17T15:37:14.240322+0000","last_fullsized":"2024-04-17T15:37:14.240322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823453+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:37:15.823453+0000","last_peered":"2024-04-17T15:37:15.823453+0000","last_clean":"2024-04-17T15:37:15.823453+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:37:15.823453+0000","last_undegraded":"2024-04-17T15:37:15.823453+0000","last_fullsized":"2024-04-17T15:37:15.823453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823247+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:37:15.823247+0000","last_peered":"2024-04-17T15:37:15.823247+0000","last_clean":"2024-04-17T15:37:15.823247+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:37:15.823247+0000","last_undegraded":"2024-04-17T15:37:15.823247+0000","last_fullsized":"2024-04-17T15:37:15.823247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238682+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:37:14.238682+0000","last_peered":"2024-04-17T15:37:14.238682+0000","last_clean":"2024-04-17T15:37:14.238682+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:37:14.238682+0000","last_undegraded":"2024-04-17T15:37:14.238682+0000","last_fullsized":"2024-04-17T15:37:14.238682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239471+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:37:14.239471+0000","last_peered":"2024-04-17T15:37:14.239471+0000","last_clean":"2024-04-17T15:37:14.239471+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:37:14.239471+0000","last_undegraded":"2024-04-17T15:37:14.239471+0000","last_fullsized":"2024-04-17T15:37:14.239471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823566+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:37:15.823566+0000","last_peered":"2024-04-17T15:37:15.823566+0000","last_clean":"2024-04-17T15:37:15.823566+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:37:15.823566+0000","last_undegraded":"2024-04-17T15:37:15.823566+0000","last_fullsized":"2024-04-17T15:37:15.823566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808243+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:37:14.808243+0000","last_peered":"2024-04-17T15:37:14.808243+0000","last_clean":"2024-04-17T15:37:14.808243+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:37:14.808243+0000","last_undegraded":"2024-04-17T15:37:14.808243+0000","last_fullsized":"2024-04-17T15:37:14.808243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239917+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:37:14.239917+0000","last_peered":"2024-04-17T15:37:14.239917+0000","last_clean":"2024-04-17T15:37:14.239917+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:37:14.239917+0000","last_undegraded":"2024-04-17T15:37:14.239917+0000","last_fullsized":"2024-04-17T15:37:14.239917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823473+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:37:15.823473+0000","last_peered":"2024-04-17T15:37:15.823473+0000","last_clean":"2024-04-17T15:37:15.823473+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:37:15.823473+0000","last_undegraded":"2024-04-17T15:37:15.823473+0000","last_fullsized":"2024-04-17T15:37:15.823473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243057+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:37:14.243057+0000","last_peered":"2024-04-17T15:37:14.243057+0000","last_clean":"2024-04-17T15:37:14.243057+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:37:14.243057+0000","last_undegraded":"2024-04-17T15:37:14.243057+0000","last_fullsized":"2024-04-17T15:37:14.243057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820522+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:37:15.820522+0000","last_peered":"2024-04-17T15:37:15.820522+0000","last_clean":"2024-04-17T15:37:15.820522+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:37:15.820522+0000","last_undegraded":"2024-04-17T15:37:15.820522+0000","last_fullsized":"2024-04-17T15:37:15.820522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239215+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:37:14.239215+0000","last_peered":"2024-04-17T15:37:14.239215+0000","last_clean":"2024-04-17T15:37:14.239215+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:37:14.239215+0000","last_undegraded":"2024-04-17T15:37:14.239215+0000","last_fullsized":"2024-04-17T15:37:14.239215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241317+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:37:14.241317+0000","last_peered":"2024-04-17T15:37:14.241317+0000","last_clean":"2024-04-17T15:37:14.241317+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:37:14.241317+0000","last_undegraded":"2024-04-17T15:37:14.241317+0000","last_fullsized":"2024-04-17T15:37:14.241317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.817036+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:37:15.817036+0000","last_peered":"2024-04-17T15:37:15.817036+0000","last_clean":"2024-04-17T15:37:15.817036+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:37:15.817036+0000","last_undegraded":"2024-04-17T15:37:15.817036+0000","last_fullsized":"2024-04-17T15:37:15.817036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.824329+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:37:15.824329+0000","last_peered":"2024-04-17T15:37:15.824329+0000","last_clean":"2024-04-17T15:37:15.824329+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:37:15.824329+0000","last_undegraded":"2024-04-17T15:37:15.824329+0000","last_fullsized":"2024-04-17T15:37:15.824329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823300+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:37:15.823300+0000","last_peered":"2024-04-17T15:37:15.823300+0000","last_clean":"2024-04-17T15:37:15.823300+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:37:15.823300+0000","last_undegraded":"2024-04-17T15:37:15.823300+0000","last_fullsized":"2024-04-17T15:37:15.823300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821589+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:37:15.821589+0000","last_peered":"2024-04-17T15:37:15.821589+0000","last_clean":"2024-04-17T15:37:15.821589+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:37:15.821589+0000","last_undegraded":"2024-04-17T15:37:15.821589+0000","last_fullsized":"2024-04-17T15:37:15.821589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240413+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:37:14.240413+0000","last_peered":"2024-04-17T15:37:14.240413+0000","last_clean":"2024-04-17T15:37:14.240413+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:37:14.240413+0000","last_undegraded":"2024-04-17T15:37:14.240413+0000","last_fullsized":"2024-04-17T15:37:14.240413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243751+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:37:14.243751+0000","last_peered":"2024-04-17T15:37:14.243751+0000","last_clean":"2024-04-17T15:37:14.243751+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:37:14.243751+0000","last_undegraded":"2024-04-17T15:37:14.243751+0000","last_fullsized":"2024-04-17T15:37:14.243751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822774+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:37:15.822774+0000","last_peered":"2024-04-17T15:37:15.822774+0000","last_clean":"2024-04-17T15:37:15.822774+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:37:15.822774+0000","last_undegraded":"2024-04-17T15:37:15.822774+0000","last_fullsized":"2024-04-17T15:37:15.822774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823841+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:37:15.823841+0000","last_peered":"2024-04-17T15:37:15.823841+0000","last_clean":"2024-04-17T15:37:15.823841+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:37:15.823841+0000","last_undegraded":"2024-04-17T15:37:15.823841+0000","last_fullsized":"2024-04-17T15:37:15.823841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240556+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:37:14.240556+0000","last_peered":"2024-04-17T15:37:14.240556+0000","last_clean":"2024-04-17T15:37:14.240556+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:37:14.240556+0000","last_undegraded":"2024-04-17T15:37:14.240556+0000","last_fullsized":"2024-04-17T15:37:14.240556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.824104+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:37:15.824104+0000","last_peered":"2024-04-17T15:37:15.824104+0000","last_clean":"2024-04-17T15:37:15.824104+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:37:15.824104+0000","last_undegraded":"2024-04-17T15:37:15.824104+0000","last_fullsized":"2024-04-17T15:37:15.824104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820595+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:37:15.820595+0000","last_peered":"2024-04-17T15:37:15.820595+0000","last_clean":"2024-04-17T15:37:15.820595+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:37:15.820595+0000","last_undegraded":"2024-04-17T15:37:15.820595+0000","last_fullsized":"2024-04-17T15:37:15.820595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242797+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:37:14.242797+0000","last_peered":"2024-04-17T15:37:14.242797+0000","last_clean":"2024-04-17T15:37:14.242797+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:37:14.242797+0000","last_undegraded":"2024-04-17T15:37:14.242797+0000","last_fullsized":"2024-04-17T15:37:14.242797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819738+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:37:15.819738+0000","last_peered":"2024-04-17T15:37:15.819738+0000","last_clean":"2024-04-17T15:37:15.819738+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:37:15.819738+0000","last_undegraded":"2024-04-17T15:37:15.819738+0000","last_fullsized":"2024-04-17T15:37:15.819738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244074+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:37:14.244074+0000","last_peered":"2024-04-17T15:37:14.244074+0000","last_clean":"2024-04-17T15:37:14.244074+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:37:14.244074+0000","last_undegraded":"2024-04-17T15:37:14.244074+0000","last_fullsized":"2024-04-17T15:37:14.244074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244204+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:37:14.244204+0000","last_peered":"2024-04-17T15:37:14.244204+0000","last_clean":"2024-04-17T15:37:14.244204+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:37:14.244204+0000","last_undegraded":"2024-04-17T15:37:14.244204+0000","last_fullsized":"2024-04-17T15:37:14.244204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820541+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:37:15.820541+0000","last_peered":"2024-04-17T15:37:15.820541+0000","last_clean":"2024-04-17T15:37:15.820541+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:37:15.820541+0000","last_undegraded":"2024-04-17T15:37:15.820541+0000","last_fullsized":"2024-04-17T15:37:15.820541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238723+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:37:14.238723+0000","last_peered":"2024-04-17T15:37:14.238723+0000","last_clean":"2024-04-17T15:37:14.238723+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:37:14.238723+0000","last_undegraded":"2024-04-17T15:37:14.238723+0000","last_fullsized":"2024-04-17T15:37:14.238723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244583+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:37:14.244583+0000","last_peered":"2024-04-17T15:37:14.244583+0000","last_clean":"2024-04-17T15:37:14.244583+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:37:14.244583+0000","last_undegraded":"2024-04-17T15:37:14.244583+0000","last_fullsized":"2024-04-17T15:37:14.244583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821679+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:37:15.821679+0000","last_peered":"2024-04-17T15:37:15.821679+0000","last_clean":"2024-04-17T15:37:15.821679+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:37:15.821679+0000","last_undegraded":"2024-04-17T15:37:15.821679+0000","last_fullsized":"2024-04-17T15:37:15.821679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807808+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:37:14.807808+0000","last_peered":"2024-04-17T15:37:14.807808+0000","last_clean":"2024-04-17T15:37:14.807808+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:37:14.807808+0000","last_undegraded":"2024-04-17T15:37:14.807808+0000","last_fullsized":"2024-04-17T15:37:14.807808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241762+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:37:14.241762+0000","last_peered":"2024-04-17T15:37:14.241762+0000","last_clean":"2024-04-17T15:37:14.241762+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:37:14.241762+0000","last_undegraded":"2024-04-17T15:37:14.241762+0000","last_fullsized":"2024-04-17T15:37:14.241762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807969+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:37:14.807969+0000","last_peered":"2024-04-17T15:37:14.807969+0000","last_clean":"2024-04-17T15:37:14.807969+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:37:14.807969+0000","last_undegraded":"2024-04-17T15:37:14.807969+0000","last_fullsized":"2024-04-17T15:37:14.807969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243723+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:37:14.243723+0000","last_peered":"2024-04-17T15:37:14.243723+0000","last_clean":"2024-04-17T15:37:14.243723+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:37:14.243723+0000","last_undegraded":"2024-04-17T15:37:14.243723+0000","last_fullsized":"2024-04-17T15:37:14.243723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806800+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:37:14.806800+0000","last_peered":"2024-04-17T15:37:14.806800+0000","last_clean":"2024-04-17T15:37:14.806800+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:37:14.806800+0000","last_undegraded":"2024-04-17T15:37:14.806800+0000","last_fullsized":"2024-04-17T15:37:14.806800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822057+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:37:15.822057+0000","last_peered":"2024-04-17T15:37:15.822057+0000","last_clean":"2024-04-17T15:37:15.822057+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:37:15.822057+0000","last_undegraded":"2024-04-17T15:37:15.822057+0000","last_fullsized":"2024-04-17T15:37:15.822057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820450+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:37:15.820450+0000","last_peered":"2024-04-17T15:37:15.820450+0000","last_clean":"2024-04-17T15:37:15.820450+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:37:15.820450+0000","last_undegraded":"2024-04-17T15:37:15.820450+0000","last_fullsized":"2024-04-17T15:37:15.820450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246985+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:37:14.246985+0000","last_peered":"2024-04-17T15:37:14.246985+0000","last_clean":"2024-04-17T15:37:14.246985+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:37:14.246985+0000","last_undegraded":"2024-04-17T15:37:14.246985+0000","last_fullsized":"2024-04-17T15:37:14.246985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.816853+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:37:15.816853+0000","last_peered":"2024-04-17T15:37:15.816853+0000","last_clean":"2024-04-17T15:37:15.816853+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:37:15.816853+0000","last_undegraded":"2024-04-17T15:37:15.816853+0000","last_fullsized":"2024-04-17T15:37:15.816853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823952+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:37:15.823952+0000","last_peered":"2024-04-17T15:37:15.823952+0000","last_clean":"2024-04-17T15:37:15.823952+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:37:15.823952+0000","last_undegraded":"2024-04-17T15:37:15.823952+0000","last_fullsized":"2024-04-17T15:37:15.823952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238549+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:37:14.238549+0000","last_peered":"2024-04-17T15:37:14.238549+0000","last_clean":"2024-04-17T15:37:14.238549+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:37:14.238549+0000","last_undegraded":"2024-04-17T15:37:14.238549+0000","last_fullsized":"2024-04-17T15:37:14.238549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.816828+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:37:15.816828+0000","last_peered":"2024-04-17T15:37:15.816828+0000","last_clean":"2024-04-17T15:37:15.816828+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:37:15.816828+0000","last_undegraded":"2024-04-17T15:37:15.816828+0000","last_fullsized":"2024-04-17T15:37:15.816828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241152+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:37:14.241152+0000","last_peered":"2024-04-17T15:37:14.241152+0000","last_clean":"2024-04-17T15:37:14.241152+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:37:14.241152+0000","last_undegraded":"2024-04-17T15:37:14.241152+0000","last_fullsized":"2024-04-17T15:37:14.241152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247273+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:37:14.247273+0000","last_peered":"2024-04-17T15:37:14.247273+0000","last_clean":"2024-04-17T15:37:14.247273+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:37:14.247273+0000","last_undegraded":"2024-04-17T15:37:14.247273+0000","last_fullsized":"2024-04-17T15:37:14.247273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807100+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:37:14.807100+0000","last_peered":"2024-04-17T15:37:14.807100+0000","last_clean":"2024-04-17T15:37:14.807100+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:37:14.807100+0000","last_undegraded":"2024-04-17T15:37:14.807100+0000","last_fullsized":"2024-04-17T15:37:14.807100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239158+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:37:14.239158+0000","last_peered":"2024-04-17T15:37:14.239158+0000","last_clean":"2024-04-17T15:37:14.239158+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:37:14.239158+0000","last_undegraded":"2024-04-17T15:37:14.239158+0000","last_fullsized":"2024-04-17T15:37:14.239158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820704+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:37:15.820704+0000","last_peered":"2024-04-17T15:37:15.820704+0000","last_clean":"2024-04-17T15:37:15.820704+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:37:15.820704+0000","last_undegraded":"2024-04-17T15:37:15.820704+0000","last_fullsized":"2024-04-17T15:37:15.820704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820385+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:37:15.820385+0000","last_peered":"2024-04-17T15:37:15.820385+0000","last_clean":"2024-04-17T15:37:15.820385+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:37:15.820385+0000","last_undegraded":"2024-04-17T15:37:15.820385+0000","last_fullsized":"2024-04-17T15:37:15.820385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823704+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:37:15.823704+0000","last_peered":"2024-04-17T15:37:15.823704+0000","last_clean":"2024-04-17T15:37:15.823704+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:37:15.823704+0000","last_undegraded":"2024-04-17T15:37:15.823704+0000","last_fullsized":"2024-04-17T15:37:15.823704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807417+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:37:14.807417+0000","last_peered":"2024-04-17T15:37:14.807417+0000","last_clean":"2024-04-17T15:37:14.807417+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:37:14.807417+0000","last_undegraded":"2024-04-17T15:37:14.807417+0000","last_fullsized":"2024-04-17T15:37:14.807417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240012+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:37:14.240012+0000","last_peered":"2024-04-17T15:37:14.240012+0000","last_clean":"2024-04-17T15:37:14.240012+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:37:14.240012+0000","last_undegraded":"2024-04-17T15:37:14.240012+0000","last_fullsized":"2024-04-17T15:37:14.240012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244034+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:37:14.244034+0000","last_peered":"2024-04-17T15:37:14.244034+0000","last_clean":"2024-04-17T15:37:14.244034+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:37:14.244034+0000","last_undegraded":"2024-04-17T15:37:14.244034+0000","last_fullsized":"2024-04-17T15:37:14.244034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819400+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:37:15.819400+0000","last_peered":"2024-04-17T15:37:15.819400+0000","last_clean":"2024-04-17T15:37:15.819400+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:37:15.819400+0000","last_undegraded":"2024-04-17T15:37:15.819400+0000","last_fullsized":"2024-04-17T15:37:15.819400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819674+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:37:15.819674+0000","last_peered":"2024-04-17T15:37:15.819674+0000","last_clean":"2024-04-17T15:37:15.819674+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:37:15.819674+0000","last_undegraded":"2024-04-17T15:37:15.819674+0000","last_fullsized":"2024-04-17T15:37:15.819674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821417+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:37:15.821417+0000","last_peered":"2024-04-17T15:37:15.821417+0000","last_clean":"2024-04-17T15:37:15.821417+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:37:15.821417+0000","last_undegraded":"2024-04-17T15:37:15.821417+0000","last_fullsized":"2024-04-17T15:37:15.821417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820860+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:37:15.820860+0000","last_peered":"2024-04-17T15:37:15.820860+0000","last_clean":"2024-04-17T15:37:15.820860+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:37:15.820860+0000","last_undegraded":"2024-04-17T15:37:15.820860+0000","last_fullsized":"2024-04-17T15:37:15.820860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808726+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:37:14.808726+0000","last_peered":"2024-04-17T15:37:14.808726+0000","last_clean":"2024-04-17T15:37:14.808726+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:37:14.808726+0000","last_undegraded":"2024-04-17T15:37:14.808726+0000","last_fullsized":"2024-04-17T15:37:14.808726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806451+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:37:14.806451+0000","last_peered":"2024-04-17T15:37:14.806451+0000","last_clean":"2024-04-17T15:37:14.806451+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:37:14.806451+0000","last_undegraded":"2024-04-17T15:37:14.806451+0000","last_fullsized":"2024-04-17T15:37:14.806451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821911+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:37:15.821911+0000","last_peered":"2024-04-17T15:37:15.821911+0000","last_clean":"2024-04-17T15:37:15.821911+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:37:15.821911+0000","last_undegraded":"2024-04-17T15:37:15.821911+0000","last_fullsized":"2024-04-17T15:37:15.821911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807635+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:37:14.807635+0000","last_peered":"2024-04-17T15:37:14.807635+0000","last_clean":"2024-04-17T15:37:14.807635+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:37:14.807635+0000","last_undegraded":"2024-04-17T15:37:14.807635+0000","last_fullsized":"2024-04-17T15:37:14.807635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.809389+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:37:14.809389+0000","last_peered":"2024-04-17T15:37:14.809389+0000","last_clean":"2024-04-17T15:37:14.809389+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:37:14.809389+0000","last_undegraded":"2024-04-17T15:37:14.809389+0000","last_fullsized":"2024-04-17T15:37:14.809389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820721+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:37:15.820721+0000","last_peered":"2024-04-17T15:37:15.820721+0000","last_clean":"2024-04-17T15:37:15.820721+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:37:15.820721+0000","last_undegraded":"2024-04-17T15:37:15.820721+0000","last_fullsized":"2024-04-17T15:37:15.820721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247951+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:37:14.247951+0000","last_peered":"2024-04-17T15:37:14.247951+0000","last_clean":"2024-04-17T15:37:14.247951+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:37:14.247951+0000","last_undegraded":"2024-04-17T15:37:14.247951+0000","last_fullsized":"2024-04-17T15:37:14.247951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242521+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:37:14.242521+0000","last_peered":"2024-04-17T15:37:14.242521+0000","last_clean":"2024-04-17T15:37:14.242521+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:37:14.242521+0000","last_undegraded":"2024-04-17T15:37:14.242521+0000","last_fullsized":"2024-04-17T15:37:14.242521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.816722+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:37:15.816722+0000","last_peered":"2024-04-17T15:37:15.816722+0000","last_clean":"2024-04-17T15:37:15.816722+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:37:15.816722+0000","last_undegraded":"2024-04-17T15:37:15.816722+0000","last_fullsized":"2024-04-17T15:37:15.816722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819721+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:37:15.819721+0000","last_peered":"2024-04-17T15:37:15.819721+0000","last_clean":"2024-04-17T15:37:15.819721+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:37:15.819721+0000","last_undegraded":"2024-04-17T15:37:15.819721+0000","last_fullsized":"2024-04-17T15:37:15.819721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240588+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:37:14.240588+0000","last_peered":"2024-04-17T15:37:14.240588+0000","last_clean":"2024-04-17T15:37:14.240588+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:37:14.240588+0000","last_undegraded":"2024-04-17T15:37:14.240588+0000","last_fullsized":"2024-04-17T15:37:14.240588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240168+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:37:14.240168+0000","last_peered":"2024-04-17T15:37:14.240168+0000","last_clean":"2024-04-17T15:37:14.240168+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:37:14.240168+0000","last_undegraded":"2024-04-17T15:37:14.240168+0000","last_fullsized":"2024-04-17T15:37:14.240168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240164+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:37:14.240164+0000","last_peered":"2024-04-17T15:37:14.240164+0000","last_clean":"2024-04-17T15:37:14.240164+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:37:14.240164+0000","last_undegraded":"2024-04-17T15:37:14.240164+0000","last_fullsized":"2024-04-17T15:37:14.240164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823536+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:37:15.823536+0000","last_peered":"2024-04-17T15:37:15.823536+0000","last_clean":"2024-04-17T15:37:15.823536+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:37:15.823536+0000","last_undegraded":"2024-04-17T15:37:15.823536+0000","last_fullsized":"2024-04-17T15:37:15.823536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822421+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:37:15.822421+0000","last_peered":"2024-04-17T15:37:15.822421+0000","last_clean":"2024-04-17T15:37:15.822421+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:37:15.822421+0000","last_undegraded":"2024-04-17T15:37:15.822421+0000","last_fullsized":"2024-04-17T15:37:15.822421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822974+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:37:15.822974+0000","last_peered":"2024-04-17T15:37:15.822974+0000","last_clean":"2024-04-17T15:37:15.822974+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:37:15.822974+0000","last_undegraded":"2024-04-17T15:37:15.822974+0000","last_fullsized":"2024-04-17T15:37:15.822974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239713+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:37:14.239713+0000","last_peered":"2024-04-17T15:37:14.239713+0000","last_clean":"2024-04-17T15:37:14.239713+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:37:14.239713+0000","last_undegraded":"2024-04-17T15:37:14.239713+0000","last_fullsized":"2024-04-17T15:37:14.239713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807187+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:37:14.807187+0000","last_peered":"2024-04-17T15:37:14.807187+0000","last_clean":"2024-04-17T15:37:14.807187+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:37:14.807187+0000","last_undegraded":"2024-04-17T15:37:14.807187+0000","last_fullsized":"2024-04-17T15:37:14.807187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822507+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:37:15.822507+0000","last_peered":"2024-04-17T15:37:15.822507+0000","last_clean":"2024-04-17T15:37:15.822507+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:37:15.822507+0000","last_undegraded":"2024-04-17T15:37:15.822507+0000","last_fullsized":"2024-04-17T15:37:15.822507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808084+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:37:14.808084+0000","last_peered":"2024-04-17T15:37:14.808084+0000","last_clean":"2024-04-17T15:37:14.808084+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:37:14.808084+0000","last_undegraded":"2024-04-17T15:37:14.808084+0000","last_fullsized":"2024-04-17T15:37:14.808084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244693+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:37:14.244693+0000","last_peered":"2024-04-17T15:37:14.244693+0000","last_clean":"2024-04-17T15:37:14.244693+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:37:14.244693+0000","last_undegraded":"2024-04-17T15:37:14.244693+0000","last_fullsized":"2024-04-17T15:37:14.244693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239690+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:37:14.239690+0000","last_peered":"2024-04-17T15:37:14.239690+0000","last_clean":"2024-04-17T15:37:14.239690+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:37:14.239690+0000","last_undegraded":"2024-04-17T15:37:14.239690+0000","last_fullsized":"2024-04-17T15:37:14.239690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.245544+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:37:14.245544+0000","last_peered":"2024-04-17T15:37:14.245544+0000","last_clean":"2024-04-17T15:37:14.245544+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:37:14.245544+0000","last_undegraded":"2024-04-17T15:37:14.245544+0000","last_fullsized":"2024-04-17T15:37:14.245544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238480+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:37:14.238480+0000","last_peered":"2024-04-17T15:37:14.238480+0000","last_clean":"2024-04-17T15:37:14.238480+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:37:14.238480+0000","last_undegraded":"2024-04-17T15:37:14.238480+0000","last_fullsized":"2024-04-17T15:37:14.238480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820375+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:37:15.820375+0000","last_peered":"2024-04-17T15:37:15.820375+0000","last_clean":"2024-04-17T15:37:15.820375+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:37:15.820375+0000","last_undegraded":"2024-04-17T15:37:15.820375+0000","last_fullsized":"2024-04-17T15:37:15.820375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808170+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:37:14.808170+0000","last_peered":"2024-04-17T15:37:14.808170+0000","last_clean":"2024-04-17T15:37:14.808170+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:37:14.808170+0000","last_undegraded":"2024-04-17T15:37:14.808170+0000","last_fullsized":"2024-04-17T15:37:14.808170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823417+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:37:15.823417+0000","last_peered":"2024-04-17T15:37:15.823417+0000","last_clean":"2024-04-17T15:37:15.823417+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:37:15.823417+0000","last_undegraded":"2024-04-17T15:37:15.823417+0000","last_fullsized":"2024-04-17T15:37:15.823417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822852+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:37:15.822852+0000","last_peered":"2024-04-17T15:37:15.822852+0000","last_clean":"2024-04-17T15:37:15.822852+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:37:15.822852+0000","last_undegraded":"2024-04-17T15:37:15.822852+0000","last_fullsized":"2024-04-17T15:37:15.822852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819755+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:37:15.819755+0000","last_peered":"2024-04-17T15:37:15.819755+0000","last_clean":"2024-04-17T15:37:15.819755+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:37:15.819755+0000","last_undegraded":"2024-04-17T15:37:15.819755+0000","last_fullsized":"2024-04-17T15:37:15.819755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239175+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:37:14.239175+0000","last_peered":"2024-04-17T15:37:14.239175+0000","last_clean":"2024-04-17T15:37:14.239175+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:37:14.239175+0000","last_undegraded":"2024-04-17T15:37:14.239175+0000","last_fullsized":"2024-04-17T15:37:14.239175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240008+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:37:14.240008+0000","last_peered":"2024-04-17T15:37:14.240008+0000","last_clean":"2024-04-17T15:37:14.240008+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:37:14.240008+0000","last_undegraded":"2024-04-17T15:37:14.240008+0000","last_fullsized":"2024-04-17T15:37:14.240008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239791+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:37:14.239791+0000","last_peered":"2024-04-17T15:37:14.239791+0000","last_clean":"2024-04-17T15:37:14.239791+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:37:14.239791+0000","last_undegraded":"2024-04-17T15:37:14.239791+0000","last_fullsized":"2024-04-17T15:37:14.239791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819573+0000","last_change":"2024-04-17T15:36:56.210604+0000","last_active":"2024-04-17T15:37:15.819573+0000","last_peered":"2024-04-17T15:37:15.819573+0000","last_clean":"2024-04-17T15:37:15.819573+0000","last_became_active":"2024-04-17T15:36:56.210290+0000","last_became_peered":"2024-04-17T15:36:56.210290+0000","last_unstale":"2024-04-17T15:37:15.819573+0000","last_undegraded":"2024-04-17T15:37:15.819573+0000","last_fullsized":"2024-04-17T15:37:15.819573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247620+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:37:14.247620+0000","last_peered":"2024-04-17T15:37:14.247620+0000","last_clean":"2024-04-17T15:37:14.247620+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:37:14.247620+0000","last_undegraded":"2024-04-17T15:37:14.247620+0000","last_fullsized":"2024-04-17T15:37:14.247620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239059+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:37:14.239059+0000","last_peered":"2024-04-17T15:37:14.239059+0000","last_clean":"2024-04-17T15:37:14.239059+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:37:14.239059+0000","last_undegraded":"2024-04-17T15:37:14.239059+0000","last_fullsized":"2024-04-17T15:37:14.239059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806306+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:37:14.806306+0000","last_peered":"2024-04-17T15:37:14.806306+0000","last_clean":"2024-04-17T15:37:14.806306+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:37:14.806306+0000","last_undegraded":"2024-04-17T15:37:14.806306+0000","last_fullsized":"2024-04-17T15:37:14.806306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244149+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:37:14.244149+0000","last_peered":"2024-04-17T15:37:14.244149+0000","last_clean":"2024-04-17T15:37:14.244149+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:37:14.244149+0000","last_undegraded":"2024-04-17T15:37:14.244149+0000","last_fullsized":"2024-04-17T15:37:14.244149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807327+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:37:14.807327+0000","last_peered":"2024-04-17T15:37:14.807327+0000","last_clean":"2024-04-17T15:37:14.807327+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:37:14.807327+0000","last_undegraded":"2024-04-17T15:37:14.807327+0000","last_fullsized":"2024-04-17T15:37:14.807327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239446+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:37:14.239446+0000","last_peered":"2024-04-17T15:37:14.239446+0000","last_clean":"2024-04-17T15:37:14.239446+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:37:14.239446+0000","last_undegraded":"2024-04-17T15:37:14.239446+0000","last_fullsized":"2024-04-17T15:37:14.239446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822248+0000","last_change":"2024-04-17T15:36:54.207503+0000","last_active":"2024-04-17T15:37:15.822248+0000","last_peered":"2024-04-17T15:37:15.822248+0000","last_clean":"2024-04-17T15:37:15.822248+0000","last_became_active":"2024-04-17T15:36:54.206672+0000","last_became_peered":"2024-04-17T15:36:54.206672+0000","last_unstale":"2024-04-17T15:37:15.822248+0000","last_undegraded":"2024-04-17T15:37:15.822248+0000","last_fullsized":"2024-04-17T15:37:15.822248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242464+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:37:14.242464+0000","last_peered":"2024-04-17T15:37:14.242464+0000","last_clean":"2024-04-17T15:37:14.242464+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:37:14.242464+0000","last_undegraded":"2024-04-17T15:37:14.242464+0000","last_fullsized":"2024-04-17T15:37:14.242464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238851+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:37:14.238851+0000","last_peered":"2024-04-17T15:37:14.238851+0000","last_clean":"2024-04-17T15:37:14.238851+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:37:14.238851+0000","last_undegraded":"2024-04-17T15:37:14.238851+0000","last_fullsized":"2024-04-17T15:37:14.238851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242344+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:37:14.242344+0000","last_peered":"2024-04-17T15:37:14.242344+0000","last_clean":"2024-04-17T15:37:14.242344+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:37:14.242344+0000","last_undegraded":"2024-04-17T15:37:14.242344+0000","last_fullsized":"2024-04-17T15:37:14.242344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819977+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:37:15.819977+0000","last_peered":"2024-04-17T15:37:15.819977+0000","last_clean":"2024-04-17T15:37:15.819977+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:37:15.819977+0000","last_undegraded":"2024-04-17T15:37:15.819977+0000","last_fullsized":"2024-04-17T15:37:15.819977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240279+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:37:14.240279+0000","last_peered":"2024-04-17T15:37:14.240279+0000","last_clean":"2024-04-17T15:37:14.240279+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:37:14.240279+0000","last_undegraded":"2024-04-17T15:37:14.240279+0000","last_fullsized":"2024-04-17T15:37:14.240279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808437+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:37:14.808437+0000","last_peered":"2024-04-17T15:37:14.808437+0000","last_clean":"2024-04-17T15:37:14.808437+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:37:14.808437+0000","last_undegraded":"2024-04-17T15:37:14.808437+0000","last_fullsized":"2024-04-17T15:37:14.808437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241440+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:37:14.241440+0000","last_peered":"2024-04-17T15:37:14.241440+0000","last_clean":"2024-04-17T15:37:14.241440+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:37:14.241440+0000","last_undegraded":"2024-04-17T15:37:14.241440+0000","last_fullsized":"2024-04-17T15:37:14.241440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242730+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:37:14.242730+0000","last_peered":"2024-04-17T15:37:14.242730+0000","last_clean":"2024-04-17T15:37:14.242730+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:37:14.242730+0000","last_undegraded":"2024-04-17T15:37:14.242730+0000","last_fullsized":"2024-04-17T15:37:14.242730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808116+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:37:14.808116+0000","last_peered":"2024-04-17T15:37:14.808116+0000","last_clean":"2024-04-17T15:37:14.808116+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:37:14.808116+0000","last_undegraded":"2024-04-17T15:37:14.808116+0000","last_fullsized":"2024-04-17T15:37:14.808116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244393+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:37:14.244393+0000","last_peered":"2024-04-17T15:37:14.244393+0000","last_clean":"2024-04-17T15:37:14.244393+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:37:14.244393+0000","last_undegraded":"2024-04-17T15:37:14.244393+0000","last_fullsized":"2024-04-17T15:37:14.244393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240467+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:37:14.240467+0000","last_peered":"2024-04-17T15:37:14.240467+0000","last_clean":"2024-04-17T15:37:14.240467+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:37:14.240467+0000","last_undegraded":"2024-04-17T15:37:14.240467+0000","last_fullsized":"2024-04-17T15:37:14.240467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807850+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:37:14.807850+0000","last_peered":"2024-04-17T15:37:14.807850+0000","last_clean":"2024-04-17T15:37:14.807850+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:37:14.807850+0000","last_undegraded":"2024-04-17T15:37:14.807850+0000","last_fullsized":"2024-04-17T15:37:14.807850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821158+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:37:15.821158+0000","last_peered":"2024-04-17T15:37:15.821158+0000","last_clean":"2024-04-17T15:37:15.821158+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:37:15.821158+0000","last_undegraded":"2024-04-17T15:37:15.821158+0000","last_fullsized":"2024-04-17T15:37:15.821158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820222+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:37:15.820222+0000","last_peered":"2024-04-17T15:37:15.820222+0000","last_clean":"2024-04-17T15:37:15.820222+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:37:15.820222+0000","last_undegraded":"2024-04-17T15:37:15.820222+0000","last_fullsized":"2024-04-17T15:37:15.820222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238574+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:37:14.238574+0000","last_peered":"2024-04-17T15:37:14.238574+0000","last_clean":"2024-04-17T15:37:14.238574+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:37:14.238574+0000","last_undegraded":"2024-04-17T15:37:14.238574+0000","last_fullsized":"2024-04-17T15:37:14.238574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807925+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:37:14.807925+0000","last_peered":"2024-04-17T15:37:14.807925+0000","last_clean":"2024-04-17T15:37:14.807925+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:37:14.807925+0000","last_undegraded":"2024-04-17T15:37:14.807925+0000","last_fullsized":"2024-04-17T15:37:14.807925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.817314+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:37:15.817314+0000","last_peered":"2024-04-17T15:37:15.817314+0000","last_clean":"2024-04-17T15:37:15.817314+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:37:15.817314+0000","last_undegraded":"2024-04-17T15:37:15.817314+0000","last_fullsized":"2024-04-17T15:37:15.817314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241470+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:37:14.241470+0000","last_peered":"2024-04-17T15:37:14.241470+0000","last_clean":"2024-04-17T15:37:14.241470+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:37:14.241470+0000","last_undegraded":"2024-04-17T15:37:14.241470+0000","last_fullsized":"2024-04-17T15:37:14.241470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242428+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:37:14.242428+0000","last_peered":"2024-04-17T15:37:14.242428+0000","last_clean":"2024-04-17T15:37:14.242428+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:37:14.242428+0000","last_undegraded":"2024-04-17T15:37:14.242428+0000","last_fullsized":"2024-04-17T15:37:14.242428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821474+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:37:15.821474+0000","last_peered":"2024-04-17T15:37:15.821474+0000","last_clean":"2024-04-17T15:37:15.821474+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:37:15.821474+0000","last_undegraded":"2024-04-17T15:37:15.821474+0000","last_fullsized":"2024-04-17T15:37:15.821474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242040+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:37:14.242040+0000","last_peered":"2024-04-17T15:37:14.242040+0000","last_clean":"2024-04-17T15:37:14.242040+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:37:14.242040+0000","last_undegraded":"2024-04-17T15:37:14.242040+0000","last_fullsized":"2024-04-17T15:37:14.242040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238915+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:37:14.238915+0000","last_peered":"2024-04-17T15:37:14.238915+0000","last_clean":"2024-04-17T15:37:14.238915+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:37:14.238915+0000","last_undegraded":"2024-04-17T15:37:14.238915+0000","last_fullsized":"2024-04-17T15:37:14.238915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823336+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:37:15.823336+0000","last_peered":"2024-04-17T15:37:15.823336+0000","last_clean":"2024-04-17T15:37:15.823336+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:37:15.823336+0000","last_undegraded":"2024-04-17T15:37:15.823336+0000","last_fullsized":"2024-04-17T15:37:15.823336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823519+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:37:15.823519+0000","last_peered":"2024-04-17T15:37:15.823519+0000","last_clean":"2024-04-17T15:37:15.823519+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:37:15.823519+0000","last_undegraded":"2024-04-17T15:37:15.823519+0000","last_fullsized":"2024-04-17T15:37:15.823519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240693+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:37:14.240693+0000","last_peered":"2024-04-17T15:37:14.240693+0000","last_clean":"2024-04-17T15:37:14.240693+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:37:14.240693+0000","last_undegraded":"2024-04-17T15:37:14.240693+0000","last_fullsized":"2024-04-17T15:37:14.240693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821044+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:37:15.821044+0000","last_peered":"2024-04-17T15:37:15.821044+0000","last_clean":"2024-04-17T15:37:15.821044+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:37:15.821044+0000","last_undegraded":"2024-04-17T15:37:15.821044+0000","last_fullsized":"2024-04-17T15:37:15.821044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819641+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:37:15.819641+0000","last_peered":"2024-04-17T15:37:15.819641+0000","last_clean":"2024-04-17T15:37:15.819641+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:37:15.819641+0000","last_undegraded":"2024-04-17T15:37:15.819641+0000","last_fullsized":"2024-04-17T15:37:15.819641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238991+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:37:14.238991+0000","last_peered":"2024-04-17T15:37:14.238991+0000","last_clean":"2024-04-17T15:37:14.238991+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:37:14.238991+0000","last_undegraded":"2024-04-17T15:37:14.238991+0000","last_fullsized":"2024-04-17T15:37:14.238991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808282+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:37:14.808282+0000","last_peered":"2024-04-17T15:37:14.808282+0000","last_clean":"2024-04-17T15:37:14.808282+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:37:14.808282+0000","last_undegraded":"2024-04-17T15:37:14.808282+0000","last_fullsized":"2024-04-17T15:37:14.808282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822403+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:37:15.822403+0000","last_peered":"2024-04-17T15:37:15.822403+0000","last_clean":"2024-04-17T15:37:15.822403+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:37:15.822403+0000","last_undegraded":"2024-04-17T15:37:15.822403+0000","last_fullsized":"2024-04-17T15:37:15.822403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823674+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:37:15.823674+0000","last_peered":"2024-04-17T15:37:15.823674+0000","last_clean":"2024-04-17T15:37:15.823674+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:37:15.823674+0000","last_undegraded":"2024-04-17T15:37:15.823674+0000","last_fullsized":"2024-04-17T15:37:15.823674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243597+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:37:14.243597+0000","last_peered":"2024-04-17T15:37:14.243597+0000","last_clean":"2024-04-17T15:37:14.243597+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:37:14.243597+0000","last_undegraded":"2024-04-17T15:37:14.243597+0000","last_fullsized":"2024-04-17T15:37:14.243597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242759+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:37:14.242759+0000","last_peered":"2024-04-17T15:37:14.242759+0000","last_clean":"2024-04-17T15:37:14.242759+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:37:14.242759+0000","last_undegraded":"2024-04-17T15:37:14.242759+0000","last_fullsized":"2024-04-17T15:37:14.242759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822736+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:37:15.822736+0000","last_peered":"2024-04-17T15:37:15.822736+0000","last_clean":"2024-04-17T15:37:15.822736+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:37:15.822736+0000","last_undegraded":"2024-04-17T15:37:15.822736+0000","last_fullsized":"2024-04-17T15:37:15.822736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820779+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:37:15.820779+0000","last_peered":"2024-04-17T15:37:15.820779+0000","last_clean":"2024-04-17T15:37:15.820779+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:37:15.820779+0000","last_undegraded":"2024-04-17T15:37:15.820779+0000","last_fullsized":"2024-04-17T15:37:15.820779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242230+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:37:14.242230+0000","last_peered":"2024-04-17T15:37:14.242230+0000","last_clean":"2024-04-17T15:37:14.242230+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:37:14.242230+0000","last_undegraded":"2024-04-17T15:37:14.242230+0000","last_fullsized":"2024-04-17T15:37:14.242230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819705+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:37:15.819705+0000","last_peered":"2024-04-17T15:37:15.819705+0000","last_clean":"2024-04-17T15:37:15.819705+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:37:15.819705+0000","last_undegraded":"2024-04-17T15:37:15.819705+0000","last_fullsized":"2024-04-17T15:37:15.819705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806069+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:37:14.806069+0000","last_peered":"2024-04-17T15:37:14.806069+0000","last_clean":"2024-04-17T15:37:14.806069+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:37:14.806069+0000","last_undegraded":"2024-04-17T15:37:14.806069+0000","last_fullsized":"2024-04-17T15:37:14.806069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247975+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:37:14.247975+0000","last_peered":"2024-04-17T15:37:14.247975+0000","last_clean":"2024-04-17T15:37:14.247975+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:37:14.247975+0000","last_undegraded":"2024-04-17T15:37:14.247975+0000","last_fullsized":"2024-04-17T15:37:14.247975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823042+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:37:15.823042+0000","last_peered":"2024-04-17T15:37:15.823042+0000","last_clean":"2024-04-17T15:37:15.823042+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:37:15.823042+0000","last_undegraded":"2024-04-17T15:37:15.823042+0000","last_fullsized":"2024-04-17T15:37:15.823042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821338+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:37:15.821338+0000","last_peered":"2024-04-17T15:37:15.821338+0000","last_clean":"2024-04-17T15:37:15.821338+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:37:15.821338+0000","last_undegraded":"2024-04-17T15:37:15.821338+0000","last_fullsized":"2024-04-17T15:37:15.821338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820247+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:37:15.820247+0000","last_peered":"2024-04-17T15:37:15.820247+0000","last_clean":"2024-04-17T15:37:15.820247+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:37:15.820247+0000","last_undegraded":"2024-04-17T15:37:15.820247+0000","last_fullsized":"2024-04-17T15:37:15.820247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806097+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:37:14.806097+0000","last_peered":"2024-04-17T15:37:14.806097+0000","last_clean":"2024-04-17T15:37:14.806097+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:37:14.806097+0000","last_undegraded":"2024-04-17T15:37:14.806097+0000","last_fullsized":"2024-04-17T15:37:14.806097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244858+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:37:14.244858+0000","last_peered":"2024-04-17T15:37:14.244858+0000","last_clean":"2024-04-17T15:37:14.244858+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:37:14.244858+0000","last_undegraded":"2024-04-17T15:37:14.244858+0000","last_fullsized":"2024-04-17T15:37:14.244858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239880+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:37:14.239880+0000","last_peered":"2024-04-17T15:37:14.239880+0000","last_clean":"2024-04-17T15:37:14.239880+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:37:14.239880+0000","last_undegraded":"2024-04-17T15:37:14.239880+0000","last_fullsized":"2024-04-17T15:37:14.239880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239529+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:37:14.239529+0000","last_peered":"2024-04-17T15:37:14.239529+0000","last_clean":"2024-04-17T15:37:14.239529+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:37:14.239529+0000","last_undegraded":"2024-04-17T15:37:14.239529+0000","last_fullsized":"2024-04-17T15:37:14.239529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240178+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:37:14.240178+0000","last_peered":"2024-04-17T15:37:14.240178+0000","last_clean":"2024-04-17T15:37:14.240178+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:37:14.240178+0000","last_undegraded":"2024-04-17T15:37:14.240178+0000","last_fullsized":"2024-04-17T15:37:14.240178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821297+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:37:15.821297+0000","last_peered":"2024-04-17T15:37:15.821297+0000","last_clean":"2024-04-17T15:37:15.821297+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:37:15.821297+0000","last_undegraded":"2024-04-17T15:37:15.821297+0000","last_fullsized":"2024-04-17T15:37:15.821297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239612+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:37:14.239612+0000","last_peered":"2024-04-17T15:37:14.239612+0000","last_clean":"2024-04-17T15:37:14.239612+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:37:14.239612+0000","last_undegraded":"2024-04-17T15:37:14.239612+0000","last_fullsized":"2024-04-17T15:37:14.239612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821601+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:37:15.821601+0000","last_peered":"2024-04-17T15:37:15.821601+0000","last_clean":"2024-04-17T15:37:15.821601+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:37:15.821601+0000","last_undegraded":"2024-04-17T15:37:15.821601+0000","last_fullsized":"2024-04-17T15:37:15.821601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247179+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:37:14.247179+0000","last_peered":"2024-04-17T15:37:14.247179+0000","last_clean":"2024-04-17T15:37:14.247179+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:37:14.247179+0000","last_undegraded":"2024-04-17T15:37:14.247179+0000","last_fullsized":"2024-04-17T15:37:14.247179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821561+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:37:15.821561+0000","last_peered":"2024-04-17T15:37:15.821561+0000","last_clean":"2024-04-17T15:37:15.821561+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:37:15.821561+0000","last_undegraded":"2024-04-17T15:37:15.821561+0000","last_fullsized":"2024-04-17T15:37:15.821561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808393+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:37:14.808393+0000","last_peered":"2024-04-17T15:37:14.808393+0000","last_clean":"2024-04-17T15:37:14.808393+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:37:14.808393+0000","last_undegraded":"2024-04-17T15:37:14.808393+0000","last_fullsized":"2024-04-17T15:37:14.808393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.816874+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:37:15.816874+0000","last_peered":"2024-04-17T15:37:15.816874+0000","last_clean":"2024-04-17T15:37:15.816874+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:37:15.816874+0000","last_undegraded":"2024-04-17T15:37:15.816874+0000","last_fullsized":"2024-04-17T15:37:15.816874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822553+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:37:15.822553+0000","last_peered":"2024-04-17T15:37:15.822553+0000","last_clean":"2024-04-17T15:37:15.822553+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:37:15.822553+0000","last_undegraded":"2024-04-17T15:37:15.822553+0000","last_fullsized":"2024-04-17T15:37:15.822553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807940+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:37:14.807940+0000","last_peered":"2024-04-17T15:37:14.807940+0000","last_clean":"2024-04-17T15:37:14.807940+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:37:14.807940+0000","last_undegraded":"2024-04-17T15:37:14.807940+0000","last_fullsized":"2024-04-17T15:37:14.807940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823709+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:37:15.823709+0000","last_peered":"2024-04-17T15:37:15.823709+0000","last_clean":"2024-04-17T15:37:15.823709+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:37:15.823709+0000","last_undegraded":"2024-04-17T15:37:15.823709+0000","last_fullsized":"2024-04-17T15:37:15.823709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823726+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:37:15.823726+0000","last_peered":"2024-04-17T15:37:15.823726+0000","last_clean":"2024-04-17T15:37:15.823726+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:37:15.823726+0000","last_undegraded":"2024-04-17T15:37:15.823726+0000","last_fullsized":"2024-04-17T15:37:15.823726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241931+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:37:14.241931+0000","last_peered":"2024-04-17T15:37:14.241931+0000","last_clean":"2024-04-17T15:37:14.241931+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:37:14.241931+0000","last_undegraded":"2024-04-17T15:37:14.241931+0000","last_fullsized":"2024-04-17T15:37:14.241931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823397+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:37:15.823397+0000","last_peered":"2024-04-17T15:37:15.823397+0000","last_clean":"2024-04-17T15:37:15.823397+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:37:15.823397+0000","last_undegraded":"2024-04-17T15:37:15.823397+0000","last_fullsized":"2024-04-17T15:37:15.823397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238409+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:37:14.238409+0000","last_peered":"2024-04-17T15:37:14.238409+0000","last_clean":"2024-04-17T15:37:14.238409+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:37:14.238409+0000","last_undegraded":"2024-04-17T15:37:14.238409+0000","last_fullsized":"2024-04-17T15:37:14.238409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820802+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:37:15.820802+0000","last_peered":"2024-04-17T15:37:15.820802+0000","last_clean":"2024-04-17T15:37:15.820802+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:37:15.820802+0000","last_undegraded":"2024-04-17T15:37:15.820802+0000","last_fullsized":"2024-04-17T15:37:15.820802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820945+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:37:15.820945+0000","last_peered":"2024-04-17T15:37:15.820945+0000","last_clean":"2024-04-17T15:37:15.820945+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:37:15.820945+0000","last_undegraded":"2024-04-17T15:37:15.820945+0000","last_fullsized":"2024-04-17T15:37:15.820945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820795+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:37:15.820795+0000","last_peered":"2024-04-17T15:37:15.820795+0000","last_clean":"2024-04-17T15:37:15.820795+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:37:15.820795+0000","last_undegraded":"2024-04-17T15:37:15.820795+0000","last_fullsized":"2024-04-17T15:37:15.820795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808589+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:37:14.808589+0000","last_peered":"2024-04-17T15:37:14.808589+0000","last_clean":"2024-04-17T15:37:14.808589+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:37:14.808589+0000","last_undegraded":"2024-04-17T15:37:14.808589+0000","last_fullsized":"2024-04-17T15:37:14.808589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239310+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:37:14.239310+0000","last_peered":"2024-04-17T15:37:14.239310+0000","last_clean":"2024-04-17T15:37:14.239310+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:37:14.239310+0000","last_undegraded":"2024-04-17T15:37:14.239310+0000","last_fullsized":"2024-04-17T15:37:14.239310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240726+0000","last_change":"2024-04-17T15:36:54.177547+0000","last_active":"2024-04-17T15:37:14.240726+0000","last_peered":"2024-04-17T15:37:14.240726+0000","last_clean":"2024-04-17T15:37:14.240726+0000","last_became_active":"2024-04-17T15:36:54.176327+0000","last_became_peered":"2024-04-17T15:36:54.176327+0000","last_unstale":"2024-04-17T15:37:14.240726+0000","last_undegraded":"2024-04-17T15:37:14.240726+0000","last_fullsized":"2024-04-17T15:37:14.240726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:54:55.766570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823226+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:37:15.823226+0000","last_peered":"2024-04-17T15:37:15.823226+0000","last_clean":"2024-04-17T15:37:15.823226+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:37:15.823226+0000","last_undegraded":"2024-04-17T15:37:15.823226+0000","last_fullsized":"2024-04-17T15:37:15.823226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823202+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:37:15.823202+0000","last_peered":"2024-04-17T15:37:15.823202+0000","last_clean":"2024-04-17T15:37:15.823202+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:37:15.823202+0000","last_undegraded":"2024-04-17T15:37:15.823202+0000","last_fullsized":"2024-04-17T15:37:15.823202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239399+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:37:14.239399+0000","last_peered":"2024-04-17T15:37:14.239399+0000","last_clean":"2024-04-17T15:37:14.239399+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:37:14.239399+0000","last_undegraded":"2024-04-17T15:37:14.239399+0000","last_fullsized":"2024-04-17T15:37:14.239399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244689+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:37:14.244689+0000","last_peered":"2024-04-17T15:37:14.244689+0000","last_clean":"2024-04-17T15:37:14.244689+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:37:14.244689+0000","last_undegraded":"2024-04-17T15:37:14.244689+0000","last_fullsized":"2024-04-17T15:37:14.244689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241846+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:37:14.241846+0000","last_peered":"2024-04-17T15:37:14.241846+0000","last_clean":"2024-04-17T15:37:14.241846+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:37:14.241846+0000","last_undegraded":"2024-04-17T15:37:14.241846+0000","last_fullsized":"2024-04-17T15:37:14.241846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240487+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:37:14.240487+0000","last_peered":"2024-04-17T15:37:14.240487+0000","last_clean":"2024-04-17T15:37:14.240487+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:37:14.240487+0000","last_undegraded":"2024-04-17T15:37:14.240487+0000","last_fullsized":"2024-04-17T15:37:14.240487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808349+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:37:14.808349+0000","last_peered":"2024-04-17T15:37:14.808349+0000","last_clean":"2024-04-17T15:37:14.808349+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:37:14.808349+0000","last_undegraded":"2024-04-17T15:37:14.808349+0000","last_fullsized":"2024-04-17T15:37:14.808349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820041+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:37:15.820041+0000","last_peered":"2024-04-17T15:37:15.820041+0000","last_clean":"2024-04-17T15:37:15.820041+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:37:15.820041+0000","last_undegraded":"2024-04-17T15:37:15.820041+0000","last_fullsized":"2024-04-17T15:37:15.820041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.824220+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:37:15.824220+0000","last_peered":"2024-04-17T15:37:15.824220+0000","last_clean":"2024-04-17T15:37:15.824220+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:37:15.824220+0000","last_undegraded":"2024-04-17T15:37:15.824220+0000","last_fullsized":"2024-04-17T15:37:15.824220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239578+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:37:14.239578+0000","last_peered":"2024-04-17T15:37:14.239578+0000","last_clean":"2024-04-17T15:37:14.239578+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:37:14.239578+0000","last_undegraded":"2024-04-17T15:37:14.239578+0000","last_fullsized":"2024-04-17T15:37:14.239578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239650+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:37:14.239650+0000","last_peered":"2024-04-17T15:37:14.239650+0000","last_clean":"2024-04-17T15:37:14.239650+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:37:14.239650+0000","last_undegraded":"2024-04-17T15:37:14.239650+0000","last_fullsized":"2024-04-17T15:37:14.239650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820271+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:37:15.820271+0000","last_peered":"2024-04-17T15:37:15.820271+0000","last_clean":"2024-04-17T15:37:15.820271+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:37:15.820271+0000","last_undegraded":"2024-04-17T15:37:15.820271+0000","last_fullsized":"2024-04-17T15:37:15.820271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823248+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:37:15.823248+0000","last_peered":"2024-04-17T15:37:15.823248+0000","last_clean":"2024-04-17T15:37:15.823248+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:37:15.823248+0000","last_undegraded":"2024-04-17T15:37:15.823248+0000","last_fullsized":"2024-04-17T15:37:15.823248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808865+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:37:14.808865+0000","last_peered":"2024-04-17T15:37:14.808865+0000","last_clean":"2024-04-17T15:37:14.808865+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:37:14.808865+0000","last_undegraded":"2024-04-17T15:37:14.808865+0000","last_fullsized":"2024-04-17T15:37:14.808865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246124+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:37:14.246124+0000","last_peered":"2024-04-17T15:37:14.246124+0000","last_clean":"2024-04-17T15:37:14.246124+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:37:14.246124+0000","last_undegraded":"2024-04-17T15:37:14.246124+0000","last_fullsized":"2024-04-17T15:37:14.246124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.245063+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:37:14.245063+0000","last_peered":"2024-04-17T15:37:14.245063+0000","last_clean":"2024-04-17T15:37:14.245063+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:37:14.245063+0000","last_undegraded":"2024-04-17T15:37:14.245063+0000","last_fullsized":"2024-04-17T15:37:14.245063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806899+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:37:14.806899+0000","last_peered":"2024-04-17T15:37:14.806899+0000","last_clean":"2024-04-17T15:37:14.806899+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:37:14.806899+0000","last_undegraded":"2024-04-17T15:37:14.806899+0000","last_fullsized":"2024-04-17T15:37:14.806899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247896+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:37:14.247896+0000","last_peered":"2024-04-17T15:37:14.247896+0000","last_clean":"2024-04-17T15:37:14.247896+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:37:14.247896+0000","last_undegraded":"2024-04-17T15:37:14.247896+0000","last_fullsized":"2024-04-17T15:37:14.247896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239330+0000","last_change":"2024-04-17T15:36:56.190009+0000","last_active":"2024-04-17T15:37:14.239330+0000","last_peered":"2024-04-17T15:37:14.239330+0000","last_clean":"2024-04-17T15:37:14.239330+0000","last_became_active":"2024-04-17T15:36:56.189084+0000","last_became_peered":"2024-04-17T15:36:56.189084+0000","last_unstale":"2024-04-17T15:37:14.239330+0000","last_undegraded":"2024-04-17T15:37:14.239330+0000","last_fullsized":"2024-04-17T15:37:14.239330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:04:56.180628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241569+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:37:14.241569+0000","last_peered":"2024-04-17T15:37:14.241569+0000","last_clean":"2024-04-17T15:37:14.241569+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:37:14.241569+0000","last_undegraded":"2024-04-17T15:37:14.241569+0000","last_fullsized":"2024-04-17T15:37:14.241569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243365+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:37:14.243365+0000","last_peered":"2024-04-17T15:37:14.243365+0000","last_clean":"2024-04-17T15:37:14.243365+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:37:14.243365+0000","last_undegraded":"2024-04-17T15:37:14.243365+0000","last_fullsized":"2024-04-17T15:37:14.243365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822181+0000","last_change":"2024-04-17T15:36:54.206097+0000","last_active":"2024-04-17T15:37:15.822181+0000","last_peered":"2024-04-17T15:37:15.822181+0000","last_clean":"2024-04-17T15:37:15.822181+0000","last_became_active":"2024-04-17T15:36:54.205139+0000","last_became_peered":"2024-04-17T15:36:54.205139+0000","last_unstale":"2024-04-17T15:37:15.822181+0000","last_undegraded":"2024-04-17T15:37:15.822181+0000","last_fullsized":"2024-04-17T15:37:15.822181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820021+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:37:15.820021+0000","last_peered":"2024-04-17T15:37:15.820021+0000","last_clean":"2024-04-17T15:37:15.820021+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:37:15.820021+0000","last_undegraded":"2024-04-17T15:37:15.820021+0000","last_fullsized":"2024-04-17T15:37:15.820021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808292+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:37:14.808292+0000","last_peered":"2024-04-17T15:37:14.808292+0000","last_clean":"2024-04-17T15:37:14.808292+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:37:14.808292+0000","last_undegraded":"2024-04-17T15:37:14.808292+0000","last_fullsized":"2024-04-17T15:37:14.808292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.817196+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:37:15.817196+0000","last_peered":"2024-04-17T15:37:15.817196+0000","last_clean":"2024-04-17T15:37:15.817196+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:37:15.817196+0000","last_undegraded":"2024-04-17T15:37:15.817196+0000","last_fullsized":"2024-04-17T15:37:15.817196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822092+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:37:15.822092+0000","last_peered":"2024-04-17T15:37:15.822092+0000","last_clean":"2024-04-17T15:37:15.822092+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:37:15.822092+0000","last_undegraded":"2024-04-17T15:37:15.822092+0000","last_fullsized":"2024-04-17T15:37:15.822092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":745370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":154342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":170890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":169124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":155731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":153904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":162670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":753411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:37:21.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:37:21.345 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:21.346+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:21.427 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.177174813000001, 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.428 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:37:21.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.145204506999999, 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.436 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:21.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:21.441 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.127868491000001, 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.125333849, 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.447 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:21.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:37:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.452 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.024780224000001, 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:37:21.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:37:21.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:37:21.459 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.459 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.460 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.460 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:21.460 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:21.460 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.131715494000002, 2024-04-17T15:37:21.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:37:21.460 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:37:21.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:37:21.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.464 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.108582799000001, 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:37:21.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:37:21.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.068349312999999, 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.469 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:21.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:37:21.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:21.473 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.013815283, 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.993033661, 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.478 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:37:21.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:37:21.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.992622472000001, 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:37:21.486 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.990231068, 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.990133009000001, 2024-04-17T15:37:21.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:37:21.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:37:21.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.987427180999999, 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:37:21.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.500 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.954691641, 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:37:21.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:37:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:37:21.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.945671482, 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:37:21.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.509 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.510 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.510 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:37:21.510 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:21.510 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.941056135, 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:37:21.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:37:21.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:37:21.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.931662902999999, 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:37:21.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.519 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.898320207999999, 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:21.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:37:21.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:37:21.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:37:21.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:37:21.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:37:21.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:37:21.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:37:21.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.838560439, 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:21.527 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:37:21.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:37:21.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:37:21.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:21.531 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:21.533 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:21.534 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:21.535+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:21.634 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:21.631+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:21.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:37:21.702 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:37:21.706 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:21.707 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:21.707 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:21.707 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:21.719 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-04-17T15:37:20.859766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224508,"kb_used_data":4176,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750212,"statfs":{"total":773094113280,"available":772864217088,"internally_reserved":0,"allocated":4276224,"data_stored":2465442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.037649"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247667+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:37:14.247667+0000","last_peered":"2024-04-17T15:37:14.247667+0000","last_clean":"2024-04-17T15:37:14.247667+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:37:14.247667+0000","last_undegraded":"2024-04-17T15:37:14.247667+0000","last_fullsized":"2024-04-17T15:37:14.247667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819686+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:37:15.819686+0000","last_peered":"2024-04-17T15:37:15.819686+0000","last_clean":"2024-04-17T15:37:15.819686+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:37:15.819686+0000","last_undegraded":"2024-04-17T15:37:15.819686+0000","last_fullsized":"2024-04-17T15:37:15.819686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823504+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:37:15.823504+0000","last_peered":"2024-04-17T15:37:15.823504+0000","last_clean":"2024-04-17T15:37:15.823504+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:37:15.823504+0000","last_undegraded":"2024-04-17T15:37:15.823504+0000","last_fullsized":"2024-04-17T15:37:15.823504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244367+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:37:14.244367+0000","last_peered":"2024-04-17T15:37:14.244367+0000","last_clean":"2024-04-17T15:37:14.244367+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:37:14.244367+0000","last_undegraded":"2024-04-17T15:37:14.244367+0000","last_fullsized":"2024-04-17T15:37:14.244367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807509+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:37:14.807509+0000","last_peered":"2024-04-17T15:37:14.807509+0000","last_clean":"2024-04-17T15:37:14.807509+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:37:14.807509+0000","last_undegraded":"2024-04-17T15:37:14.807509+0000","last_fullsized":"2024-04-17T15:37:14.807509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822874+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:37:15.822874+0000","last_peered":"2024-04-17T15:37:15.822874+0000","last_clean":"2024-04-17T15:37:15.822874+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:37:15.822874+0000","last_undegraded":"2024-04-17T15:37:15.822874+0000","last_fullsized":"2024-04-17T15:37:15.822874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820615+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:37:15.820615+0000","last_peered":"2024-04-17T15:37:15.820615+0000","last_clean":"2024-04-17T15:37:15.820615+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:37:15.820615+0000","last_undegraded":"2024-04-17T15:37:15.820615+0000","last_fullsized":"2024-04-17T15:37:15.820615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808434+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:37:14.808434+0000","last_peered":"2024-04-17T15:37:14.808434+0000","last_clean":"2024-04-17T15:37:14.808434+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:37:14.808434+0000","last_undegraded":"2024-04-17T15:37:14.808434+0000","last_fullsized":"2024-04-17T15:37:14.808434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246554+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:37:14.246554+0000","last_peered":"2024-04-17T15:37:14.246554+0000","last_clean":"2024-04-17T15:37:14.246554+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:37:14.246554+0000","last_undegraded":"2024-04-17T15:37:14.246554+0000","last_fullsized":"2024-04-17T15:37:14.246554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244845+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:37:14.244845+0000","last_peered":"2024-04-17T15:37:14.244845+0000","last_clean":"2024-04-17T15:37:14.244845+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:37:14.244845+0000","last_undegraded":"2024-04-17T15:37:14.244845+0000","last_fullsized":"2024-04-17T15:37:14.244845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820013+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:37:15.820013+0000","last_peered":"2024-04-17T15:37:15.820013+0000","last_clean":"2024-04-17T15:37:15.820013+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:37:15.820013+0000","last_undegraded":"2024-04-17T15:37:15.820013+0000","last_fullsized":"2024-04-17T15:37:15.820013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823193+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:37:15.823193+0000","last_peered":"2024-04-17T15:37:15.823193+0000","last_clean":"2024-04-17T15:37:15.823193+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:37:15.823193+0000","last_undegraded":"2024-04-17T15:37:15.823193+0000","last_fullsized":"2024-04-17T15:37:15.823193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244825+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:37:14.244825+0000","last_peered":"2024-04-17T15:37:14.244825+0000","last_clean":"2024-04-17T15:37:14.244825+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:37:14.244825+0000","last_undegraded":"2024-04-17T15:37:14.244825+0000","last_fullsized":"2024-04-17T15:37:14.244825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821951+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:37:15.821951+0000","last_peered":"2024-04-17T15:37:15.821951+0000","last_clean":"2024-04-17T15:37:15.821951+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:37:15.821951+0000","last_undegraded":"2024-04-17T15:37:15.821951+0000","last_fullsized":"2024-04-17T15:37:15.821951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240369+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:37:14.240369+0000","last_peered":"2024-04-17T15:37:14.240369+0000","last_clean":"2024-04-17T15:37:14.240369+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:37:14.240369+0000","last_undegraded":"2024-04-17T15:37:14.240369+0000","last_fullsized":"2024-04-17T15:37:14.240369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239361+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:37:14.239361+0000","last_peered":"2024-04-17T15:37:14.239361+0000","last_clean":"2024-04-17T15:37:14.239361+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:37:14.239361+0000","last_undegraded":"2024-04-17T15:37:14.239361+0000","last_fullsized":"2024-04-17T15:37:14.239361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821567+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:37:15.821567+0000","last_peered":"2024-04-17T15:37:15.821567+0000","last_clean":"2024-04-17T15:37:15.821567+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:37:15.821567+0000","last_undegraded":"2024-04-17T15:37:15.821567+0000","last_fullsized":"2024-04-17T15:37:15.821567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247807+0000","last_change":"2024-04-17T15:36:54.210516+0000","last_active":"2024-04-17T15:37:14.247807+0000","last_peered":"2024-04-17T15:37:14.247807+0000","last_clean":"2024-04-17T15:37:14.247807+0000","last_became_active":"2024-04-17T15:36:54.208488+0000","last_became_peered":"2024-04-17T15:36:54.208488+0000","last_unstale":"2024-04-17T15:37:14.247807+0000","last_undegraded":"2024-04-17T15:37:14.247807+0000","last_fullsized":"2024-04-17T15:37:14.247807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:43.263883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244601+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:37:14.244601+0000","last_peered":"2024-04-17T15:37:14.244601+0000","last_clean":"2024-04-17T15:37:14.244601+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:37:14.244601+0000","last_undegraded":"2024-04-17T15:37:14.244601+0000","last_fullsized":"2024-04-17T15:37:14.244601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244365+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:37:14.244365+0000","last_peered":"2024-04-17T15:37:14.244365+0000","last_clean":"2024-04-17T15:37:14.244365+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:37:14.244365+0000","last_undegraded":"2024-04-17T15:37:14.244365+0000","last_fullsized":"2024-04-17T15:37:14.244365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820178+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:37:15.820178+0000","last_peered":"2024-04-17T15:37:15.820178+0000","last_clean":"2024-04-17T15:37:15.820178+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:37:15.820178+0000","last_undegraded":"2024-04-17T15:37:15.820178+0000","last_fullsized":"2024-04-17T15:37:15.820178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244231+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:37:14.244231+0000","last_peered":"2024-04-17T15:37:14.244231+0000","last_clean":"2024-04-17T15:37:14.244231+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:37:14.244231+0000","last_undegraded":"2024-04-17T15:37:14.244231+0000","last_fullsized":"2024-04-17T15:37:14.244231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239934+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:37:14.239934+0000","last_peered":"2024-04-17T15:37:14.239934+0000","last_clean":"2024-04-17T15:37:14.239934+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:37:14.239934+0000","last_undegraded":"2024-04-17T15:37:14.239934+0000","last_fullsized":"2024-04-17T15:37:14.239934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822902+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:37:15.822902+0000","last_peered":"2024-04-17T15:37:15.822902+0000","last_clean":"2024-04-17T15:37:15.822902+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:37:15.822902+0000","last_undegraded":"2024-04-17T15:37:15.822902+0000","last_fullsized":"2024-04-17T15:37:15.822902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238903+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:37:14.238903+0000","last_peered":"2024-04-17T15:37:14.238903+0000","last_clean":"2024-04-17T15:37:14.238903+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:37:14.238903+0000","last_undegraded":"2024-04-17T15:37:14.238903+0000","last_fullsized":"2024-04-17T15:37:14.238903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238953+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:37:14.238953+0000","last_peered":"2024-04-17T15:37:14.238953+0000","last_clean":"2024-04-17T15:37:14.238953+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:37:14.238953+0000","last_undegraded":"2024-04-17T15:37:14.238953+0000","last_fullsized":"2024-04-17T15:37:14.238953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823333+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:37:15.823333+0000","last_peered":"2024-04-17T15:37:15.823333+0000","last_clean":"2024-04-17T15:37:15.823333+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:37:15.823333+0000","last_undegraded":"2024-04-17T15:37:15.823333+0000","last_fullsized":"2024-04-17T15:37:15.823333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.810210+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:37:14.810210+0000","last_peered":"2024-04-17T15:37:14.810210+0000","last_clean":"2024-04-17T15:37:14.810210+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:37:14.810210+0000","last_undegraded":"2024-04-17T15:37:14.810210+0000","last_fullsized":"2024-04-17T15:37:14.810210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821254+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:37:15.821254+0000","last_peered":"2024-04-17T15:37:15.821254+0000","last_clean":"2024-04-17T15:37:15.821254+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:37:15.821254+0000","last_undegraded":"2024-04-17T15:37:15.821254+0000","last_fullsized":"2024-04-17T15:37:15.821254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240604+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:37:14.240604+0000","last_peered":"2024-04-17T15:37:14.240604+0000","last_clean":"2024-04-17T15:37:14.240604+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:37:14.240604+0000","last_undegraded":"2024-04-17T15:37:14.240604+0000","last_fullsized":"2024-04-17T15:37:14.240604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246741+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:37:14.246741+0000","last_peered":"2024-04-17T15:37:14.246741+0000","last_clean":"2024-04-17T15:37:14.246741+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:37:14.246741+0000","last_undegraded":"2024-04-17T15:37:14.246741+0000","last_fullsized":"2024-04-17T15:37:14.246741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820709+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:37:15.820709+0000","last_peered":"2024-04-17T15:37:15.820709+0000","last_clean":"2024-04-17T15:37:15.820709+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:37:15.820709+0000","last_undegraded":"2024-04-17T15:37:15.820709+0000","last_fullsized":"2024-04-17T15:37:15.820709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807718+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:37:14.807718+0000","last_peered":"2024-04-17T15:37:14.807718+0000","last_clean":"2024-04-17T15:37:14.807718+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:37:14.807718+0000","last_undegraded":"2024-04-17T15:37:14.807718+0000","last_fullsized":"2024-04-17T15:37:14.807718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247383+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:37:14.247383+0000","last_peered":"2024-04-17T15:37:14.247383+0000","last_clean":"2024-04-17T15:37:14.247383+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:37:14.247383+0000","last_undegraded":"2024-04-17T15:37:14.247383+0000","last_fullsized":"2024-04-17T15:37:14.247383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819536+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:37:15.819536+0000","last_peered":"2024-04-17T15:37:15.819536+0000","last_clean":"2024-04-17T15:37:15.819536+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:37:15.819536+0000","last_undegraded":"2024-04-17T15:37:15.819536+0000","last_fullsized":"2024-04-17T15:37:15.819536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821242+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:37:15.821242+0000","last_peered":"2024-04-17T15:37:15.821242+0000","last_clean":"2024-04-17T15:37:15.821242+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:37:15.821242+0000","last_undegraded":"2024-04-17T15:37:15.821242+0000","last_fullsized":"2024-04-17T15:37:15.821242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.810296+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:37:14.810296+0000","last_peered":"2024-04-17T15:37:14.810296+0000","last_clean":"2024-04-17T15:37:14.810296+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:37:14.810296+0000","last_undegraded":"2024-04-17T15:37:14.810296+0000","last_fullsized":"2024-04-17T15:37:14.810296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240526+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:37:14.240526+0000","last_peered":"2024-04-17T15:37:14.240526+0000","last_clean":"2024-04-17T15:37:14.240526+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:37:14.240526+0000","last_undegraded":"2024-04-17T15:37:14.240526+0000","last_fullsized":"2024-04-17T15:37:14.240526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823805+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:37:15.823805+0000","last_peered":"2024-04-17T15:37:15.823805+0000","last_clean":"2024-04-17T15:37:15.823805+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:37:15.823805+0000","last_undegraded":"2024-04-17T15:37:15.823805+0000","last_fullsized":"2024-04-17T15:37:15.823805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823319+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:37:15.823319+0000","last_peered":"2024-04-17T15:37:15.823319+0000","last_clean":"2024-04-17T15:37:15.823319+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:37:15.823319+0000","last_undegraded":"2024-04-17T15:37:15.823319+0000","last_fullsized":"2024-04-17T15:37:15.823319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.810393+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:37:14.810393+0000","last_peered":"2024-04-17T15:37:14.810393+0000","last_clean":"2024-04-17T15:37:14.810393+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:37:14.810393+0000","last_undegraded":"2024-04-17T15:37:14.810393+0000","last_fullsized":"2024-04-17T15:37:14.810393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808040+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:37:14.808040+0000","last_peered":"2024-04-17T15:37:14.808040+0000","last_clean":"2024-04-17T15:37:14.808040+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:37:14.808040+0000","last_undegraded":"2024-04-17T15:37:14.808040+0000","last_fullsized":"2024-04-17T15:37:14.808040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.245033+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:37:14.245033+0000","last_peered":"2024-04-17T15:37:14.245033+0000","last_clean":"2024-04-17T15:37:14.245033+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:37:14.245033+0000","last_undegraded":"2024-04-17T15:37:14.245033+0000","last_fullsized":"2024-04-17T15:37:14.245033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239989+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:37:14.239989+0000","last_peered":"2024-04-17T15:37:14.239989+0000","last_clean":"2024-04-17T15:37:14.239989+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:37:14.239989+0000","last_undegraded":"2024-04-17T15:37:14.239989+0000","last_fullsized":"2024-04-17T15:37:14.239989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238716+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:37:14.238716+0000","last_peered":"2024-04-17T15:37:14.238716+0000","last_clean":"2024-04-17T15:37:14.238716+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:37:14.238716+0000","last_undegraded":"2024-04-17T15:37:14.238716+0000","last_fullsized":"2024-04-17T15:37:14.238716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246755+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:37:14.246755+0000","last_peered":"2024-04-17T15:37:14.246755+0000","last_clean":"2024-04-17T15:37:14.246755+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:37:14.246755+0000","last_undegraded":"2024-04-17T15:37:14.246755+0000","last_fullsized":"2024-04-17T15:37:14.246755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822698+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:37:15.822698+0000","last_peered":"2024-04-17T15:37:15.822698+0000","last_clean":"2024-04-17T15:37:15.822698+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:37:15.822698+0000","last_undegraded":"2024-04-17T15:37:15.822698+0000","last_fullsized":"2024-04-17T15:37:15.822698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240341+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:37:14.240341+0000","last_peered":"2024-04-17T15:37:14.240341+0000","last_clean":"2024-04-17T15:37:14.240341+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:37:14.240341+0000","last_undegraded":"2024-04-17T15:37:14.240341+0000","last_fullsized":"2024-04-17T15:37:14.240341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242109+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:37:14.242109+0000","last_peered":"2024-04-17T15:37:14.242109+0000","last_clean":"2024-04-17T15:37:14.242109+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:37:14.242109+0000","last_undegraded":"2024-04-17T15:37:14.242109+0000","last_fullsized":"2024-04-17T15:37:14.242109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821827+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:37:15.821827+0000","last_peered":"2024-04-17T15:37:15.821827+0000","last_clean":"2024-04-17T15:37:15.821827+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:37:15.821827+0000","last_undegraded":"2024-04-17T15:37:15.821827+0000","last_fullsized":"2024-04-17T15:37:15.821827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247020+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:37:14.247020+0000","last_peered":"2024-04-17T15:37:14.247020+0000","last_clean":"2024-04-17T15:37:14.247020+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:37:14.247020+0000","last_undegraded":"2024-04-17T15:37:14.247020+0000","last_fullsized":"2024-04-17T15:37:14.247020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240364+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:37:14.240364+0000","last_peered":"2024-04-17T15:37:14.240364+0000","last_clean":"2024-04-17T15:37:14.240364+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:37:14.240364+0000","last_undegraded":"2024-04-17T15:37:14.240364+0000","last_fullsized":"2024-04-17T15:37:14.240364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819915+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:37:15.819915+0000","last_peered":"2024-04-17T15:37:15.819915+0000","last_clean":"2024-04-17T15:37:15.819915+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:37:15.819915+0000","last_undegraded":"2024-04-17T15:37:15.819915+0000","last_fullsized":"2024-04-17T15:37:15.819915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247912+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:37:14.247912+0000","last_peered":"2024-04-17T15:37:14.247912+0000","last_clean":"2024-04-17T15:37:14.247912+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:37:14.247912+0000","last_undegraded":"2024-04-17T15:37:14.247912+0000","last_fullsized":"2024-04-17T15:37:14.247912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243786+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:37:14.243786+0000","last_peered":"2024-04-17T15:37:14.243786+0000","last_clean":"2024-04-17T15:37:14.243786+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:37:14.243786+0000","last_undegraded":"2024-04-17T15:37:14.243786+0000","last_fullsized":"2024-04-17T15:37:14.243786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819737+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:37:15.819737+0000","last_peered":"2024-04-17T15:37:15.819737+0000","last_clean":"2024-04-17T15:37:15.819737+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:37:15.819737+0000","last_undegraded":"2024-04-17T15:37:15.819737+0000","last_fullsized":"2024-04-17T15:37:15.819737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820054+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:37:15.820054+0000","last_peered":"2024-04-17T15:37:15.820054+0000","last_clean":"2024-04-17T15:37:15.820054+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:37:15.820054+0000","last_undegraded":"2024-04-17T15:37:15.820054+0000","last_fullsized":"2024-04-17T15:37:15.820054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820080+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:37:15.820080+0000","last_peered":"2024-04-17T15:37:15.820080+0000","last_clean":"2024-04-17T15:37:15.820080+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:37:15.820080+0000","last_undegraded":"2024-04-17T15:37:15.820080+0000","last_fullsized":"2024-04-17T15:37:15.820080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822525+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:37:15.822525+0000","last_peered":"2024-04-17T15:37:15.822525+0000","last_clean":"2024-04-17T15:37:15.822525+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:37:15.822525+0000","last_undegraded":"2024-04-17T15:37:15.822525+0000","last_fullsized":"2024-04-17T15:37:15.822525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247682+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:37:14.247682+0000","last_peered":"2024-04-17T15:37:14.247682+0000","last_clean":"2024-04-17T15:37:14.247682+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:37:14.247682+0000","last_undegraded":"2024-04-17T15:37:14.247682+0000","last_fullsized":"2024-04-17T15:37:14.247682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240464+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:37:14.240464+0000","last_peered":"2024-04-17T15:37:14.240464+0000","last_clean":"2024-04-17T15:37:14.240464+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:37:14.240464+0000","last_undegraded":"2024-04-17T15:37:14.240464+0000","last_fullsized":"2024-04-17T15:37:14.240464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239398+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:37:14.239398+0000","last_peered":"2024-04-17T15:37:14.239398+0000","last_clean":"2024-04-17T15:37:14.239398+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:37:14.239398+0000","last_undegraded":"2024-04-17T15:37:14.239398+0000","last_fullsized":"2024-04-17T15:37:14.239398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238389+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:37:14.238389+0000","last_peered":"2024-04-17T15:37:14.238389+0000","last_clean":"2024-04-17T15:37:14.238389+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:37:14.238389+0000","last_undegraded":"2024-04-17T15:37:14.238389+0000","last_fullsized":"2024-04-17T15:37:14.238389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243445+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:37:14.243445+0000","last_peered":"2024-04-17T15:37:14.243445+0000","last_clean":"2024-04-17T15:37:14.243445+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:37:14.243445+0000","last_undegraded":"2024-04-17T15:37:14.243445+0000","last_fullsized":"2024-04-17T15:37:14.243445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242808+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:37:14.242808+0000","last_peered":"2024-04-17T15:37:14.242808+0000","last_clean":"2024-04-17T15:37:14.242808+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:37:14.242808+0000","last_undegraded":"2024-04-17T15:37:14.242808+0000","last_fullsized":"2024-04-17T15:37:14.242808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247698+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:37:14.247698+0000","last_peered":"2024-04-17T15:37:14.247698+0000","last_clean":"2024-04-17T15:37:14.247698+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:37:14.247698+0000","last_undegraded":"2024-04-17T15:37:14.247698+0000","last_fullsized":"2024-04-17T15:37:14.247698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240179+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:37:14.240179+0000","last_peered":"2024-04-17T15:37:14.240179+0000","last_clean":"2024-04-17T15:37:14.240179+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:37:14.240179+0000","last_undegraded":"2024-04-17T15:37:14.240179+0000","last_fullsized":"2024-04-17T15:37:14.240179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243950+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:37:14.243950+0000","last_peered":"2024-04-17T15:37:14.243950+0000","last_clean":"2024-04-17T15:37:14.243950+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:37:14.243950+0000","last_undegraded":"2024-04-17T15:37:14.243950+0000","last_fullsized":"2024-04-17T15:37:14.243950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806439+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:37:14.806439+0000","last_peered":"2024-04-17T15:37:14.806439+0000","last_clean":"2024-04-17T15:37:14.806439+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:37:14.806439+0000","last_undegraded":"2024-04-17T15:37:14.806439+0000","last_fullsized":"2024-04-17T15:37:14.806439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807764+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:37:14.807764+0000","last_peered":"2024-04-17T15:37:14.807764+0000","last_clean":"2024-04-17T15:37:14.807764+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:37:14.807764+0000","last_undegraded":"2024-04-17T15:37:14.807764+0000","last_fullsized":"2024-04-17T15:37:14.807764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.809555+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:37:14.809555+0000","last_peered":"2024-04-17T15:37:14.809555+0000","last_clean":"2024-04-17T15:37:14.809555+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:37:14.809555+0000","last_undegraded":"2024-04-17T15:37:14.809555+0000","last_fullsized":"2024-04-17T15:37:14.809555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820905+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:37:15.820905+0000","last_peered":"2024-04-17T15:37:15.820905+0000","last_clean":"2024-04-17T15:37:15.820905+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:37:15.820905+0000","last_undegraded":"2024-04-17T15:37:15.820905+0000","last_fullsized":"2024-04-17T15:37:15.820905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240702+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:37:14.240702+0000","last_peered":"2024-04-17T15:37:14.240702+0000","last_clean":"2024-04-17T15:37:14.240702+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:37:14.240702+0000","last_undegraded":"2024-04-17T15:37:14.240702+0000","last_fullsized":"2024-04-17T15:37:14.240702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806710+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:37:14.806710+0000","last_peered":"2024-04-17T15:37:14.806710+0000","last_clean":"2024-04-17T15:37:14.806710+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:37:14.806710+0000","last_undegraded":"2024-04-17T15:37:14.806710+0000","last_fullsized":"2024-04-17T15:37:14.806710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240322+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:37:14.240322+0000","last_peered":"2024-04-17T15:37:14.240322+0000","last_clean":"2024-04-17T15:37:14.240322+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:37:14.240322+0000","last_undegraded":"2024-04-17T15:37:14.240322+0000","last_fullsized":"2024-04-17T15:37:14.240322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823453+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:37:15.823453+0000","last_peered":"2024-04-17T15:37:15.823453+0000","last_clean":"2024-04-17T15:37:15.823453+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:37:15.823453+0000","last_undegraded":"2024-04-17T15:37:15.823453+0000","last_fullsized":"2024-04-17T15:37:15.823453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823247+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:37:15.823247+0000","last_peered":"2024-04-17T15:37:15.823247+0000","last_clean":"2024-04-17T15:37:15.823247+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:37:15.823247+0000","last_undegraded":"2024-04-17T15:37:15.823247+0000","last_fullsized":"2024-04-17T15:37:15.823247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238682+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:37:14.238682+0000","last_peered":"2024-04-17T15:37:14.238682+0000","last_clean":"2024-04-17T15:37:14.238682+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:37:14.238682+0000","last_undegraded":"2024-04-17T15:37:14.238682+0000","last_fullsized":"2024-04-17T15:37:14.238682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239471+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:37:14.239471+0000","last_peered":"2024-04-17T15:37:14.239471+0000","last_clean":"2024-04-17T15:37:14.239471+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:37:14.239471+0000","last_undegraded":"2024-04-17T15:37:14.239471+0000","last_fullsized":"2024-04-17T15:37:14.239471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823566+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:37:15.823566+0000","last_peered":"2024-04-17T15:37:15.823566+0000","last_clean":"2024-04-17T15:37:15.823566+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:37:15.823566+0000","last_undegraded":"2024-04-17T15:37:15.823566+0000","last_fullsized":"2024-04-17T15:37:15.823566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808243+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:37:14.808243+0000","last_peered":"2024-04-17T15:37:14.808243+0000","last_clean":"2024-04-17T15:37:14.808243+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:37:14.808243+0000","last_undegraded":"2024-04-17T15:37:14.808243+0000","last_fullsized":"2024-04-17T15:37:14.808243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239917+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:37:14.239917+0000","last_peered":"2024-04-17T15:37:14.239917+0000","last_clean":"2024-04-17T15:37:14.239917+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:37:14.239917+0000","last_undegraded":"2024-04-17T15:37:14.239917+0000","last_fullsized":"2024-04-17T15:37:14.239917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823473+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:37:15.823473+0000","last_peered":"2024-04-17T15:37:15.823473+0000","last_clean":"2024-04-17T15:37:15.823473+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:37:15.823473+0000","last_undegraded":"2024-04-17T15:37:15.823473+0000","last_fullsized":"2024-04-17T15:37:15.823473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243057+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:37:14.243057+0000","last_peered":"2024-04-17T15:37:14.243057+0000","last_clean":"2024-04-17T15:37:14.243057+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:37:14.243057+0000","last_undegraded":"2024-04-17T15:37:14.243057+0000","last_fullsized":"2024-04-17T15:37:14.243057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820522+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:37:15.820522+0000","last_peered":"2024-04-17T15:37:15.820522+0000","last_clean":"2024-04-17T15:37:15.820522+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:37:15.820522+0000","last_undegraded":"2024-04-17T15:37:15.820522+0000","last_fullsized":"2024-04-17T15:37:15.820522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239215+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:37:14.239215+0000","last_peered":"2024-04-17T15:37:14.239215+0000","last_clean":"2024-04-17T15:37:14.239215+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:37:14.239215+0000","last_undegraded":"2024-04-17T15:37:14.239215+0000","last_fullsized":"2024-04-17T15:37:14.239215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241317+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:37:14.241317+0000","last_peered":"2024-04-17T15:37:14.241317+0000","last_clean":"2024-04-17T15:37:14.241317+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:37:14.241317+0000","last_undegraded":"2024-04-17T15:37:14.241317+0000","last_fullsized":"2024-04-17T15:37:14.241317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.817036+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:37:15.817036+0000","last_peered":"2024-04-17T15:37:15.817036+0000","last_clean":"2024-04-17T15:37:15.817036+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:37:15.817036+0000","last_undegraded":"2024-04-17T15:37:15.817036+0000","last_fullsized":"2024-04-17T15:37:15.817036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.824329+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:37:15.824329+0000","last_peered":"2024-04-17T15:37:15.824329+0000","last_clean":"2024-04-17T15:37:15.824329+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:37:15.824329+0000","last_undegraded":"2024-04-17T15:37:15.824329+0000","last_fullsized":"2024-04-17T15:37:15.824329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823300+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:37:15.823300+0000","last_peered":"2024-04-17T15:37:15.823300+0000","last_clean":"2024-04-17T15:37:15.823300+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:37:15.823300+0000","last_undegraded":"2024-04-17T15:37:15.823300+0000","last_fullsized":"2024-04-17T15:37:15.823300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821589+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:37:15.821589+0000","last_peered":"2024-04-17T15:37:15.821589+0000","last_clean":"2024-04-17T15:37:15.821589+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:37:15.821589+0000","last_undegraded":"2024-04-17T15:37:15.821589+0000","last_fullsized":"2024-04-17T15:37:15.821589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240413+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:37:14.240413+0000","last_peered":"2024-04-17T15:37:14.240413+0000","last_clean":"2024-04-17T15:37:14.240413+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:37:14.240413+0000","last_undegraded":"2024-04-17T15:37:14.240413+0000","last_fullsized":"2024-04-17T15:37:14.240413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243751+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:37:14.243751+0000","last_peered":"2024-04-17T15:37:14.243751+0000","last_clean":"2024-04-17T15:37:14.243751+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:37:14.243751+0000","last_undegraded":"2024-04-17T15:37:14.243751+0000","last_fullsized":"2024-04-17T15:37:14.243751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822774+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:37:15.822774+0000","last_peered":"2024-04-17T15:37:15.822774+0000","last_clean":"2024-04-17T15:37:15.822774+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:37:15.822774+0000","last_undegraded":"2024-04-17T15:37:15.822774+0000","last_fullsized":"2024-04-17T15:37:15.822774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823841+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:37:15.823841+0000","last_peered":"2024-04-17T15:37:15.823841+0000","last_clean":"2024-04-17T15:37:15.823841+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:37:15.823841+0000","last_undegraded":"2024-04-17T15:37:15.823841+0000","last_fullsized":"2024-04-17T15:37:15.823841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240556+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:37:14.240556+0000","last_peered":"2024-04-17T15:37:14.240556+0000","last_clean":"2024-04-17T15:37:14.240556+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:37:14.240556+0000","last_undegraded":"2024-04-17T15:37:14.240556+0000","last_fullsized":"2024-04-17T15:37:14.240556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.824104+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:37:15.824104+0000","last_peered":"2024-04-17T15:37:15.824104+0000","last_clean":"2024-04-17T15:37:15.824104+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:37:15.824104+0000","last_undegraded":"2024-04-17T15:37:15.824104+0000","last_fullsized":"2024-04-17T15:37:15.824104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820595+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:37:15.820595+0000","last_peered":"2024-04-17T15:37:15.820595+0000","last_clean":"2024-04-17T15:37:15.820595+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:37:15.820595+0000","last_undegraded":"2024-04-17T15:37:15.820595+0000","last_fullsized":"2024-04-17T15:37:15.820595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242797+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:37:14.242797+0000","last_peered":"2024-04-17T15:37:14.242797+0000","last_clean":"2024-04-17T15:37:14.242797+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:37:14.242797+0000","last_undegraded":"2024-04-17T15:37:14.242797+0000","last_fullsized":"2024-04-17T15:37:14.242797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819738+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:37:15.819738+0000","last_peered":"2024-04-17T15:37:15.819738+0000","last_clean":"2024-04-17T15:37:15.819738+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:37:15.819738+0000","last_undegraded":"2024-04-17T15:37:15.819738+0000","last_fullsized":"2024-04-17T15:37:15.819738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244074+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:37:14.244074+0000","last_peered":"2024-04-17T15:37:14.244074+0000","last_clean":"2024-04-17T15:37:14.244074+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:37:14.244074+0000","last_undegraded":"2024-04-17T15:37:14.244074+0000","last_fullsized":"2024-04-17T15:37:14.244074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244204+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:37:14.244204+0000","last_peered":"2024-04-17T15:37:14.244204+0000","last_clean":"2024-04-17T15:37:14.244204+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:37:14.244204+0000","last_undegraded":"2024-04-17T15:37:14.244204+0000","last_fullsized":"2024-04-17T15:37:14.244204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820541+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:37:15.820541+0000","last_peered":"2024-04-17T15:37:15.820541+0000","last_clean":"2024-04-17T15:37:15.820541+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:37:15.820541+0000","last_undegraded":"2024-04-17T15:37:15.820541+0000","last_fullsized":"2024-04-17T15:37:15.820541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238723+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:37:14.238723+0000","last_peered":"2024-04-17T15:37:14.238723+0000","last_clean":"2024-04-17T15:37:14.238723+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:37:14.238723+0000","last_undegraded":"2024-04-17T15:37:14.238723+0000","last_fullsized":"2024-04-17T15:37:14.238723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244583+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:37:14.244583+0000","last_peered":"2024-04-17T15:37:14.244583+0000","last_clean":"2024-04-17T15:37:14.244583+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:37:14.244583+0000","last_undegraded":"2024-04-17T15:37:14.244583+0000","last_fullsized":"2024-04-17T15:37:14.244583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821679+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:37:15.821679+0000","last_peered":"2024-04-17T15:37:15.821679+0000","last_clean":"2024-04-17T15:37:15.821679+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:37:15.821679+0000","last_undegraded":"2024-04-17T15:37:15.821679+0000","last_fullsized":"2024-04-17T15:37:15.821679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807808+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:37:14.807808+0000","last_peered":"2024-04-17T15:37:14.807808+0000","last_clean":"2024-04-17T15:37:14.807808+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:37:14.807808+0000","last_undegraded":"2024-04-17T15:37:14.807808+0000","last_fullsized":"2024-04-17T15:37:14.807808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241762+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:37:14.241762+0000","last_peered":"2024-04-17T15:37:14.241762+0000","last_clean":"2024-04-17T15:37:14.241762+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:37:14.241762+0000","last_undegraded":"2024-04-17T15:37:14.241762+0000","last_fullsized":"2024-04-17T15:37:14.241762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807969+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:37:14.807969+0000","last_peered":"2024-04-17T15:37:14.807969+0000","last_clean":"2024-04-17T15:37:14.807969+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:37:14.807969+0000","last_undegraded":"2024-04-17T15:37:14.807969+0000","last_fullsized":"2024-04-17T15:37:14.807969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243723+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:37:14.243723+0000","last_peered":"2024-04-17T15:37:14.243723+0000","last_clean":"2024-04-17T15:37:14.243723+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:37:14.243723+0000","last_undegraded":"2024-04-17T15:37:14.243723+0000","last_fullsized":"2024-04-17T15:37:14.243723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806800+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:37:14.806800+0000","last_peered":"2024-04-17T15:37:14.806800+0000","last_clean":"2024-04-17T15:37:14.806800+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:37:14.806800+0000","last_undegraded":"2024-04-17T15:37:14.806800+0000","last_fullsized":"2024-04-17T15:37:14.806800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822057+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:37:15.822057+0000","last_peered":"2024-04-17T15:37:15.822057+0000","last_clean":"2024-04-17T15:37:15.822057+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:37:15.822057+0000","last_undegraded":"2024-04-17T15:37:15.822057+0000","last_fullsized":"2024-04-17T15:37:15.822057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820450+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:37:15.820450+0000","last_peered":"2024-04-17T15:37:15.820450+0000","last_clean":"2024-04-17T15:37:15.820450+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:37:15.820450+0000","last_undegraded":"2024-04-17T15:37:15.820450+0000","last_fullsized":"2024-04-17T15:37:15.820450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246985+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:37:14.246985+0000","last_peered":"2024-04-17T15:37:14.246985+0000","last_clean":"2024-04-17T15:37:14.246985+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:37:14.246985+0000","last_undegraded":"2024-04-17T15:37:14.246985+0000","last_fullsized":"2024-04-17T15:37:14.246985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.816853+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:37:15.816853+0000","last_peered":"2024-04-17T15:37:15.816853+0000","last_clean":"2024-04-17T15:37:15.816853+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:37:15.816853+0000","last_undegraded":"2024-04-17T15:37:15.816853+0000","last_fullsized":"2024-04-17T15:37:15.816853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823952+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:37:15.823952+0000","last_peered":"2024-04-17T15:37:15.823952+0000","last_clean":"2024-04-17T15:37:15.823952+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:37:15.823952+0000","last_undegraded":"2024-04-17T15:37:15.823952+0000","last_fullsized":"2024-04-17T15:37:15.823952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238549+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:37:14.238549+0000","last_peered":"2024-04-17T15:37:14.238549+0000","last_clean":"2024-04-17T15:37:14.238549+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:37:14.238549+0000","last_undegraded":"2024-04-17T15:37:14.238549+0000","last_fullsized":"2024-04-17T15:37:14.238549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.816828+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:37:15.816828+0000","last_peered":"2024-04-17T15:37:15.816828+0000","last_clean":"2024-04-17T15:37:15.816828+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:37:15.816828+0000","last_undegraded":"2024-04-17T15:37:15.816828+0000","last_fullsized":"2024-04-17T15:37:15.816828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241152+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:37:14.241152+0000","last_peered":"2024-04-17T15:37:14.241152+0000","last_clean":"2024-04-17T15:37:14.241152+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:37:14.241152+0000","last_undegraded":"2024-04-17T15:37:14.241152+0000","last_fullsized":"2024-04-17T15:37:14.241152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247273+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:37:14.247273+0000","last_peered":"2024-04-17T15:37:14.247273+0000","last_clean":"2024-04-17T15:37:14.247273+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:37:14.247273+0000","last_undegraded":"2024-04-17T15:37:14.247273+0000","last_fullsized":"2024-04-17T15:37:14.247273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807100+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:37:14.807100+0000","last_peered":"2024-04-17T15:37:14.807100+0000","last_clean":"2024-04-17T15:37:14.807100+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:37:14.807100+0000","last_undegraded":"2024-04-17T15:37:14.807100+0000","last_fullsized":"2024-04-17T15:37:14.807100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239158+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:37:14.239158+0000","last_peered":"2024-04-17T15:37:14.239158+0000","last_clean":"2024-04-17T15:37:14.239158+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:37:14.239158+0000","last_undegraded":"2024-04-17T15:37:14.239158+0000","last_fullsized":"2024-04-17T15:37:14.239158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820704+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:37:15.820704+0000","last_peered":"2024-04-17T15:37:15.820704+0000","last_clean":"2024-04-17T15:37:15.820704+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:37:15.820704+0000","last_undegraded":"2024-04-17T15:37:15.820704+0000","last_fullsized":"2024-04-17T15:37:15.820704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820385+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:37:15.820385+0000","last_peered":"2024-04-17T15:37:15.820385+0000","last_clean":"2024-04-17T15:37:15.820385+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:37:15.820385+0000","last_undegraded":"2024-04-17T15:37:15.820385+0000","last_fullsized":"2024-04-17T15:37:15.820385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823704+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:37:15.823704+0000","last_peered":"2024-04-17T15:37:15.823704+0000","last_clean":"2024-04-17T15:37:15.823704+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:37:15.823704+0000","last_undegraded":"2024-04-17T15:37:15.823704+0000","last_fullsized":"2024-04-17T15:37:15.823704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807417+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:37:14.807417+0000","last_peered":"2024-04-17T15:37:14.807417+0000","last_clean":"2024-04-17T15:37:14.807417+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:37:14.807417+0000","last_undegraded":"2024-04-17T15:37:14.807417+0000","last_fullsized":"2024-04-17T15:37:14.807417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240012+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:37:14.240012+0000","last_peered":"2024-04-17T15:37:14.240012+0000","last_clean":"2024-04-17T15:37:14.240012+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:37:14.240012+0000","last_undegraded":"2024-04-17T15:37:14.240012+0000","last_fullsized":"2024-04-17T15:37:14.240012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244034+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:37:14.244034+0000","last_peered":"2024-04-17T15:37:14.244034+0000","last_clean":"2024-04-17T15:37:14.244034+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:37:14.244034+0000","last_undegraded":"2024-04-17T15:37:14.244034+0000","last_fullsized":"2024-04-17T15:37:14.244034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819400+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:37:15.819400+0000","last_peered":"2024-04-17T15:37:15.819400+0000","last_clean":"2024-04-17T15:37:15.819400+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:37:15.819400+0000","last_undegraded":"2024-04-17T15:37:15.819400+0000","last_fullsized":"2024-04-17T15:37:15.819400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819674+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:37:15.819674+0000","last_peered":"2024-04-17T15:37:15.819674+0000","last_clean":"2024-04-17T15:37:15.819674+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:37:15.819674+0000","last_undegraded":"2024-04-17T15:37:15.819674+0000","last_fullsized":"2024-04-17T15:37:15.819674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821417+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:37:15.821417+0000","last_peered":"2024-04-17T15:37:15.821417+0000","last_clean":"2024-04-17T15:37:15.821417+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:37:15.821417+0000","last_undegraded":"2024-04-17T15:37:15.821417+0000","last_fullsized":"2024-04-17T15:37:15.821417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820860+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:37:15.820860+0000","last_peered":"2024-04-17T15:37:15.820860+0000","last_clean":"2024-04-17T15:37:15.820860+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:37:15.820860+0000","last_undegraded":"2024-04-17T15:37:15.820860+0000","last_fullsized":"2024-04-17T15:37:15.820860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808726+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:37:14.808726+0000","last_peered":"2024-04-17T15:37:14.808726+0000","last_clean":"2024-04-17T15:37:14.808726+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:37:14.808726+0000","last_undegraded":"2024-04-17T15:37:14.808726+0000","last_fullsized":"2024-04-17T15:37:14.808726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806451+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:37:14.806451+0000","last_peered":"2024-04-17T15:37:14.806451+0000","last_clean":"2024-04-17T15:37:14.806451+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:37:14.806451+0000","last_undegraded":"2024-04-17T15:37:14.806451+0000","last_fullsized":"2024-04-17T15:37:14.806451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821911+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:37:15.821911+0000","last_peered":"2024-04-17T15:37:15.821911+0000","last_clean":"2024-04-17T15:37:15.821911+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:37:15.821911+0000","last_undegraded":"2024-04-17T15:37:15.821911+0000","last_fullsized":"2024-04-17T15:37:15.821911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807635+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:37:14.807635+0000","last_peered":"2024-04-17T15:37:14.807635+0000","last_clean":"2024-04-17T15:37:14.807635+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:37:14.807635+0000","last_undegraded":"2024-04-17T15:37:14.807635+0000","last_fullsized":"2024-04-17T15:37:14.807635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.809389+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:37:14.809389+0000","last_peered":"2024-04-17T15:37:14.809389+0000","last_clean":"2024-04-17T15:37:14.809389+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:37:14.809389+0000","last_undegraded":"2024-04-17T15:37:14.809389+0000","last_fullsized":"2024-04-17T15:37:14.809389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820721+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:37:15.820721+0000","last_peered":"2024-04-17T15:37:15.820721+0000","last_clean":"2024-04-17T15:37:15.820721+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:37:15.820721+0000","last_undegraded":"2024-04-17T15:37:15.820721+0000","last_fullsized":"2024-04-17T15:37:15.820721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247951+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:37:14.247951+0000","last_peered":"2024-04-17T15:37:14.247951+0000","last_clean":"2024-04-17T15:37:14.247951+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:37:14.247951+0000","last_undegraded":"2024-04-17T15:37:14.247951+0000","last_fullsized":"2024-04-17T15:37:14.247951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242521+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:37:14.242521+0000","last_peered":"2024-04-17T15:37:14.242521+0000","last_clean":"2024-04-17T15:37:14.242521+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:37:14.242521+0000","last_undegraded":"2024-04-17T15:37:14.242521+0000","last_fullsized":"2024-04-17T15:37:14.242521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.816722+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:37:15.816722+0000","last_peered":"2024-04-17T15:37:15.816722+0000","last_clean":"2024-04-17T15:37:15.816722+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:37:15.816722+0000","last_undegraded":"2024-04-17T15:37:15.816722+0000","last_fullsized":"2024-04-17T15:37:15.816722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819721+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:37:15.819721+0000","last_peered":"2024-04-17T15:37:15.819721+0000","last_clean":"2024-04-17T15:37:15.819721+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:37:15.819721+0000","last_undegraded":"2024-04-17T15:37:15.819721+0000","last_fullsized":"2024-04-17T15:37:15.819721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240588+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:37:14.240588+0000","last_peered":"2024-04-17T15:37:14.240588+0000","last_clean":"2024-04-17T15:37:14.240588+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:37:14.240588+0000","last_undegraded":"2024-04-17T15:37:14.240588+0000","last_fullsized":"2024-04-17T15:37:14.240588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240168+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:37:14.240168+0000","last_peered":"2024-04-17T15:37:14.240168+0000","last_clean":"2024-04-17T15:37:14.240168+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:37:14.240168+0000","last_undegraded":"2024-04-17T15:37:14.240168+0000","last_fullsized":"2024-04-17T15:37:14.240168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240164+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:37:14.240164+0000","last_peered":"2024-04-17T15:37:14.240164+0000","last_clean":"2024-04-17T15:37:14.240164+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:37:14.240164+0000","last_undegraded":"2024-04-17T15:37:14.240164+0000","last_fullsized":"2024-04-17T15:37:14.240164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823536+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:37:15.823536+0000","last_peered":"2024-04-17T15:37:15.823536+0000","last_clean":"2024-04-17T15:37:15.823536+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:37:15.823536+0000","last_undegraded":"2024-04-17T15:37:15.823536+0000","last_fullsized":"2024-04-17T15:37:15.823536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822421+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:37:15.822421+0000","last_peered":"2024-04-17T15:37:15.822421+0000","last_clean":"2024-04-17T15:37:15.822421+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:37:15.822421+0000","last_undegraded":"2024-04-17T15:37:15.822421+0000","last_fullsized":"2024-04-17T15:37:15.822421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822974+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:37:15.822974+0000","last_peered":"2024-04-17T15:37:15.822974+0000","last_clean":"2024-04-17T15:37:15.822974+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:37:15.822974+0000","last_undegraded":"2024-04-17T15:37:15.822974+0000","last_fullsized":"2024-04-17T15:37:15.822974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239713+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:37:14.239713+0000","last_peered":"2024-04-17T15:37:14.239713+0000","last_clean":"2024-04-17T15:37:14.239713+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:37:14.239713+0000","last_undegraded":"2024-04-17T15:37:14.239713+0000","last_fullsized":"2024-04-17T15:37:14.239713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807187+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:37:14.807187+0000","last_peered":"2024-04-17T15:37:14.807187+0000","last_clean":"2024-04-17T15:37:14.807187+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:37:14.807187+0000","last_undegraded":"2024-04-17T15:37:14.807187+0000","last_fullsized":"2024-04-17T15:37:14.807187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822507+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:37:15.822507+0000","last_peered":"2024-04-17T15:37:15.822507+0000","last_clean":"2024-04-17T15:37:15.822507+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:37:15.822507+0000","last_undegraded":"2024-04-17T15:37:15.822507+0000","last_fullsized":"2024-04-17T15:37:15.822507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808084+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:37:14.808084+0000","last_peered":"2024-04-17T15:37:14.808084+0000","last_clean":"2024-04-17T15:37:14.808084+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:37:14.808084+0000","last_undegraded":"2024-04-17T15:37:14.808084+0000","last_fullsized":"2024-04-17T15:37:14.808084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244693+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:37:14.244693+0000","last_peered":"2024-04-17T15:37:14.244693+0000","last_clean":"2024-04-17T15:37:14.244693+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:37:14.244693+0000","last_undegraded":"2024-04-17T15:37:14.244693+0000","last_fullsized":"2024-04-17T15:37:14.244693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239690+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:37:14.239690+0000","last_peered":"2024-04-17T15:37:14.239690+0000","last_clean":"2024-04-17T15:37:14.239690+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:37:14.239690+0000","last_undegraded":"2024-04-17T15:37:14.239690+0000","last_fullsized":"2024-04-17T15:37:14.239690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.245544+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:37:14.245544+0000","last_peered":"2024-04-17T15:37:14.245544+0000","last_clean":"2024-04-17T15:37:14.245544+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:37:14.245544+0000","last_undegraded":"2024-04-17T15:37:14.245544+0000","last_fullsized":"2024-04-17T15:37:14.245544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238480+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:37:14.238480+0000","last_peered":"2024-04-17T15:37:14.238480+0000","last_clean":"2024-04-17T15:37:14.238480+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:37:14.238480+0000","last_undegraded":"2024-04-17T15:37:14.238480+0000","last_fullsized":"2024-04-17T15:37:14.238480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820375+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:37:15.820375+0000","last_peered":"2024-04-17T15:37:15.820375+0000","last_clean":"2024-04-17T15:37:15.820375+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:37:15.820375+0000","last_undegraded":"2024-04-17T15:37:15.820375+0000","last_fullsized":"2024-04-17T15:37:15.820375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808170+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:37:14.808170+0000","last_peered":"2024-04-17T15:37:14.808170+0000","last_clean":"2024-04-17T15:37:14.808170+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:37:14.808170+0000","last_undegraded":"2024-04-17T15:37:14.808170+0000","last_fullsized":"2024-04-17T15:37:14.808170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823417+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:37:15.823417+0000","last_peered":"2024-04-17T15:37:15.823417+0000","last_clean":"2024-04-17T15:37:15.823417+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:37:15.823417+0000","last_undegraded":"2024-04-17T15:37:15.823417+0000","last_fullsized":"2024-04-17T15:37:15.823417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822852+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:37:15.822852+0000","last_peered":"2024-04-17T15:37:15.822852+0000","last_clean":"2024-04-17T15:37:15.822852+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:37:15.822852+0000","last_undegraded":"2024-04-17T15:37:15.822852+0000","last_fullsized":"2024-04-17T15:37:15.822852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819755+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:37:15.819755+0000","last_peered":"2024-04-17T15:37:15.819755+0000","last_clean":"2024-04-17T15:37:15.819755+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:37:15.819755+0000","last_undegraded":"2024-04-17T15:37:15.819755+0000","last_fullsized":"2024-04-17T15:37:15.819755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239175+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:37:14.239175+0000","last_peered":"2024-04-17T15:37:14.239175+0000","last_clean":"2024-04-17T15:37:14.239175+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:37:14.239175+0000","last_undegraded":"2024-04-17T15:37:14.239175+0000","last_fullsized":"2024-04-17T15:37:14.239175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240008+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:37:14.240008+0000","last_peered":"2024-04-17T15:37:14.240008+0000","last_clean":"2024-04-17T15:37:14.240008+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:37:14.240008+0000","last_undegraded":"2024-04-17T15:37:14.240008+0000","last_fullsized":"2024-04-17T15:37:14.240008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239791+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:37:14.239791+0000","last_peered":"2024-04-17T15:37:14.239791+0000","last_clean":"2024-04-17T15:37:14.239791+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:37:14.239791+0000","last_undegraded":"2024-04-17T15:37:14.239791+0000","last_fullsized":"2024-04-17T15:37:14.239791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819573+0000","last_change":"2024-04-17T15:36:56.210604+0000","last_active":"2024-04-17T15:37:15.819573+0000","last_peered":"2024-04-17T15:37:15.819573+0000","last_clean":"2024-04-17T15:37:15.819573+0000","last_became_active":"2024-04-17T15:36:56.210290+0000","last_became_peered":"2024-04-17T15:36:56.210290+0000","last_unstale":"2024-04-17T15:37:15.819573+0000","last_undegraded":"2024-04-17T15:37:15.819573+0000","last_fullsized":"2024-04-17T15:37:15.819573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247620+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:37:14.247620+0000","last_peered":"2024-04-17T15:37:14.247620+0000","last_clean":"2024-04-17T15:37:14.247620+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:37:14.247620+0000","last_undegraded":"2024-04-17T15:37:14.247620+0000","last_fullsized":"2024-04-17T15:37:14.247620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239059+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:37:14.239059+0000","last_peered":"2024-04-17T15:37:14.239059+0000","last_clean":"2024-04-17T15:37:14.239059+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:37:14.239059+0000","last_undegraded":"2024-04-17T15:37:14.239059+0000","last_fullsized":"2024-04-17T15:37:14.239059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806306+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:37:14.806306+0000","last_peered":"2024-04-17T15:37:14.806306+0000","last_clean":"2024-04-17T15:37:14.806306+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:37:14.806306+0000","last_undegraded":"2024-04-17T15:37:14.806306+0000","last_fullsized":"2024-04-17T15:37:14.806306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244149+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:37:14.244149+0000","last_peered":"2024-04-17T15:37:14.244149+0000","last_clean":"2024-04-17T15:37:14.244149+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:37:14.244149+0000","last_undegraded":"2024-04-17T15:37:14.244149+0000","last_fullsized":"2024-04-17T15:37:14.244149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807327+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:37:14.807327+0000","last_peered":"2024-04-17T15:37:14.807327+0000","last_clean":"2024-04-17T15:37:14.807327+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:37:14.807327+0000","last_undegraded":"2024-04-17T15:37:14.807327+0000","last_fullsized":"2024-04-17T15:37:14.807327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239446+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:37:14.239446+0000","last_peered":"2024-04-17T15:37:14.239446+0000","last_clean":"2024-04-17T15:37:14.239446+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:37:14.239446+0000","last_undegraded":"2024-04-17T15:37:14.239446+0000","last_fullsized":"2024-04-17T15:37:14.239446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822248+0000","last_change":"2024-04-17T15:36:54.207503+0000","last_active":"2024-04-17T15:37:15.822248+0000","last_peered":"2024-04-17T15:37:15.822248+0000","last_clean":"2024-04-17T15:37:15.822248+0000","last_became_active":"2024-04-17T15:36:54.206672+0000","last_became_peered":"2024-04-17T15:36:54.206672+0000","last_unstale":"2024-04-17T15:37:15.822248+0000","last_undegraded":"2024-04-17T15:37:15.822248+0000","last_fullsized":"2024-04-17T15:37:15.822248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242464+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:37:14.242464+0000","last_peered":"2024-04-17T15:37:14.242464+0000","last_clean":"2024-04-17T15:37:14.242464+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:37:14.242464+0000","last_undegraded":"2024-04-17T15:37:14.242464+0000","last_fullsized":"2024-04-17T15:37:14.242464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238851+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:37:14.238851+0000","last_peered":"2024-04-17T15:37:14.238851+0000","last_clean":"2024-04-17T15:37:14.238851+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:37:14.238851+0000","last_undegraded":"2024-04-17T15:37:14.238851+0000","last_fullsized":"2024-04-17T15:37:14.238851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242344+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:37:14.242344+0000","last_peered":"2024-04-17T15:37:14.242344+0000","last_clean":"2024-04-17T15:37:14.242344+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:37:14.242344+0000","last_undegraded":"2024-04-17T15:37:14.242344+0000","last_fullsized":"2024-04-17T15:37:14.242344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819977+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:37:15.819977+0000","last_peered":"2024-04-17T15:37:15.819977+0000","last_clean":"2024-04-17T15:37:15.819977+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:37:15.819977+0000","last_undegraded":"2024-04-17T15:37:15.819977+0000","last_fullsized":"2024-04-17T15:37:15.819977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240279+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:37:14.240279+0000","last_peered":"2024-04-17T15:37:14.240279+0000","last_clean":"2024-04-17T15:37:14.240279+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:37:14.240279+0000","last_undegraded":"2024-04-17T15:37:14.240279+0000","last_fullsized":"2024-04-17T15:37:14.240279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808437+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:37:14.808437+0000","last_peered":"2024-04-17T15:37:14.808437+0000","last_clean":"2024-04-17T15:37:14.808437+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:37:14.808437+0000","last_undegraded":"2024-04-17T15:37:14.808437+0000","last_fullsized":"2024-04-17T15:37:14.808437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241440+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:37:14.241440+0000","last_peered":"2024-04-17T15:37:14.241440+0000","last_clean":"2024-04-17T15:37:14.241440+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:37:14.241440+0000","last_undegraded":"2024-04-17T15:37:14.241440+0000","last_fullsized":"2024-04-17T15:37:14.241440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242730+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:37:14.242730+0000","last_peered":"2024-04-17T15:37:14.242730+0000","last_clean":"2024-04-17T15:37:14.242730+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:37:14.242730+0000","last_undegraded":"2024-04-17T15:37:14.242730+0000","last_fullsized":"2024-04-17T15:37:14.242730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808116+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:37:14.808116+0000","last_peered":"2024-04-17T15:37:14.808116+0000","last_clean":"2024-04-17T15:37:14.808116+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:37:14.808116+0000","last_undegraded":"2024-04-17T15:37:14.808116+0000","last_fullsized":"2024-04-17T15:37:14.808116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244393+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:37:14.244393+0000","last_peered":"2024-04-17T15:37:14.244393+0000","last_clean":"2024-04-17T15:37:14.244393+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:37:14.244393+0000","last_undegraded":"2024-04-17T15:37:14.244393+0000","last_fullsized":"2024-04-17T15:37:14.244393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240467+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:37:14.240467+0000","last_peered":"2024-04-17T15:37:14.240467+0000","last_clean":"2024-04-17T15:37:14.240467+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:37:14.240467+0000","last_undegraded":"2024-04-17T15:37:14.240467+0000","last_fullsized":"2024-04-17T15:37:14.240467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807850+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:37:14.807850+0000","last_peered":"2024-04-17T15:37:14.807850+0000","last_clean":"2024-04-17T15:37:14.807850+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:37:14.807850+0000","last_undegraded":"2024-04-17T15:37:14.807850+0000","last_fullsized":"2024-04-17T15:37:14.807850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821158+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:37:15.821158+0000","last_peered":"2024-04-17T15:37:15.821158+0000","last_clean":"2024-04-17T15:37:15.821158+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:37:15.821158+0000","last_undegraded":"2024-04-17T15:37:15.821158+0000","last_fullsized":"2024-04-17T15:37:15.821158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820222+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:37:15.820222+0000","last_peered":"2024-04-17T15:37:15.820222+0000","last_clean":"2024-04-17T15:37:15.820222+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:37:15.820222+0000","last_undegraded":"2024-04-17T15:37:15.820222+0000","last_fullsized":"2024-04-17T15:37:15.820222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238574+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:37:14.238574+0000","last_peered":"2024-04-17T15:37:14.238574+0000","last_clean":"2024-04-17T15:37:14.238574+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:37:14.238574+0000","last_undegraded":"2024-04-17T15:37:14.238574+0000","last_fullsized":"2024-04-17T15:37:14.238574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807925+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:37:14.807925+0000","last_peered":"2024-04-17T15:37:14.807925+0000","last_clean":"2024-04-17T15:37:14.807925+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:37:14.807925+0000","last_undegraded":"2024-04-17T15:37:14.807925+0000","last_fullsized":"2024-04-17T15:37:14.807925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.817314+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:37:15.817314+0000","last_peered":"2024-04-17T15:37:15.817314+0000","last_clean":"2024-04-17T15:37:15.817314+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:37:15.817314+0000","last_undegraded":"2024-04-17T15:37:15.817314+0000","last_fullsized":"2024-04-17T15:37:15.817314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241470+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:37:14.241470+0000","last_peered":"2024-04-17T15:37:14.241470+0000","last_clean":"2024-04-17T15:37:14.241470+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:37:14.241470+0000","last_undegraded":"2024-04-17T15:37:14.241470+0000","last_fullsized":"2024-04-17T15:37:14.241470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242428+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:37:14.242428+0000","last_peered":"2024-04-17T15:37:14.242428+0000","last_clean":"2024-04-17T15:37:14.242428+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:37:14.242428+0000","last_undegraded":"2024-04-17T15:37:14.242428+0000","last_fullsized":"2024-04-17T15:37:14.242428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821474+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:37:15.821474+0000","last_peered":"2024-04-17T15:37:15.821474+0000","last_clean":"2024-04-17T15:37:15.821474+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:37:15.821474+0000","last_undegraded":"2024-04-17T15:37:15.821474+0000","last_fullsized":"2024-04-17T15:37:15.821474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242040+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:37:14.242040+0000","last_peered":"2024-04-17T15:37:14.242040+0000","last_clean":"2024-04-17T15:37:14.242040+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:37:14.242040+0000","last_undegraded":"2024-04-17T15:37:14.242040+0000","last_fullsized":"2024-04-17T15:37:14.242040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238915+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:37:14.238915+0000","last_peered":"2024-04-17T15:37:14.238915+0000","last_clean":"2024-04-17T15:37:14.238915+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:37:14.238915+0000","last_undegraded":"2024-04-17T15:37:14.238915+0000","last_fullsized":"2024-04-17T15:37:14.238915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823336+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:37:15.823336+0000","last_peered":"2024-04-17T15:37:15.823336+0000","last_clean":"2024-04-17T15:37:15.823336+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:37:15.823336+0000","last_undegraded":"2024-04-17T15:37:15.823336+0000","last_fullsized":"2024-04-17T15:37:15.823336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823519+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:37:15.823519+0000","last_peered":"2024-04-17T15:37:15.823519+0000","last_clean":"2024-04-17T15:37:15.823519+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:37:15.823519+0000","last_undegraded":"2024-04-17T15:37:15.823519+0000","last_fullsized":"2024-04-17T15:37:15.823519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240693+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:37:14.240693+0000","last_peered":"2024-04-17T15:37:14.240693+0000","last_clean":"2024-04-17T15:37:14.240693+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:37:14.240693+0000","last_undegraded":"2024-04-17T15:37:14.240693+0000","last_fullsized":"2024-04-17T15:37:14.240693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821044+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:37:15.821044+0000","last_peered":"2024-04-17T15:37:15.821044+0000","last_clean":"2024-04-17T15:37:15.821044+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:37:15.821044+0000","last_undegraded":"2024-04-17T15:37:15.821044+0000","last_fullsized":"2024-04-17T15:37:15.821044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819641+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:37:15.819641+0000","last_peered":"2024-04-17T15:37:15.819641+0000","last_clean":"2024-04-17T15:37:15.819641+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:37:15.819641+0000","last_undegraded":"2024-04-17T15:37:15.819641+0000","last_fullsized":"2024-04-17T15:37:15.819641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238991+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:37:14.238991+0000","last_peered":"2024-04-17T15:37:14.238991+0000","last_clean":"2024-04-17T15:37:14.238991+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:37:14.238991+0000","last_undegraded":"2024-04-17T15:37:14.238991+0000","last_fullsized":"2024-04-17T15:37:14.238991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808282+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:37:14.808282+0000","last_peered":"2024-04-17T15:37:14.808282+0000","last_clean":"2024-04-17T15:37:14.808282+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:37:14.808282+0000","last_undegraded":"2024-04-17T15:37:14.808282+0000","last_fullsized":"2024-04-17T15:37:14.808282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822403+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:37:15.822403+0000","last_peered":"2024-04-17T15:37:15.822403+0000","last_clean":"2024-04-17T15:37:15.822403+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:37:15.822403+0000","last_undegraded":"2024-04-17T15:37:15.822403+0000","last_fullsized":"2024-04-17T15:37:15.822403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823674+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:37:15.823674+0000","last_peered":"2024-04-17T15:37:15.823674+0000","last_clean":"2024-04-17T15:37:15.823674+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:37:15.823674+0000","last_undegraded":"2024-04-17T15:37:15.823674+0000","last_fullsized":"2024-04-17T15:37:15.823674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"27'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243597+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:37:14.243597+0000","last_peered":"2024-04-17T15:37:14.243597+0000","last_clean":"2024-04-17T15:37:14.243597+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:37:14.243597+0000","last_undegraded":"2024-04-17T15:37:14.243597+0000","last_fullsized":"2024-04-17T15:37:14.243597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242759+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:37:14.242759+0000","last_peered":"2024-04-17T15:37:14.242759+0000","last_clean":"2024-04-17T15:37:14.242759+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:37:14.242759+0000","last_undegraded":"2024-04-17T15:37:14.242759+0000","last_fullsized":"2024-04-17T15:37:14.242759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822736+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:37:15.822736+0000","last_peered":"2024-04-17T15:37:15.822736+0000","last_clean":"2024-04-17T15:37:15.822736+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:37:15.822736+0000","last_undegraded":"2024-04-17T15:37:15.822736+0000","last_fullsized":"2024-04-17T15:37:15.822736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820779+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:37:15.820779+0000","last_peered":"2024-04-17T15:37:15.820779+0000","last_clean":"2024-04-17T15:37:15.820779+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:37:15.820779+0000","last_undegraded":"2024-04-17T15:37:15.820779+0000","last_fullsized":"2024-04-17T15:37:15.820779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.242230+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:37:14.242230+0000","last_peered":"2024-04-17T15:37:14.242230+0000","last_clean":"2024-04-17T15:37:14.242230+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:37:14.242230+0000","last_undegraded":"2024-04-17T15:37:14.242230+0000","last_fullsized":"2024-04-17T15:37:14.242230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.819705+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:37:15.819705+0000","last_peered":"2024-04-17T15:37:15.819705+0000","last_clean":"2024-04-17T15:37:15.819705+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:37:15.819705+0000","last_undegraded":"2024-04-17T15:37:15.819705+0000","last_fullsized":"2024-04-17T15:37:15.819705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806069+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:37:14.806069+0000","last_peered":"2024-04-17T15:37:14.806069+0000","last_clean":"2024-04-17T15:37:14.806069+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:37:14.806069+0000","last_undegraded":"2024-04-17T15:37:14.806069+0000","last_fullsized":"2024-04-17T15:37:14.806069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247975+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:37:14.247975+0000","last_peered":"2024-04-17T15:37:14.247975+0000","last_clean":"2024-04-17T15:37:14.247975+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:37:14.247975+0000","last_undegraded":"2024-04-17T15:37:14.247975+0000","last_fullsized":"2024-04-17T15:37:14.247975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823042+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:37:15.823042+0000","last_peered":"2024-04-17T15:37:15.823042+0000","last_clean":"2024-04-17T15:37:15.823042+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:37:15.823042+0000","last_undegraded":"2024-04-17T15:37:15.823042+0000","last_fullsized":"2024-04-17T15:37:15.823042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821338+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:37:15.821338+0000","last_peered":"2024-04-17T15:37:15.821338+0000","last_clean":"2024-04-17T15:37:15.821338+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:37:15.821338+0000","last_undegraded":"2024-04-17T15:37:15.821338+0000","last_fullsized":"2024-04-17T15:37:15.821338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820247+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:37:15.820247+0000","last_peered":"2024-04-17T15:37:15.820247+0000","last_clean":"2024-04-17T15:37:15.820247+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:37:15.820247+0000","last_undegraded":"2024-04-17T15:37:15.820247+0000","last_fullsized":"2024-04-17T15:37:15.820247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806097+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:37:14.806097+0000","last_peered":"2024-04-17T15:37:14.806097+0000","last_clean":"2024-04-17T15:37:14.806097+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:37:14.806097+0000","last_undegraded":"2024-04-17T15:37:14.806097+0000","last_fullsized":"2024-04-17T15:37:14.806097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244858+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:37:14.244858+0000","last_peered":"2024-04-17T15:37:14.244858+0000","last_clean":"2024-04-17T15:37:14.244858+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:37:14.244858+0000","last_undegraded":"2024-04-17T15:37:14.244858+0000","last_fullsized":"2024-04-17T15:37:14.244858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239880+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:37:14.239880+0000","last_peered":"2024-04-17T15:37:14.239880+0000","last_clean":"2024-04-17T15:37:14.239880+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:37:14.239880+0000","last_undegraded":"2024-04-17T15:37:14.239880+0000","last_fullsized":"2024-04-17T15:37:14.239880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239529+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:37:14.239529+0000","last_peered":"2024-04-17T15:37:14.239529+0000","last_clean":"2024-04-17T15:37:14.239529+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:37:14.239529+0000","last_undegraded":"2024-04-17T15:37:14.239529+0000","last_fullsized":"2024-04-17T15:37:14.239529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240178+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:37:14.240178+0000","last_peered":"2024-04-17T15:37:14.240178+0000","last_clean":"2024-04-17T15:37:14.240178+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:37:14.240178+0000","last_undegraded":"2024-04-17T15:37:14.240178+0000","last_fullsized":"2024-04-17T15:37:14.240178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821297+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:37:15.821297+0000","last_peered":"2024-04-17T15:37:15.821297+0000","last_clean":"2024-04-17T15:37:15.821297+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:37:15.821297+0000","last_undegraded":"2024-04-17T15:37:15.821297+0000","last_fullsized":"2024-04-17T15:37:15.821297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239612+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:37:14.239612+0000","last_peered":"2024-04-17T15:37:14.239612+0000","last_clean":"2024-04-17T15:37:14.239612+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:37:14.239612+0000","last_undegraded":"2024-04-17T15:37:14.239612+0000","last_fullsized":"2024-04-17T15:37:14.239612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821601+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:37:15.821601+0000","last_peered":"2024-04-17T15:37:15.821601+0000","last_clean":"2024-04-17T15:37:15.821601+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:37:15.821601+0000","last_undegraded":"2024-04-17T15:37:15.821601+0000","last_fullsized":"2024-04-17T15:37:15.821601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247179+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:37:14.247179+0000","last_peered":"2024-04-17T15:37:14.247179+0000","last_clean":"2024-04-17T15:37:14.247179+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:37:14.247179+0000","last_undegraded":"2024-04-17T15:37:14.247179+0000","last_fullsized":"2024-04-17T15:37:14.247179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.821561+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:37:15.821561+0000","last_peered":"2024-04-17T15:37:15.821561+0000","last_clean":"2024-04-17T15:37:15.821561+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:37:15.821561+0000","last_undegraded":"2024-04-17T15:37:15.821561+0000","last_fullsized":"2024-04-17T15:37:15.821561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808393+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:37:14.808393+0000","last_peered":"2024-04-17T15:37:14.808393+0000","last_clean":"2024-04-17T15:37:14.808393+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:37:14.808393+0000","last_undegraded":"2024-04-17T15:37:14.808393+0000","last_fullsized":"2024-04-17T15:37:14.808393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.816874+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:37:15.816874+0000","last_peered":"2024-04-17T15:37:15.816874+0000","last_clean":"2024-04-17T15:37:15.816874+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:37:15.816874+0000","last_undegraded":"2024-04-17T15:37:15.816874+0000","last_fullsized":"2024-04-17T15:37:15.816874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822553+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:37:15.822553+0000","last_peered":"2024-04-17T15:37:15.822553+0000","last_clean":"2024-04-17T15:37:15.822553+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:37:15.822553+0000","last_undegraded":"2024-04-17T15:37:15.822553+0000","last_fullsized":"2024-04-17T15:37:15.822553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.807940+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:37:14.807940+0000","last_peered":"2024-04-17T15:37:14.807940+0000","last_clean":"2024-04-17T15:37:14.807940+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:37:14.807940+0000","last_undegraded":"2024-04-17T15:37:14.807940+0000","last_fullsized":"2024-04-17T15:37:14.807940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823709+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:37:15.823709+0000","last_peered":"2024-04-17T15:37:15.823709+0000","last_clean":"2024-04-17T15:37:15.823709+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:37:15.823709+0000","last_undegraded":"2024-04-17T15:37:15.823709+0000","last_fullsized":"2024-04-17T15:37:15.823709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823726+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:37:15.823726+0000","last_peered":"2024-04-17T15:37:15.823726+0000","last_clean":"2024-04-17T15:37:15.823726+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:37:15.823726+0000","last_undegraded":"2024-04-17T15:37:15.823726+0000","last_fullsized":"2024-04-17T15:37:15.823726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241931+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:37:14.241931+0000","last_peered":"2024-04-17T15:37:14.241931+0000","last_clean":"2024-04-17T15:37:14.241931+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:37:14.241931+0000","last_undegraded":"2024-04-17T15:37:14.241931+0000","last_fullsized":"2024-04-17T15:37:14.241931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823397+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:37:15.823397+0000","last_peered":"2024-04-17T15:37:15.823397+0000","last_clean":"2024-04-17T15:37:15.823397+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:37:15.823397+0000","last_undegraded":"2024-04-17T15:37:15.823397+0000","last_fullsized":"2024-04-17T15:37:15.823397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.238409+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:37:14.238409+0000","last_peered":"2024-04-17T15:37:14.238409+0000","last_clean":"2024-04-17T15:37:14.238409+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:37:14.238409+0000","last_undegraded":"2024-04-17T15:37:14.238409+0000","last_fullsized":"2024-04-17T15:37:14.238409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820802+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:37:15.820802+0000","last_peered":"2024-04-17T15:37:15.820802+0000","last_clean":"2024-04-17T15:37:15.820802+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:37:15.820802+0000","last_undegraded":"2024-04-17T15:37:15.820802+0000","last_fullsized":"2024-04-17T15:37:15.820802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820945+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:37:15.820945+0000","last_peered":"2024-04-17T15:37:15.820945+0000","last_clean":"2024-04-17T15:37:15.820945+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:37:15.820945+0000","last_undegraded":"2024-04-17T15:37:15.820945+0000","last_fullsized":"2024-04-17T15:37:15.820945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820795+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:37:15.820795+0000","last_peered":"2024-04-17T15:37:15.820795+0000","last_clean":"2024-04-17T15:37:15.820795+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:37:15.820795+0000","last_undegraded":"2024-04-17T15:37:15.820795+0000","last_fullsized":"2024-04-17T15:37:15.820795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808589+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:37:14.808589+0000","last_peered":"2024-04-17T15:37:14.808589+0000","last_clean":"2024-04-17T15:37:14.808589+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:37:14.808589+0000","last_undegraded":"2024-04-17T15:37:14.808589+0000","last_fullsized":"2024-04-17T15:37:14.808589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239310+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:37:14.239310+0000","last_peered":"2024-04-17T15:37:14.239310+0000","last_clean":"2024-04-17T15:37:14.239310+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:37:14.239310+0000","last_undegraded":"2024-04-17T15:37:14.239310+0000","last_fullsized":"2024-04-17T15:37:14.239310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240726+0000","last_change":"2024-04-17T15:36:54.177547+0000","last_active":"2024-04-17T15:37:14.240726+0000","last_peered":"2024-04-17T15:37:14.240726+0000","last_clean":"2024-04-17T15:37:14.240726+0000","last_became_active":"2024-04-17T15:36:54.176327+0000","last_became_peered":"2024-04-17T15:36:54.176327+0000","last_unstale":"2024-04-17T15:37:14.240726+0000","last_undegraded":"2024-04-17T15:37:14.240726+0000","last_fullsized":"2024-04-17T15:37:14.240726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:54:55.766570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823226+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:37:15.823226+0000","last_peered":"2024-04-17T15:37:15.823226+0000","last_clean":"2024-04-17T15:37:15.823226+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:37:15.823226+0000","last_undegraded":"2024-04-17T15:37:15.823226+0000","last_fullsized":"2024-04-17T15:37:15.823226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823202+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:37:15.823202+0000","last_peered":"2024-04-17T15:37:15.823202+0000","last_clean":"2024-04-17T15:37:15.823202+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:37:15.823202+0000","last_undegraded":"2024-04-17T15:37:15.823202+0000","last_fullsized":"2024-04-17T15:37:15.823202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239399+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:37:14.239399+0000","last_peered":"2024-04-17T15:37:14.239399+0000","last_clean":"2024-04-17T15:37:14.239399+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:37:14.239399+0000","last_undegraded":"2024-04-17T15:37:14.239399+0000","last_fullsized":"2024-04-17T15:37:14.239399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.244689+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:37:14.244689+0000","last_peered":"2024-04-17T15:37:14.244689+0000","last_clean":"2024-04-17T15:37:14.244689+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:37:14.244689+0000","last_undegraded":"2024-04-17T15:37:14.244689+0000","last_fullsized":"2024-04-17T15:37:14.244689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241846+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:37:14.241846+0000","last_peered":"2024-04-17T15:37:14.241846+0000","last_clean":"2024-04-17T15:37:14.241846+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:37:14.241846+0000","last_undegraded":"2024-04-17T15:37:14.241846+0000","last_fullsized":"2024-04-17T15:37:14.241846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.240487+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:37:14.240487+0000","last_peered":"2024-04-17T15:37:14.240487+0000","last_clean":"2024-04-17T15:37:14.240487+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:37:14.240487+0000","last_undegraded":"2024-04-17T15:37:14.240487+0000","last_fullsized":"2024-04-17T15:37:14.240487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808349+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:37:14.808349+0000","last_peered":"2024-04-17T15:37:14.808349+0000","last_clean":"2024-04-17T15:37:14.808349+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:37:14.808349+0000","last_undegraded":"2024-04-17T15:37:14.808349+0000","last_fullsized":"2024-04-17T15:37:14.808349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820041+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:37:15.820041+0000","last_peered":"2024-04-17T15:37:15.820041+0000","last_clean":"2024-04-17T15:37:15.820041+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:37:15.820041+0000","last_undegraded":"2024-04-17T15:37:15.820041+0000","last_fullsized":"2024-04-17T15:37:15.820041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.824220+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:37:15.824220+0000","last_peered":"2024-04-17T15:37:15.824220+0000","last_clean":"2024-04-17T15:37:15.824220+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:37:15.824220+0000","last_undegraded":"2024-04-17T15:37:15.824220+0000","last_fullsized":"2024-04-17T15:37:15.824220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239578+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:37:14.239578+0000","last_peered":"2024-04-17T15:37:14.239578+0000","last_clean":"2024-04-17T15:37:14.239578+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:37:14.239578+0000","last_undegraded":"2024-04-17T15:37:14.239578+0000","last_fullsized":"2024-04-17T15:37:14.239578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239650+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:37:14.239650+0000","last_peered":"2024-04-17T15:37:14.239650+0000","last_clean":"2024-04-17T15:37:14.239650+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:37:14.239650+0000","last_undegraded":"2024-04-17T15:37:14.239650+0000","last_fullsized":"2024-04-17T15:37:14.239650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820271+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:37:15.820271+0000","last_peered":"2024-04-17T15:37:15.820271+0000","last_clean":"2024-04-17T15:37:15.820271+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:37:15.820271+0000","last_undegraded":"2024-04-17T15:37:15.820271+0000","last_fullsized":"2024-04-17T15:37:15.820271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.823248+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:37:15.823248+0000","last_peered":"2024-04-17T15:37:15.823248+0000","last_clean":"2024-04-17T15:37:15.823248+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:37:15.823248+0000","last_undegraded":"2024-04-17T15:37:15.823248+0000","last_fullsized":"2024-04-17T15:37:15.823248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808865+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:37:14.808865+0000","last_peered":"2024-04-17T15:37:14.808865+0000","last_clean":"2024-04-17T15:37:14.808865+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:37:14.808865+0000","last_undegraded":"2024-04-17T15:37:14.808865+0000","last_fullsized":"2024-04-17T15:37:14.808865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.246124+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:37:14.246124+0000","last_peered":"2024-04-17T15:37:14.246124+0000","last_clean":"2024-04-17T15:37:14.246124+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:37:14.246124+0000","last_undegraded":"2024-04-17T15:37:14.246124+0000","last_fullsized":"2024-04-17T15:37:14.246124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.245063+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:37:14.245063+0000","last_peered":"2024-04-17T15:37:14.245063+0000","last_clean":"2024-04-17T15:37:14.245063+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:37:14.245063+0000","last_undegraded":"2024-04-17T15:37:14.245063+0000","last_fullsized":"2024-04-17T15:37:14.245063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.806899+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:37:14.806899+0000","last_peered":"2024-04-17T15:37:14.806899+0000","last_clean":"2024-04-17T15:37:14.806899+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:37:14.806899+0000","last_undegraded":"2024-04-17T15:37:14.806899+0000","last_fullsized":"2024-04-17T15:37:14.806899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.247896+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:37:14.247896+0000","last_peered":"2024-04-17T15:37:14.247896+0000","last_clean":"2024-04-17T15:37:14.247896+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:37:14.247896+0000","last_undegraded":"2024-04-17T15:37:14.247896+0000","last_fullsized":"2024-04-17T15:37:14.247896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.239330+0000","last_change":"2024-04-17T15:36:56.190009+0000","last_active":"2024-04-17T15:37:14.239330+0000","last_peered":"2024-04-17T15:37:14.239330+0000","last_clean":"2024-04-17T15:37:14.239330+0000","last_became_active":"2024-04-17T15:36:56.189084+0000","last_became_peered":"2024-04-17T15:36:56.189084+0000","last_unstale":"2024-04-17T15:37:14.239330+0000","last_undegraded":"2024-04-17T15:37:14.239330+0000","last_fullsized":"2024-04-17T15:37:14.239330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:04:56.180628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.241569+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:37:14.241569+0000","last_peered":"2024-04-17T15:37:14.241569+0000","last_clean":"2024-04-17T15:37:14.241569+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:37:14.241569+0000","last_undegraded":"2024-04-17T15:37:14.241569+0000","last_fullsized":"2024-04-17T15:37:14.241569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.243365+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:37:14.243365+0000","last_peered":"2024-04-17T15:37:14.243365+0000","last_clean":"2024-04-17T15:37:14.243365+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:37:14.243365+0000","last_undegraded":"2024-04-17T15:37:14.243365+0000","last_fullsized":"2024-04-17T15:37:14.243365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822181+0000","last_change":"2024-04-17T15:36:54.206097+0000","last_active":"2024-04-17T15:37:15.822181+0000","last_peered":"2024-04-17T15:37:15.822181+0000","last_clean":"2024-04-17T15:37:15.822181+0000","last_became_active":"2024-04-17T15:36:54.205139+0000","last_became_peered":"2024-04-17T15:36:54.205139+0000","last_unstale":"2024-04-17T15:37:15.822181+0000","last_undegraded":"2024-04-17T15:37:15.822181+0000","last_fullsized":"2024-04-17T15:37:15.822181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.820021+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:37:15.820021+0000","last_peered":"2024-04-17T15:37:15.820021+0000","last_clean":"2024-04-17T15:37:15.820021+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:37:15.820021+0000","last_undegraded":"2024-04-17T15:37:15.820021+0000","last_fullsized":"2024-04-17T15:37:15.820021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-17T15:37:14.808292+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:37:14.808292+0000","last_peered":"2024-04-17T15:37:14.808292+0000","last_clean":"2024-04-17T15:37:14.808292+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:37:14.808292+0000","last_undegraded":"2024-04-17T15:37:14.808292+0000","last_fullsized":"2024-04-17T15:37:14.808292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.817196+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:37:15.817196+0000","last_peered":"2024-04-17T15:37:15.817196+0000","last_clean":"2024-04-17T15:37:15.817196+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:37:15.817196+0000","last_undegraded":"2024-04-17T15:37:15.817196+0000","last_fullsized":"2024-04-17T15:37:15.817196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-17T15:37:15.822092+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:37:15.822092+0000","last_peered":"2024-04-17T15:37:15.822092+0000","last_clean":"2024-04-17T15:37:15.822092+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:37:15.822092+0000","last_undegraded":"2024-04-17T15:37:15.822092+0000","last_fullsized":"2024-04-17T15:37:15.822092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":745370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":154342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":170890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":169124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":155731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":153904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":162670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":753411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:37:21.730 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-17T15:37:21.730 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-17T15:37:21.730 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-17T15:37:21.730 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 1.000000 2024-04-17T15:37:21.730 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-17T15:37:21.732 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:21.765 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:21.766+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:21.835 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:21.834+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:21.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:37:21.907 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:21.907 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:21.907 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:21.907 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:21.907 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:21.922 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:21.937 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:21.938+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:22.038 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:22.035+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:22.052 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:22.052 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:22.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:22.052 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:22.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.978254012999997, 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.053 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:37:22.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:37:22.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:37:22.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.696156025999997, 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.695983871999999, 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.066 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:37:22.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:37:22.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:37:22.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:37:22.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:37:22.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:37:22.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:37:22.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:37:22.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:37:22.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.695945041999998, 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.076 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:37:22.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:37:22.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:37:22.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:37:22.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.486528851999999, 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.083 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:22.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:37:22.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:37:22.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:37:22.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.089 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.486467369000003, 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:37:22.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.486260790999999, 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:22.101 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.486220842000002, 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:22.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:37:22.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:37:22.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:37:22.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:37:22.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.486181919000003, 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:37:22.108 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:37:22.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.485982337000003, 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.485937104999998, 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.119 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:37:22.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:37:22.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:37:22.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:37:22.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.124 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259871726999997, 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:37:22.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259748018000003, 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259646863, 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.136 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:37:22.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259623646999998, 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:37:22.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259602237000003, 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259496273000003, 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.153 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:37:22.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:37:22.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259471572000002, 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.159 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:37:22.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.165 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259450555000001, 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.259336030999997, 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:22.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:22.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:37:22.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:37:22.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:37:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:22.176 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:22.177 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:22.178 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:22.175+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:22.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:22.279 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:22.278+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:22.302 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:22.303 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:22.303 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:22.303 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:22.317 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:22.405 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:22.406+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:22.481 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:22.482+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:22.494 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:22.494 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:22.494 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:22.495 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:22.495 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:22.509 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:22.605 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:22.606+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:22.685 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:22.682+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:22.709 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.709 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.375518251000003, 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:37:22.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:37:22.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.374194393000003, 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:37:22.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:37:22.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:37:22.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.348988054000003, 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:37:22.718 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:37:22.722 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.346816766000003, 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:22.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:37:22.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.726 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.345323895999996, 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:37:22.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.343764149999998, 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:37:22.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:37:22.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.341266433999998, 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.735 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:37:22.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:37:22.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:22.739 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.339645111000003, 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:37:22.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:37:22.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.743 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.135857643000001, 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 20.399939427, 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.748 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:37:22.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:37:22.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.427989343, 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.754 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.409022301, 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.760 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:37:22.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:37:22.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.379050658000001, 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.766 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:37:22.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:37:22.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.363836954, 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.771 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.334438377000001, 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.777 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.782 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.316939433000002, 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:37:22.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:37:22.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:37:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:37:22.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:37:22.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:37:22.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:408 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.265654623, 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029170390000000002, 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 408 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3600000000000002e-07 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440785+0000", 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6010000000000002e-06 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440798+0000", 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2544000000000001e-05 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440807+0000", 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2760000000000006e-06 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440879+0000", 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2319999999999999e-05 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440936+0000", 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6876999999999998e-05 2024-04-17T15:37:22.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.441075+0000", 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013935299999999999 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.441817+0000", 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00074177399999999995 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443631+0000", 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018137889999999999 2024-04-17T15:37:22.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443668+0000", 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6668000000000002e-05 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443696+0000", 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8000999999999998e-05 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.797 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.261061697999999, 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.803 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.152624465999999, 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:37:22.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:22.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:22.809 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.126121287, 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:22.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:22.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:22.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:22.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:22.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:22.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:37:22.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:37:22.815 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.815 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.815 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.815 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:22.815 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:22.815 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:22.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:22.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:22.818 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:22.819+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-17T15:37:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:37:22.919 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:22.919+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:23.013 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:23.014 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:23.014 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:23.014 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:23.017 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:23.017 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:23.018 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:23.015+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:23.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:23.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:23.056 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:23.057 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:23.075 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:23.075 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:23.097 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:23.098 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:23.119 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:23.119+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:23.135 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:23.170 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:23.171 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:23.180 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:23.180 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:23.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:23.204 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:23.205 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:23.221 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:23.219+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:23.322 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:23.319+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:23.347 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:23.348 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:23.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:23.423 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:23.422+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:23.499 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:23.499 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:23.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:23.557 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:23.558+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:23.624 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:23.627+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:23.676 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:23.676 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:23.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:23.741 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:23.742+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:23.826 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:23.823+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:23.841 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:23.841 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:23.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:23.953 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:23.954+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:24.028 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:24.027+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:24.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:24.141 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:24.142+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:24.220 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:24.221 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:24.231 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:24.230+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:24.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:24.334 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:24.330+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:24.405 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:24.405 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:24.420 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:24.461 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:24.462+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:24.534 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:24.531+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:24.557 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:24.557 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:24.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:24.635 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:24.634+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:24.736 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:24.735+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:24.742 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:24.743 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:24.757 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:24.843 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:24.843+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:24.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:37:24.932 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:24.933 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:24.950 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:24.957 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:24.958+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:25.038 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:25.035+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:25.120 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:25.120 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:25.134 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:25.139 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:25.138+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:25.224 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:25.269 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:25.270+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:25.300 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:25.300 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:25.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:25.363 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:25.363+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:25.384 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:25.385 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:25.402 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:25.419 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:25.420 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:25.439 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:25.439 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:25.443 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:25.439+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:25.443 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:25.443 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:25.454 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:25.471 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:25.489 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:25.508 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:25.509 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:25.529 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:25.529 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:25.543 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:25.542+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:25.624 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:25.624 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:25.624 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:25.625 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:25.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:25.645 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:25.643+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:25.745 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:25.743+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:25.770 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:25.770 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:25.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:25.879 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:25.879+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:25.880 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:37:25.947 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:25.946+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:25.962 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:25.962 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:25.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:25.962 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:25.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.711787396999998, 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:25.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:37:25.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:37:25.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:37:25.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:37:25.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:37:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:25.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:37:25.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:37:25.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:25.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:37:25.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:37:25.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:25.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:37:25.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.679817091, 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:25.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:25.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:37:25.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:37:25.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:25.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.662481074999999, 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:37:25.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:37:25.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:25.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:37:25.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:37:25.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:25.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:37:25.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:25.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.659946433000002, 2024-04-17T15:37:25.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.991 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.559392807999998, 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:25.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:25.996 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.666328077999999, 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:25.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:37:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:37:25.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:25.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:25.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:25.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:37:25.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:37:25.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:37:26.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.002 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:26.002 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:26.002 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.643195382999998, 2024-04-17T15:37:26.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:37:26.002 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.002 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:37:26.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:37:26.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.007 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.602961897, 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:26.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:26.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:37:26.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:37:26.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:37:26.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:37:26.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.548427867000001, 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.013 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:37:26.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:37:26.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:26.017 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.527646245, 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.527235055999999, 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:37:26.026 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.524843652000001, 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:26.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:37:26.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:37:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.030 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.524745592999999, 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:37:26.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.522039764999999, 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:26.039 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.489304225000001, 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:37:26.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:37:26.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.480284065999999, 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:37:26.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.047 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.475668719000002, 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:37:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:37:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:37:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:37:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:37:26.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.466275487000001, 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:37:26.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.432932791999999, 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.373173023, 2024-04-17T15:37:26.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:37:26.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:37:26.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:37:26.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:37:26.066 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.066 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.066 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.066 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.066 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.066 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:26.067 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:26.068 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:26.066+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:26.168 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:26.167+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:26.246 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:26.246 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:26.246 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:26.246 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:26.260 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:26.303 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:26.303+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:26.371 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:26.370+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:26.432 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:26.433 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:26.448 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:26.495 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:26.495+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:26.572 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:26.570+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:26.578 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.504784551999997, 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:37:26.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:37:26.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:37:26.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:26.588 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.222686564999997, 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:37:26.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:37:26.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:37:26.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:37:26.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.222514410999999, 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.594 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:26.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.599 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.222475580999998, 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.600 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:26.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:37:26.605 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.013059390999999, 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.606 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.607 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.607 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:37:26.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.607 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:26.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:26.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:26.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:37:26.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:37:26.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:37:26.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:37:26.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:37:26.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:37:26.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:37:26.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:37:26.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:37:26.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:37:26.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:37:26.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:37:26.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:37:26.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:37:26.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:37:26.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:37:26.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:37:26.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:37:26.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:37:26.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:37:26.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:37:26.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.619 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.619 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.619 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:26.620 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.012997908000003, 2024-04-17T15:37:26.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:37:26.620 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.620 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.620 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.620 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.621 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.621 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.621 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:37:26.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.621 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:26.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:26.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:37:26.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:37:26.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:37:26.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:37:26.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:37:26.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:37:26.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:37:26.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:37:26.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:37:26.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:37:26.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:37:26.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:37:26.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:37:26.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:37:26.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:37:26.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:37:26.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:37:26.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:37:26.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:37:26.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:37:26.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:37:26.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:37:26.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.632 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.633 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.633 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:26.633 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.012791329999999, 2024-04-17T15:37:26.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:37:26.633 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.633 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.634 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.634 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.634 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.634 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.634 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:37:26.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.635 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:26.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:26.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:37:26.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:37:26.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:37:26.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:37:26.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:37:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:37:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:37:26.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:37:26.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:37:26.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:37:26.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:37:26.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:37:26.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:37:26.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:37:26.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:37:26.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:37:26.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:37:26.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:37:26.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:37:26.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:37:26.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:37:26.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:37:26.650 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.651 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.651 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.651 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:26.652 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.012751381000001, 2024-04-17T15:37:26.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:37:26.652 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.652 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.653 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:37:26.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.653 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:26.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:37:26.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:37:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:37:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:37:26.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:37:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:37:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:37:26.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:37:26.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:37:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:37:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:37:26.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:37:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:37:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:37:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:37:26.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.012712458000003, 2024-04-17T15:37:26.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.665 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:37:26.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:37:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:37:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:37:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:37:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:37:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:37:26.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:37:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:37:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:37:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:37:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.012512876000002, 2024-04-17T15:37:26.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:37:26.677 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:37:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.678 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:26.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:37:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:37:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:37:26.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:37:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:37:26.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:37:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:37:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:37:26.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:37:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:37:26.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:37:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:37:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:37:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:37:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:37:26.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:37:26.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:37:26.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:37:26.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:37:26.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:37:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:37:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:37:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.693 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.012467643999997, 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.694 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:26.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:26.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:37:26.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:37:26.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:37:26.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:37:26.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:37:26.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:37:26.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:37:26.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:37:26.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:37:26.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:37:26.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:37:26.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:37:26.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:37:26.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:37:26.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:37:26.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:37:26.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:37:26.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:37:26.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:37:26.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:37:26.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:37:26.706 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.786402266000003, 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:37:26.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:37:26.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.786278557000003, 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.714 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:37:26.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:37:26.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:37:26.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:37:26.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:37:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.786177402, 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.721 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:37:26.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:37:26.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.727 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.786154185999997, 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:37:26.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:37:26.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:37:26.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.734 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.734 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.734 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.734 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:26.734 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.786132776000002, 2024-04-17T15:37:26.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:37:26.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:37:26.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:37:26.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.740 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.740 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.740 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.740 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:26.740 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.786026812000003, 2024-04-17T15:37:26.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:37:26.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:37:26.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:37:26.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.786002111000002, 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.746 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:37:26.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:37:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:37:26.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.785981094, 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:37:26.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:37:26.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:37:26.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:37:26.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.785866570000003, 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:26.757 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:26.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:26.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:37:26.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:26.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.762 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:26.763 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:26.763 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:26.764 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:26.763+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:26.764 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:26.865 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:26.863+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:26.921 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:26.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:26.921 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:26.921 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:26.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:26.981 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:26.982+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:27.068 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:27.067+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:27.079 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:27.079 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:27.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:27.181 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:27.182+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:27.270 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:27.267+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:27.274 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:37:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.941387902000002, 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:37:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:37:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:37:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.940064044000003, 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:37:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:37:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.914857705000003, 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:37:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:37:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:37:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:37:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:37:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:37:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.912686417000003, 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:37:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:37:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:37:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.911193547000003, 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:37:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:37:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:37:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.909633800999998, 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:37:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:37:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.907136084999998, 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.905514762000003, 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:37:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:37:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:37:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.701727294000001, 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:37:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:37:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:37:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:37:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:37:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 24.965809077999999, 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:37:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:37:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:37:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:37:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.993858994, 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.974891952, 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:37:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:37:27.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:37:27.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:37:27.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:37:27.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:37:27.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.337 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.944920309, 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.929706605, 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.343 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:27.348 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.900308028000001, 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:37:27.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.353 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.882809084000002, 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:37:27.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:37:27.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:37:27.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:37:27.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:408 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.831524274, 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029170390000000002, 2024-04-17T15:37:27.359 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 408 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3600000000000002e-07 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440785+0000", 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6010000000000002e-06 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440798+0000", 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2544000000000001e-05 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440807+0000", 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2760000000000006e-06 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440879+0000", 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2319999999999999e-05 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440936+0000", 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6876999999999998e-05 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.441075+0000", 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013935299999999999 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.441817+0000", 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00074177399999999995 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443631+0000", 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018137889999999999 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443668+0000", 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6668000000000002e-05 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443696+0000", 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8000999999999998e-05 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.364 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.826931348999999, 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.365 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:37:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.718494116999999, 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:27.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:37:27.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:37:27.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:37:27.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.375 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.691990938, 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:27.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:37:27.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:37:27.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:27.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:37:27.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:37:27.381 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.381 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.381 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.381 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:27.381 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:27.381 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:27.382 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:27.383 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:27.379+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:27.483 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:27.482+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:27.547 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:27.565 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:27.565 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:27.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:27.625 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:27.626+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:27.685 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:27.683+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:27.715 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:27.732 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:27.733 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:27.747 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:27.747 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:27.750 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:27.751 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:27.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:27.773 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:27.774 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:27.785 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:27.783+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:27.794 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:27.795 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:27.816 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:27.817 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:27.839 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:27.839 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:27.880 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:27.880 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:27.885 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:27.883+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:27.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:27.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:37:27.987 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:27.983+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:28.063 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:28.063 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:28.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:28.125 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:28.126+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:28.188 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:28.187+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:28.204 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:28.204 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:28.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:28.309 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:28.310+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:28.390 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:28.390+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:28.392 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:28.392 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:28.408 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:28.492 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:28.491+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:28.583 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:28.583 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:28.593 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:28.594+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:28.598 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:28.693 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:28.691+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:28.794 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:28.791+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:28.795 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:28.795 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:28.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:28.895 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:28.894+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:28.907 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:37:28.950 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:28.951 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:28.966 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:29.009 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:29.010+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:29.097 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:29.098+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:29.116 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:29.197 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:29.195+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:29.236 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:29.236 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:29.250 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:29.298 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:29.298+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:29.399 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:29.399+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:29.416 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:29.416 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:29.431 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:29.500 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:29.502+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:29.601 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:29.599+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:29.604 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:29.604 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:29.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:29.702 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:29.702+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:29.782 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:29.782 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:29.797 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:29.803 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:29.802+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:29.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:29.909 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:29.910+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:29.918 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:29.918 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:29.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:30.005 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:30.003+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:30.023 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:30.039 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:30.039 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:30.057 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:30.057 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:30.060 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:30.060 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:30.075 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:30.075 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:30.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:30.093 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:30.112 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:30.119 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:30.119+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:30.152 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:30.152 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:30.206 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:30.203+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:30.250 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:30.250 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:30.265 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:30.312 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:30.311+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:30.408 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:30.406+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:30.442 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:30.442 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:30.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:30.442 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:30.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.191748592, 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:37:30.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:37:30.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.449 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.159778286000002, 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:37:30.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:37:30.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:37:30.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:30.455 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.14244227, 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:37:30.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:30.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.461 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.139907628, 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:37:30.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.039354003, 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:37:30.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:37:30.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.146289273000001, 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:37:30.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:30.476 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.123156578, 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:37:30.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:37:30.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.082923092000001, 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:37:30.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.486 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.028389061999999, 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:30.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:37:30.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:37:30.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.007607440000001, 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:37:30.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:37:30.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.007196251, 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:37:30.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:37:30.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.004804846999999, 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:37:30.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:37:30.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.004706788, 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:37:30.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:37:30.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.509 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.00200096, 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.513 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.969265419999999, 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.960245261000001, 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.518 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:37:30.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:37:30.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.955629913999999, 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:37:30.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.946236681999999, 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.527 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.531 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.912893987, 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:37:30.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:37:30.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.853134218000001, 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:37:30.536 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:30.540 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:30.542 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:30.542 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:30.542+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:30.643 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:30.642+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:30.672 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:30.672 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:30.672 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:30.672 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:30.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:30.744 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:30.743+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:30.817 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:30.817 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:30.817 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:30.818 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:30.818 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:30.832 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:30.876 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:30.875+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:30.929 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:37:30.945 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:30.943+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:30.999 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.925567452000003, 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.000 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:37:31.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:37:31.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:37:31.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:37:31.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.643469465000003, 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:37:31.006 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.011 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.643297310999998, 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.012 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:31.017 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.643258480999997, 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:31.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:37:31.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:37:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:37:31.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.433842290999998, 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.023 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:37:31.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:37:31.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:37:31.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.433780808000002, 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.029 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.034 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.433574229999998, 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:31.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:37:31.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:37:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:37:31.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:37:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.433534281, 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.433495358000002, 2024-04-17T15:37:31.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:37:31.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:37:31.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:37:31.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.433295776000001, 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:37:31.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:37:31.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.433250544000003, 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:37:31.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:37:31.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:37:31.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.207185166000002, 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.062 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:31.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:37:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:37:31.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:37:31.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.207061457000002, 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.206960301999999, 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.073 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:37:31.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.206937086000003, 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:37:31.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:37:31.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:37:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.206915676000001, 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.206809712000002, 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:37:31.090 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:37:31.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.206785011000001, 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.096 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:31.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:37:31.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:37:31.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:37:31.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.206763993999999, 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:37:31.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:37:31.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.206649470000002, 2024-04-17T15:37:31.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.112 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.113 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.113 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:31.113 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:31.113 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:31.114 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:31.115+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:31.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:31.215 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:31.214+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:31.237 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:31.237 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:31.252 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:31.316 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:31.315+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:31.417 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:31.415+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:31.421 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:31.421 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:31.421 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:31.421 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:31.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:31.518 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:31.518+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:31.570 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:31.570 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:31.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.237724686, 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:31.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:37:31.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:37:31.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:37:31.575 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.575 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.575 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.236400828000001, 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.211194489, 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:37:31.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:37:31.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:37:31.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.209023201000001, 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:31.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:31.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:37:31.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:37:31.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.207530331000001, 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.205970585000003, 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.203472869000002, 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.597 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:37:31.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:37:31.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.601 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.201851546, 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:37:31.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:37:31.606 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.606 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.606 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.606 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:37:31.606 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 42.998064077999999, 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:31.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:37:31.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:37:31.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:37:31.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.262145862000001, 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.611 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:37:31.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:37:31.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:37:31.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:37:31.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:37:31.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.290195778000001, 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:37:31.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:37:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.271228736000001, 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:37:31.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.241257093000002, 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.629 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.634 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.226043389000001, 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:31.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:37:31.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:37:31.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:37:31.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:37:31.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.196644811999999, 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.179145867999999, 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.646 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:37:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:37:31.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:37:31.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:37:31.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:408 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.127861058000001, 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029170390000000002, 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.652 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 408 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440779+0000", 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3600000000000002e-07 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440785+0000", 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6010000000000002e-06 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440798+0000", 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2544000000000001e-05 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440807+0000", 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2760000000000006e-06 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440879+0000", 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2319999999999999e-05 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440936+0000", 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6876999999999998e-05 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.441075+0000", 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013935299999999999 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.441817+0000", 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00074177399999999995 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443631+0000", 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018137889999999999 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443668+0000", 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6668000000000002e-05 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.443696+0000", 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8000999999999998e-05 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:31.657 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.123268133, 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:31.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:37:31.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:37:31.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:37:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:37:31.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.014830901, 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.663 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:31.668 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 25.988327722000001, 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:37:31.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:37:31.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:37:31.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.673 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.674 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.674 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:31.674 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:31.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:31.676 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:31.675+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:31.776 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:31.774+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:31.851 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:31.851 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:31.851 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:31.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:31.877 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:31.875+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:31.921 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:37:31.978 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:31.975+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:32.037 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:32.037 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:32.037 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:32.037 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:32.052 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:32.078 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:32.075+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:32.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.909023775999998, 2024-04-17T15:37:32.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030313720000000001, 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 38 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269545+0000", 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2670000000000001e-06 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269558+0000", 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3053e-05 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269589+0000", 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1276999999999999e-05 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269605+0000", 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6076e-05 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269741+0000", 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135131 2024-04-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269958+0000", 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021726100000000001 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.270212+0000", 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000253918 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.271337+0000", 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011256980000000001 2024-04-17T15:37:32.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272406+0000", 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001068575 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272504+0000", 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7790999999999999e-05 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272574+0000", 2024-04-17T15:37:32.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0325000000000002e-05 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.896338041, 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.889720395000001, 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.189 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:37:32.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:37:32.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.889382756, 2024-04-17T15:37:32.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:37:32.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:60 7.9 e27/26 7:93e5b521:::notify.7:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:32.197 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.871300267999999, 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003055341, 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307268+0000", 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.463e-06 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307278+0000", 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307326+0000", 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8736999999999998e-05 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307347+0000", 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1053999999999999e-05 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307468+0000", 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120353 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307504+0000", 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6426e-05 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310218+0000", 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027133840000000001 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310322+0000", 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010407 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.201 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.773317805000001, 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033104499999999999, 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 193 2024-04-17T15:37:32.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405251+0000", 2024-04-17T15:37:32.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405263+0000", 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1673e-05 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405294+0000", 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1537e-05 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405311+0000", 2024-04-17T15:37:32.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6478999999999999e-05 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405428+0000", 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011737 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405628+0000", 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019951800000000001 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405892+0000", 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026415500000000002 2024-04-17T15:37:32.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.407420+0000", 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015283129999999999 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408374+0000", 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0009544 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408478+0000", 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010396200000000001 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408559+0000", 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0820000000000002e-05 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.889967676000001, 2024-04-17T15:37:32.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:37:32.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:37:32.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:37:32.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:37:32.212 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.873497263000001, 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033682500000000002, 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.213 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.214 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 212 2024-04-17T15:37:32.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305072+0000", 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305083+0000", 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1517e-05 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305112+0000", 2024-04-17T15:37:32.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8486000000000001e-05 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305126+0000", 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4487e-05 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305251+0000", 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124599 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305451+0000", 2024-04-17T15:37:32.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020034499999999999 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305839+0000", 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038760800000000001 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.307390+0000", 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015517459999999999 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308276+0000", 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088547699999999997 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308364+0000", 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8619e-05 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308438+0000", 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3133000000000006e-05 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.847271596999999, 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033421330000000002, 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 219 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331298+0000", 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4589999999999998e-06 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331311+0000", 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2257e-05 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331343+0000", 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2156000000000002e-05 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331358+0000", 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5252999999999999e-05 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331474+0000", 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011544600000000001 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331700+0000", 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000226102 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.332161+0000", 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046111699999999998 2024-04-17T15:37:32.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.333471+0000", 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001310741 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334479+0000", 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010074629999999999 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334565+0000", 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6093000000000004e-05 2024-04-17T15:37:32.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334637+0000", 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2045999999999994e-05 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.828924878999999, 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032014919999999998, 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.225 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 224 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349644+0000", 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349655+0000", 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0764000000000001e-05 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349687+0000", 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2085999999999997e-05 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349702+0000", 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349889+0000", 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698599999999999 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350092+0000", 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020369100000000001 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350514+0000", 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042112699999999998 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.351874+0000", 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013607910000000001 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352690+0000", 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081600800000000001 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352776+0000", 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6119000000000007e-05 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352843+0000", 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.669e-05 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.230 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:318 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.766649203, 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031343450000000002, 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.231 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 318 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411918+0000", 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0869999999999999e-06 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411938+0000", 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9788000000000001e-05 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411952+0000", 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4066000000000001e-05 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411963+0000", 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0920999999999999e-05 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412006+0000", 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2661999999999999e-05 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412087+0000", 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.072e-05 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412286+0000", 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019964900000000001 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.413018+0000", 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000732199 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.414968+0000", 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00194908 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415019+0000", 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1039999999999999e-05 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415052+0000", 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3133000000000003e-05 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.236 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:386 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.751413612, 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003049118, 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 386 2024-04-17T15:37:32.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427154+0000", 2024-04-17T15:37:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9800000000000002e-07 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427159+0000", 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3000000000000001e-06 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427171+0000", 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2079000000000001e-05 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427177+0000", 2024-04-17T15:37:32.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8649999999999998e-06 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427229+0000", 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2132999999999997e-05 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427333+0000", 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010389499999999999 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427500+0000", 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016634899999999999 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.428068+0000", 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000568115 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430137+0000", 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020691070000000002 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430172+0000", 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5556000000000003e-05 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430202+0000", 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9720999999999999e-05 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.633452370000001, 2024-04-17T15:37:32.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:37:32.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:37:32.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.614265345, 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.248 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:37:32.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:37:32.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:37:32.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:37:32.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:680 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.533365815, 2024-04-17T15:37:32.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031880879999999999, 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 680 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645203+0000", 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.514e-06 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645216+0000", 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3103e-05 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645252+0000", 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5549000000000001e-05 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645277+0000", 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4827000000000001e-05 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645447+0000", 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170347 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645826+0000", 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037859999999999999 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.646397+0000", 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057096999999999996 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.647773+0000", 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013760490000000001 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648242+0000", 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046900300000000001 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648326+0000", 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4320000000000006e-05 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648389+0000", 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2805999999999995e-05 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.259 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.432160109000002, 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032633940000000002, 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 733 2024-04-17T15:37:32.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746409+0000", 2024-04-17T15:37:32.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.96e-06 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746425+0000", 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5296000000000001e-05 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746458+0000", 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2913000000000001e-05 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746473+0000", 2024-04-17T15:37:32.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5147000000000001e-05 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746625+0000", 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015230199999999999 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746850+0000", 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022539899999999999 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.747194+0000", 2024-04-17T15:37:32.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034325399999999998 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.748282+0000", 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010885789999999999 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749525+0000", 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001242251 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749604+0000", 2024-04-17T15:37:32.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9110000000000007e-05 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749670+0000", 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6183e-05 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.388519935000001, 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035370559999999998, 2024-04-17T15:37:32.265 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 751 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790049+0000", 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1670000000000002e-06 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790060+0000", 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1446e-05 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790089+0000", 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8517000000000002e-05 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790103+0000", 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4103e-05 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790256+0000", 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152886 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790624+0000", 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000367804 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.791205+0000", 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058173199999999995 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.792657+0000", 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014521429999999999 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793312+0000", 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00065417600000000002 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793469+0000", 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000157503 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793584+0000", 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114579 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.270 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.383787404, 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032316369999999999, 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 753 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.271 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794781+0000", 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2359999999999999e-06 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794793+0000", 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.154e-05 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794825+0000", 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2236000000000001e-05 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794840+0000", 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5316999999999999e-05 2024-04-17T15:37:32.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794966+0000", 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012540899999999999 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795214+0000", 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024765900000000001 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795682+0000", 2024-04-17T15:37:32.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046803600000000002 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.796961+0000", 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012796909999999999 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797850+0000", 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088859699999999998 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797941+0000", 2024-04-17T15:37:32.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0836999999999998e-05 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.798011+0000", 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0079000000000004e-05 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.277810048999999, 2024-04-17T15:37:32.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029866200000000002, 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 796 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900759+0000", 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.193e-06 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900772+0000", 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3016999999999999e-05 2024-04-17T15:37:32.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900803+0000", 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1279999999999999e-05 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900818+0000", 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4620000000000001e-05 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900943+0000", 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012558900000000001 2024-04-17T15:37:32.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901172+0000", 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022883199999999999 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901518+0000", 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034601100000000002 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.902651+0000", 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011331620000000001 2024-04-17T15:37:32.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903590+0000", 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000938487 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903677+0000", 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7035999999999998e-05 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903743+0000", 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6392999999999999e-05 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.281 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 25.959748425000001, 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029942160000000001, 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:32.282 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 931 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218821+0000", 2024-04-17T15:37:32.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.807e-06 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218835+0000", 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4523e-05 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218869+0000", 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3766000000000002e-05 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218895+0000", 2024-04-17T15:37:32.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5993999999999999e-05 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219037+0000", 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014219499999999999 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219265+0000", 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022758899999999999 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219640+0000", 2024-04-17T15:37:32.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037543100000000002 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.220951+0000", 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013106509999999999 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221627+0000", 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00067609099999999997 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:32.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221713+0000", 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5470000000000007e-05 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221812+0000", 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9698999999999995e-05 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:32.287 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:32.288 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:32.178+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:32.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:32.290 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:32.287+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:32.331 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:32.331 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:32.344 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:32.361 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:32.362 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:32.391 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:32.391+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:32.399 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:32.420 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:32.440 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:32.453 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:32.454 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:32.461 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:32.461 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:32.469 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:32.491 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:32.491+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:32.593 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:32.594+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:32.651 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:32.667 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:32.694 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:32.691+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:32.795 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:32.794+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:32.838 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:32.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:32.897 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:32.898+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:32.997 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:32.995+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:33.040 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:33.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:33.098 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:33.095+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:33.187 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:33.199 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:33.198+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:33.202 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:33.300 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:33.299+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:33.379 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:33.395 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:33.400 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:33.398+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:33.501 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:33.502+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:33.529 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:33.529 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:33.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:33.602 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:33.602+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:33.662 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:33.662 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:33.677 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:33.724 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:33.723+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:33.803 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:33.802+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:33.804 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:33.804 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:33.819 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:33.912 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:33.911+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:33.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:37:33.988 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:33.988 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:34.002 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:34.044 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:34.043+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:34.106 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:34.106+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:34.174 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:34.174 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:34.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:34.207 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:34.206+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:34.309 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:34.307+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:34.321 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:34.321 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:34.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:34.410 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:34.410+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:34.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:34.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:34.529 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:34.530+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:34.613 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:34.611+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:34.640 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:34.640 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:34.642 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:34.642 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:34.654 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:34.659 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:34.678 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:34.678 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:34.696 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:34.696 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:34.713 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:34.714+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:34.714 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:34.714 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:34.732 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:34.732 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:34.751 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:34.769 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:34.770 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:34.814 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:34.811+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:34.823 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:34.823 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:34.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:34.823 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:34.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.823 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.574119089, 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:37:34.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.830 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.542148783000002, 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:37:34.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:37:34.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:37:34.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:37:34.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.524812767, 2024-04-17T15:37:34.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:37:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:37:34.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.842 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.522278125, 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:37:34.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:37:34.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.421724500000003, 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.849 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:37:34.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.528659770000001, 2024-04-17T15:37:34.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:34.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:37:34.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:37:34.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:37:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:37:34.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.859 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.505527075, 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:37:34.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:37:34.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:37:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:37:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:37:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:37:34.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.465293589000002, 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:37:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:34.871 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.410759558999999, 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:37:34.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:37:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.389977937000001, 2024-04-17T15:37:34.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:37:34.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.389566748, 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:37:34.881 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:37:34.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:37:34.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:37:34.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:37:34.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.387175343999999, 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.891 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.387077285, 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:37:34.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:37:34.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:37:34.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.384371457, 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.351635916999999, 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.900 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:37:34.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:37:34.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:37:34.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.342615758000001, 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.904 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.338000410999999, 2024-04-17T15:37:34.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.328607178999999, 2024-04-17T15:37:34.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:37:34.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:37:34.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:34.916 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.295264484, 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:37:34.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:37:34.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:37:34.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.920 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.235504715000001, 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:34.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:34.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:34.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:34.924 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:34.925 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:34.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:34.927 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:34.926+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:35.026 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:35.026+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:35.097 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:35.097 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:35.113 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:35.159 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:35.159+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:35.228 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:35.227+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:35.239 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:35.239 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:35.239 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:35.254 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:35.325 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:37:35.339 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:35.339+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:35.421 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:35.421 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:35.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:35.421 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:35.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.347361198999998, 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:37:35.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:37:35.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:37:35.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:35.427 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.065263211999998, 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.065091058, 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.434 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.439 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.065052227999999, 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.440 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:37:35.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:37:35.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:37:35.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.445 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.855636038, 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:37:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.855574554999997, 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.855367977, 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.457 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:37:35.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:37:35.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:37:35.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.855328028000002, 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.463 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:37:35.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:37:35.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:37:35.468 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.855289104999997, 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.469 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.474 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.855089522999997, 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:37:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:37:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:37:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:37:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:37:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:37:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:37:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.855044290999999, 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:37:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:37:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628978912999997, 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:37:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628855203999997, 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:37:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628754049000001, 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:37:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:37:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:37:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628730832999999, 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:37:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628709422999997, 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:37:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:37:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:37:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628603458999997, 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:37:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:37:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628578758000003, 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:37:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628557741000002, 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:37:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:37:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.628443216999997, 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:37:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:37:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:35.541 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:35.542 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:35.539+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:35.543 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:35.643 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:35.642+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:35.682 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:35.682 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:35.682 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:35.682 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:35.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:35.785 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:35.786+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:35.845 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:35.846+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:35.866 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:35.866 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:35.866 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:35.866 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:35.866 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:35.881 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:35.969 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:35.970+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:36.047 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:36.046+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:36.061 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:36.061 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.725996354000003, 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.062 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:37:36.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:37:36.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:37:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.724672495999997, 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:37:36.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.699466157000003, 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:37:36.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:37:36.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:37:36.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:37:36.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.697294868999997, 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:37:36.078 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:37:36.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:37:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.695801998999997, 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.694242252999999, 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.087 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:37:36.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:37:36.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.691744536999998, 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:37:36.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.690123214000003, 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:37:36.096 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:37:36.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:37:36.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.100 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.486335746000002, 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.104 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.75041753, 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:37:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:37:36.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.778467446000001, 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.111 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:37:36.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:36.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.116 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.759500404000001, 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:37:36.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.122 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.729528761000001, 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:37:36.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:37:36.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:36.128 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.714315057, 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:37:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:37:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.684916479999998, 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:37:36.134 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:37:36.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.667417535999999, 2024-04-17T15:37:36.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:37:36.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:36.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:36.146 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.611539800999999, 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:36.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:37:36.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.503102568999999, 2024-04-17T15:37:36.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:37:36.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:37:36.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:37:36.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.476599390000001, 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.158 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:37:36.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:37:36.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:37:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:37:36.163 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.62555791000000005, 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.164 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.170 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.170 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:36.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:36.172 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:36.171+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:36.272 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:36.274+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:36.359 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:36.359 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:36.359 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:36.359 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:36.373 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:36.374+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:36.374 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:36.474 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:36.474+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:36.548 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:36.548 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:36.548 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:36.548 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:36.549 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:36.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:36.575 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:36.571+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:36.676 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:36.675+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:36.753 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.481914031000002, 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030313720000000001, 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.754 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 38 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269545+0000", 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2670000000000001e-06 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269558+0000", 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3053e-05 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269589+0000", 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1276999999999999e-05 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269605+0000", 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6076e-05 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269741+0000", 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135131 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269958+0000", 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021726100000000001 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.270212+0000", 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000253918 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.271337+0000", 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011256980000000001 2024-04-17T15:37:36.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272406+0000", 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001068575 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272504+0000", 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7790999999999999e-05 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272574+0000", 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0325000000000002e-05 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.469228295999997, 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.760 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:37:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:37:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.462610650000002, 2024-04-17T15:37:36.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.768 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.462273011000001, 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.773 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:60 7.9 e27/26 7:93e5b521:::notify.7:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.444190523000003, 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003055341, 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307268+0000", 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.463e-06 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307278+0000", 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307326+0000", 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8736999999999998e-05 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307347+0000", 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1053999999999999e-05 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307468+0000", 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120353 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307504+0000", 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6426e-05 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310218+0000", 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027133840000000001 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310322+0000", 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010407 2024-04-17T15:37:36.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.346208060000002, 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033104499999999999, 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 193 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405251+0000", 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405263+0000", 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1673e-05 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405294+0000", 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1537e-05 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405311+0000", 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6478999999999999e-05 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405428+0000", 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011737 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405628+0000", 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019951800000000001 2024-04-17T15:37:36.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405892+0000", 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026415500000000002 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.407420+0000", 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015283129999999999 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408374+0000", 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0009544 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408478+0000", 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010396200000000001 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408559+0000", 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0820000000000002e-05 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.462857930999999, 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:37:36.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:37:36.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.446387518000002, 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033682500000000002, 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 212 2024-04-17T15:37:36.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305072+0000", 2024-04-17T15:37:36.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305083+0000", 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1517e-05 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305112+0000", 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8486000000000001e-05 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305126+0000", 2024-04-17T15:37:36.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4487e-05 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305251+0000", 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124599 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305451+0000", 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020034499999999999 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305839+0000", 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038760800000000001 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.307390+0000", 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015517459999999999 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308276+0000", 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088547699999999997 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308364+0000", 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8619e-05 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308438+0000", 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3133000000000006e-05 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.795 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.420161852, 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033421330000000002, 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 219 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331298+0000", 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4589999999999998e-06 2024-04-17T15:37:36.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331311+0000", 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2257e-05 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331343+0000", 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2156000000000002e-05 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331358+0000", 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5252999999999999e-05 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331474+0000", 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011544600000000001 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331700+0000", 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000226102 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.332161+0000", 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046111699999999998 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.333471+0000", 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001310741 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334479+0000", 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010074629999999999 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334565+0000", 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6093000000000004e-05 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334637+0000", 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2045999999999994e-05 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.801 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.401815134, 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032014919999999998, 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 224 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349644+0000", 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349655+0000", 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0764000000000001e-05 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349687+0000", 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2085999999999997e-05 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349702+0000", 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349889+0000", 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698599999999999 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350092+0000", 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020369100000000001 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350514+0000", 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042112699999999998 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.351874+0000", 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013607910000000001 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352690+0000", 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081600800000000001 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352776+0000", 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6119000000000007e-05 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352843+0000", 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.669e-05 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:318 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.339539458000001, 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031343450000000002, 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 318 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411918+0000", 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0869999999999999e-06 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411938+0000", 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9788000000000001e-05 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411952+0000", 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4066000000000001e-05 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411963+0000", 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0920999999999999e-05 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412006+0000", 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2661999999999999e-05 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412087+0000", 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.072e-05 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412286+0000", 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019964900000000001 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.413018+0000", 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000732199 2024-04-17T15:37:36.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.414968+0000", 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00194908 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415019+0000", 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1039999999999999e-05 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415052+0000", 2024-04-17T15:37:36.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3133000000000003e-05 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:386 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.324303867000001, 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003049118, 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.813 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 386 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:36.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427154+0000", 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9800000000000002e-07 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427159+0000", 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3000000000000001e-06 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427171+0000", 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2079000000000001e-05 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427177+0000", 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8649999999999998e-06 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427229+0000", 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2132999999999997e-05 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427333+0000", 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010389499999999999 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427500+0000", 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016634899999999999 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.428068+0000", 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000568115 2024-04-17T15:37:36.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430137+0000", 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020691070000000002 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430172+0000", 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5556000000000003e-05 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430202+0000", 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9720999999999999e-05 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.206342625000001, 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.819 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:36.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.824 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.187155600000001, 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.825 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:680 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.106256070000001, 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031880879999999999, 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 680 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645203+0000", 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.514e-06 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645216+0000", 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3103e-05 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645252+0000", 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5549000000000001e-05 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645277+0000", 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4827000000000001e-05 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645447+0000", 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170347 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645826+0000", 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037859999999999999 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.646397+0000", 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057096999999999996 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.647773+0000", 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013760490000000001 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648242+0000", 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046900300000000001 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648326+0000", 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4320000000000006e-05 2024-04-17T15:37:36.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648389+0000", 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2805999999999995e-05 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.005050363999999, 2024-04-17T15:37:36.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032633940000000002, 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 733 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746409+0000", 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.96e-06 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746425+0000", 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5296000000000001e-05 2024-04-17T15:37:36.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746458+0000", 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2913000000000001e-05 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746473+0000", 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5147000000000001e-05 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746625+0000", 2024-04-17T15:37:36.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015230199999999999 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746850+0000", 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022539899999999999 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.747194+0000", 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034325399999999998 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.748282+0000", 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010885789999999999 2024-04-17T15:37:36.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749525+0000", 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001242251 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749604+0000", 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9110000000000007e-05 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749670+0000", 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6183e-05 2024-04-17T15:37:36.841 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.961410189999999, 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035370559999999998, 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.842 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 751 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:36.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790049+0000", 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1670000000000002e-06 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790060+0000", 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1446e-05 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790089+0000", 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8517000000000002e-05 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790103+0000", 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4103e-05 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790256+0000", 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152886 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790624+0000", 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000367804 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.791205+0000", 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058173199999999995 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.792657+0000", 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014521429999999999 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793312+0000", 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00065417600000000002 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793469+0000", 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000157503 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793584+0000", 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114579 2024-04-17T15:37:36.849 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.956677659, 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032316369999999999, 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 753 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794781+0000", 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2359999999999999e-06 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794793+0000", 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.154e-05 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794825+0000", 2024-04-17T15:37:36.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2236000000000001e-05 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794840+0000", 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5316999999999999e-05 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794966+0000", 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012540899999999999 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795214+0000", 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024765900000000001 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795682+0000", 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046803600000000002 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.796961+0000", 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012796909999999999 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797850+0000", 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088859699999999998 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797941+0000", 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0836999999999998e-05 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.798011+0000", 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0079000000000004e-05 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.855 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.850700304, 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029866200000000002, 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 796 2024-04-17T15:37:36.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900759+0000", 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.193e-06 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900772+0000", 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3016999999999999e-05 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900803+0000", 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1279999999999999e-05 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900818+0000", 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4620000000000001e-05 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900943+0000", 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012558900000000001 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901172+0000", 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022883199999999999 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901518+0000", 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034601100000000002 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.902651+0000", 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011331620000000001 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903590+0000", 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000938487 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903677+0000", 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7035999999999998e-05 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903743+0000", 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6392999999999999e-05 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:36.861 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 30.532638680000002, 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029942160000000001, 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 931 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:36.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218821+0000", 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.807e-06 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:36.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218835+0000", 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4523e-05 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218869+0000", 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3766000000000002e-05 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218895+0000", 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5993999999999999e-05 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219037+0000", 2024-04-17T15:37:36.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014219499999999999 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219265+0000", 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022758899999999999 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219640+0000", 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037543100000000002 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:36.865 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.220951+0000", 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013106509999999999 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221627+0000", 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00067609099999999997 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221713+0000", 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5470000000000007e-05 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221812+0000", 2024-04-17T15:37:36.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9698999999999995e-05 2024-04-17T15:37:36.867 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.867 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.867 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.867 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:36.867 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:36.867 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:36.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:36.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:36.869 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:36.870+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:36.969 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:36.967+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:37.054 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:37.054 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:37.054 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:37.054 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:37.066 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:37.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:37.070 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:37.070+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:37.084 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:37.100 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:37.100 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:37.117 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:37.117 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:37.138 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:37.139 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:37.159 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:37.159 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:37.171 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:37.170+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:37.180 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:37.198 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:37.198 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:37.200 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:37.201 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:37.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:37.272 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:37.271+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:37.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:37:37.372 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:37.371+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:37.388 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:37.388 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:37.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:37.497 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:37.498+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:37.574 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:37.574+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:37.578 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:37.578 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:37.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:37.681 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:37.682+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:37.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:37.776 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:37.779+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:37.877 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:37.879+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:37.947 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:37.948 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:37.961 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:38.008 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:38.007+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:38.080 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:38.079+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:38.095 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:38.096 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:38.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:38.180 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:38.178+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:38.281 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:38.282+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:38.286 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:38.287 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:38.299 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:38.337 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:37:38.382 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:38.379+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:38.421 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:38.421 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:38.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:38.482 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:38.482+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:38.583 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:38.582+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:38.605 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:38.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:38.683 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:38.683+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:38.738 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:38.738 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:38.754 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:38.795 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:38.795+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:38.885 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:38.886+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:38.923 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:38.924 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:38.942 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:38.987 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:38.987+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:39.068 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:39.068 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:39.082 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:39.087 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:39.086+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:39.187 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:39.187+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:39.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:39.256 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:39.257 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:39.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:39.288 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:39.286+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:39.382 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:39.382 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:39.388 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:39.387+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:39.399 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:39.415 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:39.434 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:39.434 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:39.445 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:39.445 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:39.453 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:39.461 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:39.472 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:39.473 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:39.494 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:39.503 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:39.503+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:39.514 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:39.514 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:39.590 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:39.587+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:39.632 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:39.632 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:39.633 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:39.633 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:39.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:39.691 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:39.690+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:39.791 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:39.790+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:39.811 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:39.812 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:39.812 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:37:39.812 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:37:39.812 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:39.827 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:39.893 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:39.891+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:39.957 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:39.957 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:39.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:39.957 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.883317564999999, 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:37:39.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:39.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:39.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:39.964 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.601219577999998, 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:39.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:37:39.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:39.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.601047424000001, 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:39.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:37:39.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:37:39.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:37:39.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.601008594, 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:39.977 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:39.982 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.391592404000001, 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:39.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:39.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:39.988 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.391530920999998, 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:39.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:37:39.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:37:39.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:37:39.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:37:39.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.391324343000001, 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:39.994 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:39.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:37:39.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:37:39.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:37:39.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:39.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.391284394000003, 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.391245470999998, 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.005 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:40.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:37:40.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:37:40.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:37:40.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.391045888999997, 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:37:40.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.391000656999999, 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164935278999998, 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:37:40.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164811569999998, 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.033 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164710415000002, 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:37:40.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:40.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164687198999999, 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:40.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:37:40.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164665788999997, 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.045 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:37:40.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:37:40.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:37:40.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164559824999998, 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.051 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:37:40.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:37:40.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:40.056 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164535123999997, 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:37:40.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:37:40.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:37:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:37:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164514107000002, 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:37:40.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:37:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.164399582999998, 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:40.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:40.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:37:40.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:37:40.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.073 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:40.073 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:40.073 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:40.074 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:40.075 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:40.074+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:40.175 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:40.174+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:40.219 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:40.220 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:40.220 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:40.220 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:40.235 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:40.277 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:40.275+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:40.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:37:40.407 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:40.408 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:40.408 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:40.408 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:40.408 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:40.408 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:40.406+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:40.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:40.509 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:40.510+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:40.579 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:40.579+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:40.590 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:40.590 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:40.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:40.590 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:40.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.590 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:37:40.590 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.257500315000001, 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:37:40.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:40.595 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.256176457000002, 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:37:40.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.230970118000002, 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:37:40.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.604 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.228798830000002, 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:37:40.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:37:40.609 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.227305960000002, 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:37:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.225746213999997, 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.614 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:37:40.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:37:40.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:40.618 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.223248497999997, 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.221627175000002, 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.623 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:37:40.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:37:40.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:37:40.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:37:40.627 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.017839707, 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.631 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.281921490999999, 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:37:40.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:37:40.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:40.637 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.309971406999999, 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:40.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:37:40.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.291004364999999, 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.643 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:37:40.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.261032722000003, 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.649 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:37:40.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:37:40.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:37:40.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.245819017999999, 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:37:40.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:37:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.660 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.216420440999997, 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:37:40.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:40.666 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.198921497000001, 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:37:40.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:37:40.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:37:40.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.143043761999998, 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:37:40.672 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:37:40.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.034606529999998, 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.678 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:40.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:37:40.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.683 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.008103351000003, 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.684 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:37:40.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:37:40.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:37:40.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.1570618709999998, 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:37:40.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:37:40.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:37:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:37:40.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:40.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:37:40.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:37:40.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:40.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:40.696 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:40.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:40.698 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:40.698+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:40.798 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:40.795+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:40.877 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:40.878 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:40.878 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:40.878 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:40.893 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:40.941 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:40.942+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:41.000 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:40.999+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:41.028 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:41.029 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:41.029 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:41.029 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:41.029 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:41.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:41.100 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:41.099+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:41.201 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:41.199+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:41.217 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 42.943389510999999, 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030313720000000001, 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.218 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 38 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:41.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269545+0000", 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2670000000000001e-06 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269558+0000", 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3053e-05 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269589+0000", 2024-04-17T15:37:41.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1276999999999999e-05 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269605+0000", 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6076e-05 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269741+0000", 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135131 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269958+0000", 2024-04-17T15:37:41.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021726100000000001 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.270212+0000", 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000253918 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.271337+0000", 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011256980000000001 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272406+0000", 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001068575 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272504+0000", 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7790999999999999e-05 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272574+0000", 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0325000000000002e-05 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.223 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.930703776000001, 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:41.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:37:41.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:37:41.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:37:41.227 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.924086129999999, 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:37:41.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:37:41.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:37:41.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.923748490999998, 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.233 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.237 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:60 7.9 e27/26 7:93e5b521:::notify.7:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.905666003, 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003055341, 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307268+0000", 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.463e-06 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307278+0000", 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307326+0000", 2024-04-17T15:37:41.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8736999999999998e-05 2024-04-17T15:37:41.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307347+0000", 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1053999999999999e-05 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307468+0000", 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120353 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307504+0000", 2024-04-17T15:37:41.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6426e-05 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310218+0000", 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027133840000000001 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310322+0000", 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010407 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.807683539999999, 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033104499999999999, 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 193 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405251+0000", 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405263+0000", 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1673e-05 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405294+0000", 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1537e-05 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405311+0000", 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6478999999999999e-05 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405428+0000", 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011737 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405628+0000", 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019951800000000001 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405892+0000", 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026415500000000002 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.407420+0000", 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015283129999999999 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408374+0000", 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0009544 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408478+0000", 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010396200000000001 2024-04-17T15:37:41.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408559+0000", 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0820000000000002e-05 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.924333410999999, 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.248 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.253 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.907862997999999, 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033682500000000002, 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.254 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 212 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305072+0000", 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305083+0000", 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1517e-05 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305112+0000", 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8486000000000001e-05 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305126+0000", 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4487e-05 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305251+0000", 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124599 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305451+0000", 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020034499999999999 2024-04-17T15:37:41.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305839+0000", 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038760800000000001 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.307390+0000", 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015517459999999999 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308276+0000", 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088547699999999997 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308364+0000", 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8619e-05 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308438+0000", 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3133000000000006e-05 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.881637331999997, 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033421330000000002, 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 219 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.260 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331298+0000", 2024-04-17T15:37:41.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4589999999999998e-06 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331311+0000", 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2257e-05 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331343+0000", 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2156000000000002e-05 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331358+0000", 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5252999999999999e-05 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331474+0000", 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011544600000000001 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331700+0000", 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000226102 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.332161+0000", 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046111699999999998 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.333471+0000", 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001310741 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334479+0000", 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010074629999999999 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334565+0000", 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6093000000000004e-05 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334637+0000", 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2045999999999994e-05 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:41.265 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.863290614, 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032014919999999998, 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 224 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:41.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349644+0000", 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:37:41.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349655+0000", 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0764000000000001e-05 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349687+0000", 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2085999999999997e-05 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349702+0000", 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349889+0000", 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698599999999999 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350092+0000", 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020369100000000001 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350514+0000", 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042112699999999998 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.351874+0000", 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013607910000000001 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352690+0000", 2024-04-17T15:37:41.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081600800000000001 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352776+0000", 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6119000000000007e-05 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352843+0000", 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.669e-05 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:318 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.801014938000002, 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031343450000000002, 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 318 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.272 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411918+0000", 2024-04-17T15:37:41.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0869999999999999e-06 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411938+0000", 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9788000000000001e-05 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411952+0000", 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4066000000000001e-05 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411963+0000", 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0920999999999999e-05 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412006+0000", 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2661999999999999e-05 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412087+0000", 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.072e-05 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412286+0000", 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019964900000000001 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.413018+0000", 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000732199 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.414968+0000", 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00194908 2024-04-17T15:37:41.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415019+0000", 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1039999999999999e-05 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415052+0000", 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3133000000000003e-05 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:386 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.785779347000002, 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003049118, 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.278 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 386 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427154+0000", 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9800000000000002e-07 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427159+0000", 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3000000000000001e-06 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427171+0000", 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2079000000000001e-05 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427177+0000", 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8649999999999998e-06 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427229+0000", 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2132999999999997e-05 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427333+0000", 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010389499999999999 2024-04-17T15:37:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427500+0000", 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016634899999999999 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.428068+0000", 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000568115 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430137+0000", 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020691070000000002 2024-04-17T15:37:41.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430172+0000", 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5556000000000003e-05 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430202+0000", 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9720999999999999e-05 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.667818105000002, 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:37:41.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:37:41.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.648631080000001, 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:37:41.289 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:37:41.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:37:41.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:37:41.294 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:680 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.567731549999998, 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031880879999999999, 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.295 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 680 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645203+0000", 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.514e-06 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645216+0000", 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3103e-05 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645252+0000", 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5549000000000001e-05 2024-04-17T15:37:41.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645277+0000", 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4827000000000001e-05 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645447+0000", 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170347 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645826+0000", 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037859999999999999 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.646397+0000", 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057096999999999996 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.647773+0000", 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013760490000000001 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648242+0000", 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046900300000000001 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648326+0000", 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4320000000000006e-05 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648389+0000", 2024-04-17T15:37:41.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2805999999999995e-05 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.466525844000003, 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032633940000000002, 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.301 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 733 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746409+0000", 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.96e-06 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746425+0000", 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5296000000000001e-05 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746458+0000", 2024-04-17T15:37:41.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2913000000000001e-05 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746473+0000", 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5147000000000001e-05 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746625+0000", 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015230199999999999 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746850+0000", 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022539899999999999 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.747194+0000", 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034325399999999998 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.748282+0000", 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010885789999999999 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749525+0000", 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001242251 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749604+0000", 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9110000000000007e-05 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749670+0000", 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6183e-05 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.306 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.422885669999999, 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035370559999999998, 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 751 2024-04-17T15:37:41.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790049+0000", 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1670000000000002e-06 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790060+0000", 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1446e-05 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790089+0000", 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8517000000000002e-05 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790103+0000", 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4103e-05 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790256+0000", 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152886 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790624+0000", 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000367804 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.791205+0000", 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058173199999999995 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.792657+0000", 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014521429999999999 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793312+0000", 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00065417600000000002 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793469+0000", 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000157503 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793584+0000", 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114579 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:41.312 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.418153138999998, 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032316369999999999, 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 753 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:41.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794781+0000", 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2359999999999999e-06 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794793+0000", 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.154e-05 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794825+0000", 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2236000000000001e-05 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794840+0000", 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5316999999999999e-05 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794966+0000", 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012540899999999999 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795214+0000", 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024765900000000001 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795682+0000", 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046803600000000002 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.796961+0000", 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012796909999999999 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797850+0000", 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088859699999999998 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797941+0000", 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0836999999999998e-05 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.798011+0000", 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0079000000000004e-05 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.312175783999997, 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029866200000000002, 2024-04-17T15:37:41.318 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 796 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900759+0000", 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.193e-06 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900772+0000", 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3016999999999999e-05 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900803+0000", 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1279999999999999e-05 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900818+0000", 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4620000000000001e-05 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900943+0000", 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012558900000000001 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901172+0000", 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022883199999999999 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901518+0000", 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034601100000000002 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.902651+0000", 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011331620000000001 2024-04-17T15:37:41.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903590+0000", 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000938487 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903677+0000", 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7035999999999998e-05 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903743+0000", 2024-04-17T15:37:41.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6392999999999999e-05 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.994114160000002, 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029942160000000001, 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:41.324 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 931 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:41.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218821+0000", 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.807e-06 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218835+0000", 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4523e-05 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218869+0000", 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3766000000000002e-05 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218895+0000", 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5993999999999999e-05 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219037+0000", 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014219499999999999 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219265+0000", 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022758899999999999 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219640+0000", 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037543100000000002 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.220951+0000", 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013106509999999999 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221627+0000", 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00067609099999999997 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221713+0000", 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5470000000000007e-05 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221812+0000", 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9698999999999995e-05 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:41.329 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:41.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:41.332 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:41.327+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:41.332 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:37:41.433 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:41.431+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:41.464 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:41.465 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:41.465 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:41.465 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:41.479 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:41.533 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:41.531+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:41.533 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:41.610 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:41.610 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:41.610 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:41.610 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:41.610 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:41.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:41.634 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:41.631+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:41.676 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:41.677 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:41.693 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:41.694 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:41.712 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:41.712 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:41.729 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:41.735 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:41.731+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:41.749 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:41.749 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:41.750 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:41.751 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:41.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:41.772 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:41.772 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:41.794 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:41.794 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:41.815 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:41.815 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:41.835 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:41.835+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:41.884 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:41.885 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:41.899 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:41.945 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:41.946+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:42.029 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:42.029 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:42.037 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:42.035+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:42.044 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:42.138 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:42.138+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:42.217 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:42.218 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:42.232 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:42.277 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:42.278+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:42.340 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:42.338+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:42.370 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:42.371 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:42.385 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:42.441 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:42.442+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:42.511 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:42.512 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:42.526 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:42.541 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:42.542+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:42.642 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:42.639+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:42.652 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:42.652 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:42.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:42.759 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:42.759+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:42.844 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:42.844 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:42.844 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:42.843+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:42.858 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:42.946 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:42.943+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:43.027 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:43.027 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:43.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:43.083 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:43.083+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:43.147 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:43.147+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:43.203 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:43.203 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:43.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:43.248 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:43.250+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:43.349 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:43.347+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:43.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:37:43.381 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:43.381 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:43.396 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:43.450 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:43.450+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:43.551 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:43.551+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:43.566 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:43.566 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:43.581 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:43.652 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:43.654+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:43.751 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:43.751 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:43.753 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:43.751+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:43.763 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:37:43.769 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:43.835 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:43.881 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:43.882+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:43.932 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:43.933 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:43.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:43.983 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:43.984 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:43.995 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:43.995+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:44.000 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:44.000 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:44.016 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:44.016 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:44.032 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:44.052 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:44.055 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:44.054+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:44.074 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:44.075 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:44.076 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:44.076 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:44.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:44.095 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:44.095 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:44.115 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:44.115 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:44.183 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:44.183+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:44.257 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:44.255+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:44.268 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:37:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:37:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.193995198000003, 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:37:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:37:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:37:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:37:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:37:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:37:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.911897211000003, 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:37:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:37:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:37:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:37:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.911725056999998, 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.911686226999997, 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:37:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.702270036999998, 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:37:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:37:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.702208554000002, 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:37:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:37:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:37:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:37:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.702001975999998, 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:37:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:37:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:37:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:37:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:37:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:37:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:37:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:37:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:37:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:37:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:37:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:37:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:37:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:37:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:37:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:37:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.701962027, 2024-04-17T15:37:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:37:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:37:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:37:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:37:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:37:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:37:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:37:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:37:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:37:44.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:37:44.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:37:44.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:37:44.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:37:44.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:37:44.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:37:44.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:37:44.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:37:44.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:37:44.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:37:44.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:37:44.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:37:44.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:37:44.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:37:44.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:37:44.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:37:44.329 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.330 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.330 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.330 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.331 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:44.331 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.701923104000002, 2024-04-17T15:37:44.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:37:44.331 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.331 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.331 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.332 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:37:44.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.332 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:44.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:37:44.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:37:44.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:37:44.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:37:44.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:37:44.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.701723522000002, 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.339 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:37:44.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:37:44.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:37:44.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.701678289999997, 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:37:44.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:37:44.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.475612912000003, 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:37:44.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:37:44.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.475489203000002, 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.356 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:44.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:37:44.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.361 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.475388047999999, 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.362 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.367 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.475364831999997, 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:44.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:37:44.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:37:44.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:37:44.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:37:44.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.475343422000002, 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.373 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.378 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.475237458000002, 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:44.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:37:44.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:37:44.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:37:44.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.475212757000001, 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.384 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:37:44.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:37:44.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:37:44.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.389 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.47519174, 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.475077216000003, 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:37:44.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:37:44.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:37:44.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:37:44.400 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:44.402 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:44.399+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:44.402 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:44.503 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:44.499+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:44.537 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:44.537 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:44.537 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:44.537 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:44.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:44.603 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:44.602+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:44.679 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:44.679 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:44.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:44.741 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:44.742+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.545731361000001, 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.879 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.880 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.881 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:44.883 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.544407503000002, 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:37:44.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:37:44.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:37:44.887 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.519201164000002, 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:44.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:44.892 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.517029876000002, 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:37:44.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:37:44.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.515537006000002, 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:37:44.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:37:44.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:37:44.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.513977259999997, 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:37:44.901 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:44.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.905 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.511479543999997, 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:37:44.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:37:44.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.509858221000002, 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:44.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:37:44.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:37:44.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:37:44.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.306070753, 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:37:44.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:37:44.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 42.570152536999998, 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.919 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:37:44.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:44.924 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.598202452999999, 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:37:44.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:37:44.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.929 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.579235410999999, 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:37:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:37:44.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:37:44.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:44.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.935 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.549263768000003, 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:37:44.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:37:44.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:37:44.940 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.534050063999999, 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.941 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:37:44.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:37:44.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:37:44.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.504651486999997, 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:37:44.946 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:37:44.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:37:44.951 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.487152543000001, 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.952 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:37:44.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.431274807999998, 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.958 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.959 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.959 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.961 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:37:44.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.961 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:37:44.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:44.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:44.966 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.322837575999998, 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:37:44.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:37:44.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.296334397000003, 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.972 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:37:44.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.4452929169999997, 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:37:44.978 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:37:44.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:37:44.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:44.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:44.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:44.984 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:44.985 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:44.875+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:44.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:44.986 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:44.987+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:45.087 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:45.083+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:45.166 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:45.166 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:45.166 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:45.166 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:45.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:45.188 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:45.187+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:45.289 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:45.290+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:45.313 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:45.313 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:45.313 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:45.313 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:45.314 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:45.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:45.417 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:45.418+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:45.490 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:45.490+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:45.498 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:45.498 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:45.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:45.498 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:45.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.227100512, 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030313720000000001, 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 38 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269545+0000", 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2670000000000001e-06 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269558+0000", 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3053e-05 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269589+0000", 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1276999999999999e-05 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269605+0000", 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6076e-05 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269741+0000", 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135131 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269958+0000", 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021726100000000001 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.270212+0000", 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000253918 2024-04-17T15:37:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.271337+0000", 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011256980000000001 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272406+0000", 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001068575 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272504+0000", 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7790999999999999e-05 2024-04-17T15:37:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272574+0000", 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0325000000000002e-05 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.214414777000002, 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:37:45.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:37:45.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:37:45.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.207797131, 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:37:45.508 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.207459491999998, 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.513 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:60 7.9 e27/26 7:93e5b521:::notify.7:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.189377004000001, 2024-04-17T15:37:45.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003055341, 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307268+0000", 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.463e-06 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307278+0000", 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307326+0000", 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8736999999999998e-05 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307347+0000", 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1053999999999999e-05 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307468+0000", 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120353 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307504+0000", 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6426e-05 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310218+0000", 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027133840000000001 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310322+0000", 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010407 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:45.521 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.091394541, 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033104499999999999, 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 193 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405251+0000", 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405263+0000", 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1673e-05 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405294+0000", 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1537e-05 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405311+0000", 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6478999999999999e-05 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405428+0000", 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011737 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405628+0000", 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019951800000000001 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405892+0000", 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026415500000000002 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.407420+0000", 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015283129999999999 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408374+0000", 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0009544 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408478+0000", 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010396200000000001 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408559+0000", 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0820000000000002e-05 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.526 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.208044412, 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:45.532 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.191573998999999, 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033682500000000002, 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 212 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305072+0000", 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305083+0000", 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1517e-05 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305112+0000", 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8486000000000001e-05 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305126+0000", 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4487e-05 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305251+0000", 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124599 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305451+0000", 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020034499999999999 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305839+0000", 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038760800000000001 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.307390+0000", 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015517459999999999 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308276+0000", 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088547699999999997 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308364+0000", 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8619e-05 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308438+0000", 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3133000000000006e-05 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.165348332999997, 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033421330000000002, 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.538 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 219 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331298+0000", 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4589999999999998e-06 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331311+0000", 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2257e-05 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331343+0000", 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2156000000000002e-05 2024-04-17T15:37:45.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331358+0000", 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5252999999999999e-05 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331474+0000", 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011544600000000001 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331700+0000", 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000226102 2024-04-17T15:37:45.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.332161+0000", 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046111699999999998 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.333471+0000", 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001310741 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334479+0000", 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010074629999999999 2024-04-17T15:37:45.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334565+0000", 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6093000000000004e-05 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334637+0000", 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2045999999999994e-05 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.147001615000001, 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032014919999999998, 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 224 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349644+0000", 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349655+0000", 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0764000000000001e-05 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349687+0000", 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2085999999999997e-05 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349702+0000", 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349889+0000", 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698599999999999 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350092+0000", 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020369100000000001 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350514+0000", 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042112699999999998 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.351874+0000", 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013607910000000001 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352690+0000", 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081600800000000001 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352776+0000", 2024-04-17T15:37:45.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6119000000000007e-05 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352843+0000", 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.669e-05 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:318 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.084725939000002, 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031343450000000002, 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.549 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 318 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411918+0000", 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0869999999999999e-06 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411938+0000", 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9788000000000001e-05 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411952+0000", 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4066000000000001e-05 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411963+0000", 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0920999999999999e-05 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412006+0000", 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2661999999999999e-05 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412087+0000", 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.072e-05 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412286+0000", 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019964900000000001 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.413018+0000", 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000732199 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.414968+0000", 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00194908 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415019+0000", 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1039999999999999e-05 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415052+0000", 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3133000000000003e-05 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:386 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.069490348000002, 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003049118, 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 386 2024-04-17T15:37:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427154+0000", 2024-04-17T15:37:45.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9800000000000002e-07 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427159+0000", 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3000000000000001e-06 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427171+0000", 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2079000000000001e-05 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427177+0000", 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8649999999999998e-06 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427229+0000", 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2132999999999997e-05 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427333+0000", 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010389499999999999 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427500+0000", 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016634899999999999 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.428068+0000", 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000568115 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430137+0000", 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020691070000000002 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430172+0000", 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5556000000000003e-05 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430202+0000", 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9720999999999999e-05 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:45.560 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.951529106000002, 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:37:45.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:37:45.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:37:45.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.932342081000002, 2024-04-17T15:37:45.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:37:45.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:37:45.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:680 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.851442550999998, 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031880879999999999, 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.572 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 680 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645203+0000", 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.514e-06 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645216+0000", 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3103e-05 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645252+0000", 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5549000000000001e-05 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645277+0000", 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4827000000000001e-05 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645447+0000", 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170347 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645826+0000", 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037859999999999999 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.646397+0000", 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057096999999999996 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.647773+0000", 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013760490000000001 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648242+0000", 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046900300000000001 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648326+0000", 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4320000000000006e-05 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648389+0000", 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2805999999999995e-05 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:45.577 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.750236845000003, 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032633940000000002, 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 733 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746409+0000", 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.96e-06 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746425+0000", 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5296000000000001e-05 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746458+0000", 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2913000000000001e-05 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746473+0000", 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5147000000000001e-05 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746625+0000", 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015230199999999999 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746850+0000", 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022539899999999999 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.747194+0000", 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034325399999999998 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.748282+0000", 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010885789999999999 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749525+0000", 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001242251 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749604+0000", 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9110000000000007e-05 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749670+0000", 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6183e-05 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.706596671, 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035370559999999998, 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 751 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790049+0000", 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1670000000000002e-06 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790060+0000", 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1446e-05 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790089+0000", 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8517000000000002e-05 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790103+0000", 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4103e-05 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790256+0000", 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152886 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790624+0000", 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000367804 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.791205+0000", 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058173199999999995 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.792657+0000", 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014521429999999999 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793312+0000", 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00065417600000000002 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793469+0000", 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000157503 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793584+0000", 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114579 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:45.588 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.701864139999998, 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032316369999999999, 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 753 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794781+0000", 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2359999999999999e-06 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794793+0000", 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.154e-05 2024-04-17T15:37:45.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794825+0000", 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2236000000000001e-05 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794840+0000", 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5316999999999999e-05 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794966+0000", 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012540899999999999 2024-04-17T15:37:45.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795214+0000", 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024765900000000001 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795682+0000", 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046803600000000002 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.796961+0000", 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012796909999999999 2024-04-17T15:37:45.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797850+0000", 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088859699999999998 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797941+0000", 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0836999999999998e-05 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.798011+0000", 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0079000000000004e-05 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.593 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.595886784999998, 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029866200000000002, 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 796 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900759+0000", 2024-04-17T15:37:45.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.193e-06 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900772+0000", 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3016999999999999e-05 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900803+0000", 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1279999999999999e-05 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900818+0000", 2024-04-17T15:37:45.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4620000000000001e-05 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900943+0000", 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012558900000000001 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901172+0000", 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022883199999999999 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:45.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901518+0000", 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034601100000000002 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.902651+0000", 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011331620000000001 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903590+0000", 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000938487 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903677+0000", 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7035999999999998e-05 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903743+0000", 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6392999999999999e-05 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:45.599 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.277825161000003, 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029942160000000001, 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 931 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218821+0000", 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.807e-06 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218835+0000", 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4523e-05 2024-04-17T15:37:45.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218869+0000", 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3766000000000002e-05 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218895+0000", 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5993999999999999e-05 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219037+0000", 2024-04-17T15:37:45.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014219499999999999 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219265+0000", 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022758899999999999 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219640+0000", 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037543100000000002 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:45.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.220951+0000", 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013106509999999999 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221627+0000", 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00067609099999999997 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221713+0000", 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5470000000000007e-05 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:45.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221812+0000", 2024-04-17T15:37:45.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9698999999999995e-05 2024-04-17T15:37:45.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.605 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:45.605 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:45.605 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:45.606 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:45.607 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:45.606+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:45.707 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:45.707+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:45.782 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:45.782 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:45.782 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:45.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:37:45.796 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:45.845 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:45.846+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:45.909 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:45.907+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:45.967 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:45.967 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:45.967 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:45.967 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:45.967 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:45.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:46.024 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:46.026+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:46.103 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:46.103 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.822106335000001, 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030098299999999998, 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:46.104 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 42 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280322+0000", 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6360000000000001e-06 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280344+0000", 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1710000000000001e-05 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280367+0000", 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2646e-05 2024-04-17T15:37:46.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280380+0000", 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3574000000000001e-05 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280494+0000", 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114288 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280703+0000", 2024-04-17T15:37:46.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000208805 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280947+0000", 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024378799999999999 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.282418+0000", 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014711030000000001 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283224+0000", 2024-04-17T15:37:46.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00080576599999999997 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283286+0000", 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1921999999999994e-05 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283330+0000", 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4592000000000003e-05 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.807752188999999, 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003461703, 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 52 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.110 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294678+0000", 2024-04-17T15:37:46.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.92e-06 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294691+0000", 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3244999999999999e-05 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294739+0000", 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7778999999999998e-05 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294753+0000", 2024-04-17T15:37:46.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4297999999999999e-05 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294857+0000", 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104107 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295108+0000", 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025097299999999998 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:46.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295309+0000", 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020123600000000001 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297594+0000", 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002284379 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297987+0000", 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039364100000000002 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298068+0000", 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1001999999999995e-05 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298136+0000", 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8122999999999998e-05 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:57 7.3 e27/26 7:c609908c:::notify.5:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:46.115 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.797670334999999, 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003535472, 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304759+0000", 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304773+0000", 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.396e-05 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304796+0000", 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3961999999999999e-05 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304813+0000", 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6086000000000002e-05 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304947+0000", 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013435899999999999 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304991+0000", 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4221000000000002e-05 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308226+0000", 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032346190000000002 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308292+0000", 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6282e-05 2024-04-17T15:37:46.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:59 7.14 e27/26 7:2b04a3e9:::notify.6:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.795204579, 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033715469999999999, 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307224+0000", 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6169999999999999e-06 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307235+0000", 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1408e-05 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307269+0000", 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3442999999999998e-05 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307290+0000", 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1353999999999999e-05 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307413+0000", 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000122865 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307452+0000", 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9387000000000001e-05 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310518+0000", 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030657919999999999 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310594+0000", 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5680999999999996e-05 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.709409229000002, 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034483930000000001, 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.124 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 236 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393020+0000", 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7669999999999999e-06 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393034+0000", 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3073e-05 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393065+0000", 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1860000000000003e-05 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393082+0000", 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6855999999999999e-05 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393221+0000", 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013827300000000001 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393434+0000", 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021370199999999999 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393850+0000", 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041539700000000002 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.395194+0000", 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001344121 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396313+0000", 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011190180000000001 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396398+0000", 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5393e-05 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396466+0000", 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7933000000000002e-05 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.129 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.696370776999998, 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002805929, 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 280 2024-04-17T15:37:46.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406057+0000", 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.203e-06 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406063+0000", 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9610000000000002e-06 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406075+0000", 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1714e-05 2024-04-17T15:37:46.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406082+0000", 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5220000000000004e-06 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406136+0000", 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4211e-05 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406231+0000", 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4871999999999996e-05 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406377+0000", 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146448 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.407079+0000", 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000701639 2024-04-17T15:37:46.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408771+0000", 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001692432 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408820+0000", 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9289999999999997e-05 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408862+0000", 2024-04-17T15:37:46.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1637000000000001e-05 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:697 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.442948459999997, 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002810561, 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.136 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 697 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659480+0000", 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4759999999999999e-06 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659488+0000", 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1710000000000002e-06 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659509+0000", 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0718000000000001e-05 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659525+0000", 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5894999999999999e-05 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659651+0000", 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012638300000000001 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659781+0000", 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013031300000000001 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.660036+0000", 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025453599999999998 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.661296+0000", 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001260331 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662138+0000", 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084126399999999999 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662208+0000", 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0188e-05 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662289+0000", 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.141 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.334620368000003, 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029789930000000001, 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 742 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767809+0000", 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7329999999999999e-06 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767822+0000", 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2663999999999999e-05 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767854+0000", 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1875999999999998e-05 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767869+0000", 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768001+0000", 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013243900000000001 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768229+0000", 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022790500000000001 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768575+0000", 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034550800000000001 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.769817+0000", 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012425019999999999 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770633+0000", 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081610700000000005 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770720+0000", 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6682999999999997e-05 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770786+0000", 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5525999999999996e-05 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.289207412000003, 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029893189999999998, 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 760 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813222+0000", 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-06 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813233+0000", 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1703e-05 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813266+0000", 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2772999999999999e-05 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813289+0000", 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2337e-05 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813434+0000", 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014584400000000001 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813598+0000", 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000163752 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813883+0000", 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000285087 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.815043+0000", 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011595819999999999 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816059+0000", 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010158459999999999 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816148+0000", 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9553000000000001e-05 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816209+0000", 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0585999999999999e-05 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.285249983, 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030744029999999999, 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 762 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.153 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817179+0000", 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-06 2024-04-17T15:37:46.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817190+0000", 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1090000000000001e-05 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817225+0000", 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5129999999999997e-05 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817244+0000", 2024-04-17T15:37:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9029999999999999e-05 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817379+0000", 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000134475 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817606+0000", 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022773199999999999 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.818089+0000", 2024-04-17T15:37:46.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048282400000000002 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.819375+0000", 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012861680000000001 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820098+0000", 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000722841 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820184+0000", 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5500000000000005e-05 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820251+0000", 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7613000000000005e-05 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:46.158 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.153181211000003, 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029764269999999998, 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 817 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949248+0000", 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4099999999999998e-06 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949264+0000", 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6364000000000001e-05 2024-04-17T15:37:46.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949296+0000", 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1513000000000001e-05 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949317+0000", 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1403000000000002e-05 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949509+0000", 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019130500000000001 2024-04-17T15:37:46.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949747+0000", 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000238039 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.950063+0000", 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031621399999999999 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.951228+0000", 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001165379 2024-04-17T15:37:46.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952068+0000", 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000839674 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952156+0000", 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8313000000000006e-05 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952222+0000", 2024-04-17T15:37:46.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5813000000000002e-05 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.149244551000002, 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029501589999999999, 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 819 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953184+0000", 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.973e-06 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953198+0000", 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3657e-05 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953229+0000", 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1486000000000003e-05 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953248+0000", 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187000000000001e-05 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953356+0000", 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107909 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953484+0000", 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012820600000000001 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953773+0000", 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028948800000000002 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.954862+0000", 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001088365 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.955975+0000", 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001113326 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956061+0000", 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6470000000000004e-05 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956133+0000", 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1092000000000003e-05 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.169 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.097890399999997, 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029884, 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 841 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.170 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004539+0000", 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2630000000000002e-06 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004551+0000", 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2680000000000001e-05 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004582+0000", 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0700000000000001e-05 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004597+0000", 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.501e-05 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004732+0000", 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013490900000000001 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004956+0000", 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022391800000000001 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.005298+0000", 2024-04-17T15:37:46.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034173100000000001 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.006602+0000", 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013043810000000001 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007387+0000", 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000784635 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007467+0000", 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0661999999999994e-05 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007525+0000", 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7510999999999999e-05 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:46.175 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.082968256999997, 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031389679999999998, 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 847 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:46.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019461+0000", 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.277e-06 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019472+0000", 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1319e-05 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019503+0000", 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0626999999999997e-05 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019517+0000", 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019652+0000", 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013442799999999999 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019977+0000", 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032536300000000001 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.020521+0000", 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00054383700000000003 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.021843+0000", 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001321593 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022433+0000", 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058991600000000001 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022517+0000", 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4845999999999994e-05 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022598+0000", 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0185999999999994e-05 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.034009216000001, 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034503820000000001, 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.181 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 868 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068420+0000", 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1330000000000002e-06 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068432+0000", 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2646000000000001e-05 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068463+0000", 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0170000000000001e-05 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068477+0000", 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4797000000000001e-05 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068645+0000", 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016787200000000001 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068999+0000", 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035414099999999998 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.069565+0000", 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056531599999999995 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.070818+0000", 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001252932 2024-04-17T15:37:46.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071707+0000", 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088886 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071793+0000", 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6885999999999994e-05 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071868+0000", 2024-04-17T15:37:46.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4629000000000007e-05 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.941362834000003, 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030204519999999999, 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 907 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161067+0000", 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4329999999999998e-06 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161077+0000", 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0910000000000001e-05 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161109+0000", 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1288999999999998e-05 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161123+0000", 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4739999999999999e-05 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161242+0000", 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011889 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161468+0000", 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022609099999999999 2024-04-17T15:37:46.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161805+0000", 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612099999999999 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.162878+0000", 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001073606 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.163928+0000", 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00104958 2024-04-17T15:37:46.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164017+0000", 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9284999999999996e-05 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164085+0000", 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7507000000000003e-05 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.840586389000002, 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003409006, 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 949 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261844+0000", 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.993e-06 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261857+0000", 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261902+0000", 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5286e-05 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261926+0000", 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3757e-05 2024-04-17T15:37:46.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262112+0000", 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018562900000000001 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262494+0000", 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038215999999999999 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262901+0000", 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040692000000000001 2024-04-17T15:37:46.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.264939+0000", 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020382400000000002 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265106+0000", 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016660500000000001 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265187+0000", 2024-04-17T15:37:46.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265250+0000", 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2063000000000005e-05 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.836286895999997, 2024-04-17T15:37:46.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032687240000000002, 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 951 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266142+0000", 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6640000000000001e-06 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266151+0000", 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5829999999999996e-06 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266177+0000", 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.55e-05 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266189+0000", 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2139e-05 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266301+0000", 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011170700000000001 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266418+0000", 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117599 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266690+0000", 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027164099999999998 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.268256+0000", 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001565842 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269168+0000", 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00091194099999999999 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269297+0000", 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012897900000000001 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269409+0000", 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112129 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.203 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.825483220999999, 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030567260000000001, 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 955 2024-04-17T15:37:46.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276946+0000", 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6139999999999999e-06 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276959+0000", 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.279e-05 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276992+0000", 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2981999999999997e-05 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277008+0000", 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6127e-05 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277162+0000", 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015356199999999999 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277427+0000", 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026516799999999998 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277784+0000", 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035701500000000002 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279283+0000", 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499479 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279849+0000", 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056583000000000002 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279935+0000", 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5649000000000006e-05 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280000+0000", 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5510000000000001e-05 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 39.821504619000002, 2024-04-17T15:37:46.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028646269999999998, 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 957 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280924+0000", 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.894e-06 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:46.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280934+0000", 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6299999999999993e-06 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280960+0000", 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280986+0000", 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5913000000000001e-05 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281095+0000", 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109212 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281215+0000", 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120469 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281472+0000", 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025682199999999997 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.282766+0000", 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001293521 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283642+0000", 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087648000000000001 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283727+0000", 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4874000000000001e-05 2024-04-17T15:37:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283787+0000", 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9892000000000002e-05 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:46.215 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:46.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:46.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:37:46.218 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:46.218+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:46.317 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:46.318+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:46.397 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:46.397 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:46.397 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:46.397 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:46.412 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:46.413 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:46.431 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:46.432 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:46.432 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:46.430+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:46.450 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:46.450 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:46.468 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:46.468 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:46.490 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:46.490 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:46.512 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:46.512 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:46.519 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:46.518+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:46.533 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:46.533 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:46.542 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:46.542 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:46.554 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:46.554 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:46.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:46.661 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:46.662+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:46.721 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:46.719+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:46.733 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:46.734 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:46.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:46.822 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:46.822+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:46.885 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:46.885 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:46.899 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:46.924 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:46.921+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:47.025 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:47.023+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:47.025 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:47.025 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:47.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:47.127 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:47.127+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:47.213 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:47.213 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:47.226 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:47.223+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:47.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:47.328 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:47.327+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:47.401 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:47.401 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:47.415 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:47.429 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:47.429+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:47.530 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:47.529+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:47.587 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:47.587 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:47.601 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:47.631 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:47.629+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:47.729 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:47.730 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:47.732 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:47.729+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:47.744 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:47.833 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:47.833+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:47.871 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:47.872 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:47.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:47.934 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:47.931+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:48.004 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:48.004 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:48.019 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:48.035 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:48.033+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:48.136 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:48.135+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:48.187 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:48.187 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:48.202 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:48.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:37:48.264 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:48.265+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:48.338 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:48.335+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:48.371 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:48.371 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:48.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:48.471 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:48.471+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:48.541 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:48.538+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:48.555 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:48.555 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:48.569 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:48.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:48.641 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:48.641+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:48.725 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:48.725 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:48.740 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:48.740 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:48.742 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:48.742 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:48.743 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:48.738+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:48.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:48.758 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:48.759 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:48.776 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:48.797 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:48.797 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:48.816 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:48.817 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:48.838 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:48.843 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:48.842+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:48.861 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:48.877 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:48.877 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:48.877 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:48.877 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:48.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:48.981 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:48.981+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:49.047 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:49.045+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:49.076 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:49.076 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:49.076 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:49.076 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:49.077 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:49.093 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:49.181 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:49.181+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:49.251 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:49.249+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:49.273 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:49.273 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:49.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:49.273 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:49.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.273 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:37:49.273 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.939765739999999, 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:37:49.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.938441881999999, 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:37:49.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.913235542999999, 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:49.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:37:49.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.911064254999999, 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:37:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:37:49.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.909571385, 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:49.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:37:49.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.908011639000001, 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:49.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.905513923000001, 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:37:49.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:37:49.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.308 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.903892599999999, 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:37:49.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:37:49.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.700105131999997, 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:49.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:37:49.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 46.964186916000003, 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.319 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:37:49.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.992236832000003, 2024-04-17T15:37:49.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:37:49.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:37:49.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:37:49.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.973269790000003, 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.332 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:37:49.338 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.943298147, 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.339 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:37:49.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.345 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.928084443000003, 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:37:49.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:37:49.351 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.352 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.352 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.898685866000001, 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:37:49.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:37:49.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:37:49.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.360 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.881186921999998, 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.361 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:37:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:37:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.825309187000002, 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:37:49.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.369 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:49.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:37:49.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:37:49.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.716871955000002, 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.375 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:37:49.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:37:49.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.381 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.690368776, 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:37:49.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:37:49.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.839327296, 2024-04-17T15:37:49.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:49.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:37:49.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:49.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.394 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.395 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.395 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:49.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:37:49.398 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:49.394+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:49.497 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:49.497+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:49.582 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:49.583 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:49.583 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:49.583 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:49.598 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:49.598 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:49.594+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:49.699 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:49.694+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:49.774 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:49.774 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:49.774 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:49.774 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:49.774 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:49.788 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:49.834 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:49.833+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:49.900 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:49.901+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.651850138, 2024-04-17T15:37:49.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030313720000000001, 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 38 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269545+0000", 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2670000000000001e-06 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269558+0000", 2024-04-17T15:37:49.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3053e-05 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269589+0000", 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1276999999999999e-05 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269605+0000", 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6076e-05 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269741+0000", 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135131 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269958+0000", 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021726100000000001 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.270212+0000", 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000253918 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.271337+0000", 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011256980000000001 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272406+0000", 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001068575 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272504+0000", 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7790999999999999e-05 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272574+0000", 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0325000000000002e-05 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.639164403000002, 2024-04-17T15:37:49.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:49.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:37:49.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:37:49.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.632546757, 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:49.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:37:49.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:49.938 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.632209117999999, 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:37:49.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:60 7.9 e27/26 7:93e5b521:::notify.7:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.614126630000001, 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003055341, 2024-04-17T15:37:49.943 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.944 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.944 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.944 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:49.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:49.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307268+0000", 2024-04-17T15:37:49.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.463e-06 2024-04-17T15:37:49.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307278+0000", 2024-04-17T15:37:49.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:37:49.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307326+0000", 2024-04-17T15:37:49.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8736999999999998e-05 2024-04-17T15:37:49.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307347+0000", 2024-04-17T15:37:49.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1053999999999999e-05 2024-04-17T15:37:49.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307468+0000", 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120353 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307504+0000", 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6426e-05 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310218+0000", 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027133840000000001 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310322+0000", 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010407 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:49.950 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.516144167, 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033104499999999999, 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 193 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405251+0000", 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405263+0000", 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1673e-05 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405294+0000", 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1537e-05 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405311+0000", 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6478999999999999e-05 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405428+0000", 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011737 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405628+0000", 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019951800000000001 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405892+0000", 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026415500000000002 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.407420+0000", 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015283129999999999 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408374+0000", 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0009544 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408478+0000", 2024-04-17T15:37:49.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010396200000000001 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408559+0000", 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0820000000000002e-05 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.632794038, 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:37:49.956 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:37:49.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.616323625, 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033682500000000002, 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.962 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 212 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305072+0000", 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305083+0000", 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1517e-05 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305112+0000", 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8486000000000001e-05 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305126+0000", 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4487e-05 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305251+0000", 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124599 2024-04-17T15:37:49.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305451+0000", 2024-04-17T15:37:49.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020034499999999999 2024-04-17T15:37:49.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:49.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305839+0000", 2024-04-17T15:37:49.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038760800000000001 2024-04-17T15:37:49.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.307390+0000", 2024-04-17T15:37:49.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015517459999999999 2024-04-17T15:37:49.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308276+0000", 2024-04-17T15:37:49.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088547699999999997 2024-04-17T15:37:49.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308364+0000", 2024-04-17T15:37:49.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8619e-05 2024-04-17T15:37:49.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308438+0000", 2024-04-17T15:37:49.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3133000000000006e-05 2024-04-17T15:37:49.970 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.970 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.970 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.973 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.974 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:49.974 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.590097958999998, 2024-04-17T15:37:49.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033421330000000002, 2024-04-17T15:37:49.974 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.974 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.974 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.975 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 219 2024-04-17T15:37:49.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.975 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:49.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:49.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331298+0000", 2024-04-17T15:37:49.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4589999999999998e-06 2024-04-17T15:37:49.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331311+0000", 2024-04-17T15:37:49.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2257e-05 2024-04-17T15:37:49.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331343+0000", 2024-04-17T15:37:49.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2156000000000002e-05 2024-04-17T15:37:49.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331358+0000", 2024-04-17T15:37:49.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5252999999999999e-05 2024-04-17T15:37:49.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331474+0000", 2024-04-17T15:37:49.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011544600000000001 2024-04-17T15:37:49.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331700+0000", 2024-04-17T15:37:49.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000226102 2024-04-17T15:37:49.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:49.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.332161+0000", 2024-04-17T15:37:49.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046111699999999998 2024-04-17T15:37:49.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.333471+0000", 2024-04-17T15:37:49.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001310741 2024-04-17T15:37:49.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:49.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334479+0000", 2024-04-17T15:37:49.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010074629999999999 2024-04-17T15:37:49.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:49.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334565+0000", 2024-04-17T15:37:49.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6093000000000004e-05 2024-04-17T15:37:49.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:49.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334637+0000", 2024-04-17T15:37:49.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2045999999999994e-05 2024-04-17T15:37:49.987 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.987 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:49.987 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:49.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.987 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:49.988 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:49.988 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.571751241000001, 2024-04-17T15:37:49.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032014919999999998, 2024-04-17T15:37:49.988 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:49.988 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:49.988 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:49.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:49.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:49.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:49.989 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 224 2024-04-17T15:37:49.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.989 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:49.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:49.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:49.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:49.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:49.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:49.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:49.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349644+0000", 2024-04-17T15:37:49.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:37:49.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:49.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349655+0000", 2024-04-17T15:37:49.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0764000000000001e-05 2024-04-17T15:37:49.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:49.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349687+0000", 2024-04-17T15:37:49.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2085999999999997e-05 2024-04-17T15:37:49.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:49.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349702+0000", 2024-04-17T15:37:49.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:49.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:49.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349889+0000", 2024-04-17T15:37:49.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698599999999999 2024-04-17T15:37:49.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:49.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350092+0000", 2024-04-17T15:37:49.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020369100000000001 2024-04-17T15:37:49.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:49.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350514+0000", 2024-04-17T15:37:49.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042112699999999998 2024-04-17T15:37:49.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:49.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:49.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:49.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.351874+0000", 2024-04-17T15:37:49.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013607910000000001 2024-04-17T15:37:50.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352690+0000", 2024-04-17T15:37:50.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081600800000000001 2024-04-17T15:37:50.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352776+0000", 2024-04-17T15:37:50.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6119000000000007e-05 2024-04-17T15:37:50.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352843+0000", 2024-04-17T15:37:50.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.669e-05 2024-04-17T15:37:50.002 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.003 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.003 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.003 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:318 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.003 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:50.004 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.509475565000002, 2024-04-17T15:37:50.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031343450000000002, 2024-04-17T15:37:50.004 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.004 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.004 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.005 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 318 2024-04-17T15:37:50.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.005 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:50.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:50.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411918+0000", 2024-04-17T15:37:50.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0869999999999999e-06 2024-04-17T15:37:50.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411938+0000", 2024-04-17T15:37:50.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9788000000000001e-05 2024-04-17T15:37:50.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411952+0000", 2024-04-17T15:37:50.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4066000000000001e-05 2024-04-17T15:37:50.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411963+0000", 2024-04-17T15:37:50.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0920999999999999e-05 2024-04-17T15:37:50.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412006+0000", 2024-04-17T15:37:50.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2661999999999999e-05 2024-04-17T15:37:50.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412087+0000", 2024-04-17T15:37:50.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.072e-05 2024-04-17T15:37:50.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:50.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412286+0000", 2024-04-17T15:37:50.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019964900000000001 2024-04-17T15:37:50.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.413018+0000", 2024-04-17T15:37:50.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000732199 2024-04-17T15:37:50.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.414968+0000", 2024-04-17T15:37:50.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00194908 2024-04-17T15:37:50.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415019+0000", 2024-04-17T15:37:50.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1039999999999999e-05 2024-04-17T15:37:50.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415052+0000", 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3133000000000003e-05 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:386 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.494239974000003, 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003049118, 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.017 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 386 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427154+0000", 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9800000000000002e-07 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427159+0000", 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3000000000000001e-06 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427171+0000", 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2079000000000001e-05 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427177+0000", 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8649999999999998e-06 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427229+0000", 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2132999999999997e-05 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427333+0000", 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010389499999999999 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427500+0000", 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016634899999999999 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.428068+0000", 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000568115 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430137+0000", 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020691070000000002 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430172+0000", 2024-04-17T15:37:50.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5556000000000003e-05 2024-04-17T15:37:50.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430202+0000", 2024-04-17T15:37:50.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9720999999999999e-05 2024-04-17T15:37:50.022 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.023 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.023 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.023 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:50.023 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.376278732000003, 2024-04-17T15:37:50.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:37:50.024 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.024 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.024 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.024 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.024 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.024 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.024 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:37:50.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.025 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:50.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:50.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:37:50.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:37:50.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:37:50.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:37:50.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:37:50.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:37:50.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:37:50.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.357091707000002, 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:37:50.034 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:37:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:37:50.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:37:50.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:680 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.276192176999999, 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031880879999999999, 2024-04-17T15:37:50.040 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 680 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645203+0000", 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.514e-06 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645216+0000", 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3103e-05 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645252+0000", 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5549000000000001e-05 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645277+0000", 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4827000000000001e-05 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645447+0000", 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170347 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645826+0000", 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037859999999999999 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.646397+0000", 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057096999999999996 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.647773+0000", 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013760490000000001 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648242+0000", 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046900300000000001 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648326+0000", 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4320000000000006e-05 2024-04-17T15:37:50.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648389+0000", 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2805999999999995e-05 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.174986470999997, 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032633940000000002, 2024-04-17T15:37:50.046 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 733 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746409+0000", 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.96e-06 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746425+0000", 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5296000000000001e-05 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746458+0000", 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2913000000000001e-05 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746473+0000", 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5147000000000001e-05 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746625+0000", 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015230199999999999 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746850+0000", 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022539899999999999 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.747194+0000", 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034325399999999998 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.748282+0000", 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010885789999999999 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749525+0000", 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001242251 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749604+0000", 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9110000000000007e-05 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749670+0000", 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6183e-05 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.131346297, 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035370559999999998, 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.052 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 751 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790049+0000", 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1670000000000002e-06 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790060+0000", 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1446e-05 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790089+0000", 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8517000000000002e-05 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790103+0000", 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4103e-05 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790256+0000", 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152886 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790624+0000", 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000367804 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.791205+0000", 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058173199999999995 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.792657+0000", 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014521429999999999 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793312+0000", 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00065417600000000002 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793469+0000", 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000157503 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793584+0000", 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114579 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.126613765999998, 2024-04-17T15:37:50.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032316369999999999, 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 753 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794781+0000", 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2359999999999999e-06 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794793+0000", 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.154e-05 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794825+0000", 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2236000000000001e-05 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794840+0000", 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5316999999999999e-05 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794966+0000", 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012540899999999999 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795214+0000", 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024765900000000001 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795682+0000", 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046803600000000002 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.796961+0000", 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012796909999999999 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797850+0000", 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088859699999999998 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797941+0000", 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0836999999999998e-05 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.798011+0000", 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0079000000000004e-05 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.020636410999998, 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029866200000000002, 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 796 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900759+0000", 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.193e-06 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900772+0000", 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3016999999999999e-05 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900803+0000", 2024-04-17T15:37:50.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1279999999999999e-05 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900818+0000", 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4620000000000001e-05 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900943+0000", 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012558900000000001 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901172+0000", 2024-04-17T15:37:50.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022883199999999999 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901518+0000", 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034601100000000002 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.902651+0000", 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011331620000000001 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903590+0000", 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000938487 2024-04-17T15:37:50.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903677+0000", 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7035999999999998e-05 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903743+0000", 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6392999999999999e-05 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.068 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.702574787000003, 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029942160000000001, 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 931 2024-04-17T15:37:50.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218821+0000", 2024-04-17T15:37:50.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.807e-06 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218835+0000", 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4523e-05 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218869+0000", 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3766000000000002e-05 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218895+0000", 2024-04-17T15:37:50.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5993999999999999e-05 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219037+0000", 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014219499999999999 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219265+0000", 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022758899999999999 2024-04-17T15:37:50.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219640+0000", 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037543100000000002 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.220951+0000", 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013106509999999999 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221627+0000", 2024-04-17T15:37:50.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00067609099999999997 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221713+0000", 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5470000000000007e-05 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221812+0000", 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9698999999999995e-05 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.074 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.075 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:50.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:50.076 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:50.073+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:50.176 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:50.177+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:50.253 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:50.253 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:50.254 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:50.254 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:50.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:50.278 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:50.274+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:50.379 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:50.377+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:50.437 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:50.438 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:50.438 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:50.438 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:50.438 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:50.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:50.480 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:50.478+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:50.581 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:50.581+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.340318916999998, 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030098299999999998, 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.623 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 42 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280322+0000", 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6360000000000001e-06 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280344+0000", 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1710000000000001e-05 2024-04-17T15:37:50.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280367+0000", 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2646e-05 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280380+0000", 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3574000000000001e-05 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280494+0000", 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114288 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280703+0000", 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000208805 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280947+0000", 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024378799999999999 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.282418+0000", 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014711030000000001 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283224+0000", 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00080576599999999997 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283286+0000", 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1921999999999994e-05 2024-04-17T15:37:50.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283330+0000", 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4592000000000003e-05 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.325964771000002, 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003461703, 2024-04-17T15:37:50.629 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 52 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294678+0000", 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.92e-06 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294691+0000", 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3244999999999999e-05 2024-04-17T15:37:50.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294739+0000", 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7778999999999998e-05 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294753+0000", 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4297999999999999e-05 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294857+0000", 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104107 2024-04-17T15:37:50.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295108+0000", 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025097299999999998 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295309+0000", 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020123600000000001 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297594+0000", 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002284379 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297987+0000", 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039364100000000002 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298068+0000", 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1001999999999995e-05 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298136+0000", 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8122999999999998e-05 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:57 7.3 e27/26 7:c609908c:::notify.5:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.315882917000003, 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003535472, 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304759+0000", 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304773+0000", 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.396e-05 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304796+0000", 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3961999999999999e-05 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304813+0000", 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6086000000000002e-05 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304947+0000", 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013435899999999999 2024-04-17T15:37:50.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304991+0000", 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4221000000000002e-05 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308226+0000", 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032346190000000002 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308292+0000", 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6282e-05 2024-04-17T15:37:50.639 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:59 7.14 e27/26 7:2b04a3e9:::notify.6:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.313417160999997, 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033715469999999999, 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307224+0000", 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6169999999999999e-06 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307235+0000", 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1408e-05 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307269+0000", 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3442999999999998e-05 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307290+0000", 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1353999999999999e-05 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307413+0000", 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000122865 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307452+0000", 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9387000000000001e-05 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310518+0000", 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030657919999999999 2024-04-17T15:37:50.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310594+0000", 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5680999999999996e-05 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 45.227621810999999, 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034483930000000001, 2024-04-17T15:37:50.644 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 236 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393020+0000", 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7669999999999999e-06 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393034+0000", 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3073e-05 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393065+0000", 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1860000000000003e-05 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393082+0000", 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6855999999999999e-05 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393221+0000", 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013827300000000001 2024-04-17T15:37:50.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393434+0000", 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021370199999999999 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393850+0000", 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041539700000000002 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.395194+0000", 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001344121 2024-04-17T15:37:50.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396313+0000", 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011190180000000001 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396398+0000", 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5393e-05 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396466+0000", 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7933000000000002e-05 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 45.214583359000002, 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002805929, 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.650 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 280 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:50.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406057+0000", 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.203e-06 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406063+0000", 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9610000000000002e-06 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406075+0000", 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1714e-05 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406082+0000", 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5220000000000004e-06 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406136+0000", 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4211e-05 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406231+0000", 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4871999999999996e-05 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406377+0000", 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146448 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.407079+0000", 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000701639 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408771+0000", 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001692432 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408820+0000", 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9289999999999997e-05 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408862+0000", 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1637000000000001e-05 2024-04-17T15:37:50.655 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:697 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.961161042000001, 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002810561, 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.656 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 697 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659480+0000", 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4759999999999999e-06 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659488+0000", 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1710000000000002e-06 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659509+0000", 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0718000000000001e-05 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659525+0000", 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5894999999999999e-05 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659651+0000", 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012638300000000001 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659781+0000", 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013031300000000001 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.660036+0000", 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025453599999999998 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.661296+0000", 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001260331 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662138+0000", 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084126399999999999 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662208+0000", 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0188e-05 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662289+0000", 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.661 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.85283295, 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029789930000000001, 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 742 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:50.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767809+0000", 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7329999999999999e-06 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767822+0000", 2024-04-17T15:37:50.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2663999999999999e-05 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767854+0000", 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1875999999999998e-05 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767869+0000", 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768001+0000", 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013243900000000001 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768229+0000", 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022790500000000001 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768575+0000", 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034550800000000001 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.769817+0000", 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012425019999999999 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770633+0000", 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081610700000000005 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770720+0000", 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6682999999999997e-05 2024-04-17T15:37:50.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770786+0000", 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5525999999999996e-05 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.807419994, 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029893189999999998, 2024-04-17T15:37:50.667 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 760 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813222+0000", 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-06 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813233+0000", 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1703e-05 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813266+0000", 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2772999999999999e-05 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813289+0000", 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2337e-05 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813434+0000", 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014584400000000001 2024-04-17T15:37:50.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813598+0000", 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000163752 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813883+0000", 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000285087 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.815043+0000", 2024-04-17T15:37:50.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011595819999999999 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816059+0000", 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010158459999999999 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816148+0000", 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9553000000000001e-05 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816209+0000", 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0585999999999999e-05 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.803462564999997, 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030744029999999999, 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.673 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 762 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:50.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817179+0000", 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-06 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817190+0000", 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1090000000000001e-05 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817225+0000", 2024-04-17T15:37:50.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5129999999999997e-05 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817244+0000", 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9029999999999999e-05 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817379+0000", 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000134475 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817606+0000", 2024-04-17T15:37:50.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022773199999999999 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.818089+0000", 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048282400000000002 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.819375+0000", 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012861680000000001 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820098+0000", 2024-04-17T15:37:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000722841 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820184+0000", 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5500000000000005e-05 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820251+0000", 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7613000000000005e-05 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.678 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.671393793, 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029764269999999998, 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.679 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 817 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949248+0000", 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4099999999999998e-06 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949264+0000", 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6364000000000001e-05 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949296+0000", 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1513000000000001e-05 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949317+0000", 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1403000000000002e-05 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949509+0000", 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019130500000000001 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949747+0000", 2024-04-17T15:37:50.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000238039 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.950063+0000", 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031621399999999999 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.951228+0000", 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001165379 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952068+0000", 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000839674 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952156+0000", 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8313000000000006e-05 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952222+0000", 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5813000000000002e-05 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.667457132999999, 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029501589999999999, 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 819 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953184+0000", 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.973e-06 2024-04-17T15:37:50.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953198+0000", 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3657e-05 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953229+0000", 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1486000000000003e-05 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953248+0000", 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187000000000001e-05 2024-04-17T15:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953356+0000", 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107909 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953484+0000", 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012820600000000001 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:50.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953773+0000", 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028948800000000002 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.954862+0000", 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001088365 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.955975+0000", 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001113326 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956061+0000", 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6470000000000004e-05 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956133+0000", 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1092000000000003e-05 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.616102982000001, 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029884, 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 841 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004539+0000", 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2630000000000002e-06 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004551+0000", 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2680000000000001e-05 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004582+0000", 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0700000000000001e-05 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004597+0000", 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.501e-05 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004732+0000", 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013490900000000001 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004956+0000", 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022391800000000001 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.005298+0000", 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034173100000000001 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.006602+0000", 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013043810000000001 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007387+0000", 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000784635 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007467+0000", 2024-04-17T15:37:50.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0661999999999994e-05 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007525+0000", 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7510999999999999e-05 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.601180839000001, 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031389679999999998, 2024-04-17T15:37:50.696 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 847 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019461+0000", 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.277e-06 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019472+0000", 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1319e-05 2024-04-17T15:37:50.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019503+0000", 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0626999999999997e-05 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019517+0000", 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019652+0000", 2024-04-17T15:37:50.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013442799999999999 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019977+0000", 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032536300000000001 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.020521+0000", 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00054383700000000003 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.021843+0000", 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001321593 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022433+0000", 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058991600000000001 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022517+0000", 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4845999999999994e-05 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022598+0000", 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0185999999999994e-05 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.552221797999998, 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034503820000000001, 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.702 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 868 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068420+0000", 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1330000000000002e-06 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068432+0000", 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2646000000000001e-05 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068463+0000", 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0170000000000001e-05 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068477+0000", 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4797000000000001e-05 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068645+0000", 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016787200000000001 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068999+0000", 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035414099999999998 2024-04-17T15:37:50.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.069565+0000", 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056531599999999995 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.070818+0000", 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001252932 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071707+0000", 2024-04-17T15:37:50.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088886 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071793+0000", 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6885999999999994e-05 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071868+0000", 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4629000000000007e-05 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.707 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.459575416, 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030204519999999999, 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.708 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 907 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161067+0000", 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4329999999999998e-06 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161077+0000", 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0910000000000001e-05 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161109+0000", 2024-04-17T15:37:50.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1288999999999998e-05 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161123+0000", 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4739999999999999e-05 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161242+0000", 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011889 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161468+0000", 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022609099999999999 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161805+0000", 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612099999999999 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.162878+0000", 2024-04-17T15:37:50.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001073606 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.163928+0000", 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00104958 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164017+0000", 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9284999999999996e-05 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164085+0000", 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7507000000000003e-05 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.358798970999999, 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003409006, 2024-04-17T15:37:50.714 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 949 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261844+0000", 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.993e-06 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261857+0000", 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261902+0000", 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5286e-05 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261926+0000", 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3757e-05 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262112+0000", 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018562900000000001 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262494+0000", 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038215999999999999 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262901+0000", 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040692000000000001 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.264939+0000", 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020382400000000002 2024-04-17T15:37:50.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265106+0000", 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016660500000000001 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265187+0000", 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265250+0000", 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2063000000000005e-05 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.354499478000001, 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032687240000000002, 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.720 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 951 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266142+0000", 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6640000000000001e-06 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266151+0000", 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5829999999999996e-06 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266177+0000", 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.55e-05 2024-04-17T15:37:50.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266189+0000", 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2139e-05 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266301+0000", 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011170700000000001 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266418+0000", 2024-04-17T15:37:50.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117599 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266690+0000", 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027164099999999998 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.268256+0000", 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001565842 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269168+0000", 2024-04-17T15:37:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00091194099999999999 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269297+0000", 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012897900000000001 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269409+0000", 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112129 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.343695803000003, 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030567260000000001, 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 955 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276946+0000", 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6139999999999999e-06 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276959+0000", 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.279e-05 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276992+0000", 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2981999999999997e-05 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277008+0000", 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6127e-05 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277162+0000", 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015356199999999999 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277427+0000", 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026516799999999998 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277784+0000", 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035701500000000002 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279283+0000", 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499479 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279849+0000", 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056583000000000002 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279935+0000", 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5649000000000006e-05 2024-04-17T15:37:50.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280000+0000", 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5510000000000001e-05 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 44.339717200999999, 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028646269999999998, 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:50.731 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 957 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280924+0000", 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.894e-06 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280934+0000", 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6299999999999993e-06 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280960+0000", 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280986+0000", 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5913000000000001e-05 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281095+0000", 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109212 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281215+0000", 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120469 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281472+0000", 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025682199999999997 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.282766+0000", 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001293521 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283642+0000", 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087648000000000001 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283727+0000", 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4874000000000001e-05 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283787+0000", 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9892000000000002e-05 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.736 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.737 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.737 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:50.737 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:50.737 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:50.738 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:50.739 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:50.734+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:50.839 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:50.837+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:50.878 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:50.926 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:50.927 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:50.927 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:50.927 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:50.940 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:50.942+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:50.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:51.026 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:51.027 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:51.041 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:51.042+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:51.043 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:51.044 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:51.062 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:51.063 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:51.083 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:51.106 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:51.112 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:51.112 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:51.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:51.130 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:51.130 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:51.142 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:51.138+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:51.154 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:51.154 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:51.178 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:51.178 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:51.244 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:51.242+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:51.249 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:51.249 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:51.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:51.344 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:51.345+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:51.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:37:51.400 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:51.400 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:51.415 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:51.463 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:51.462+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:51.543 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:51.543 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:51.546 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:51.545+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:51.558 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:51.647 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:51.645+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:51.726 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:51.726 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:51.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:51.748 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:51.745+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:51.848 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:51.849+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:51.869 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:51.869 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:51.884 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:51.950 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:51.946+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:52.011 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:52.011 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:52.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:52.068 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:52.066+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:52.151 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:52.149+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:52.197 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:52.198 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:52.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:52.252 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:52.249+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:52.340 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:37:52.343 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:52.344 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:52.353 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:52.353+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:52.359 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:52.454 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:52.453+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:52.486 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:52.487 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:52.501 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:52.554 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:52.553+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:52.628 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:52.629 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:52.645 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:52.691 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:52.690+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:52.756 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:52.754+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:52.772 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:52.772 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:52.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:52.876 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:52.874+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:52.919 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-17T15:37:52.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-17T15:37:52.958 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:52.958 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:52.964 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:52.965+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:52.973 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:53.060 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:53.057+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:53.144 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:53.144 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:53.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:53.161 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:53.158+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:53.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:53.261 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:53.261+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:53.296 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:53.296 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:53.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:53.342 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-17T15:37:53.364 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:53.364 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:53.365 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:53.365+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:53.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-17T15:37:53.382 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:53.382 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:53.399 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:53.399 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:53.431 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:53.432 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:53.453 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:53.454 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:53.463 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:53.461+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:53.481 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:53.481 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:53.481 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:53.481 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:53.481 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:53.489 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:53.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:53.512 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:53.513 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:53.539 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:53.539 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:53.601 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:53.601+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.303410240000005, 2024-04-17T15:37:53.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.638 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.302086381999999, 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:37:53.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:37:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:37:53.642 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.276880043000006, 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.643 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:37:53.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:37:53.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.274708755000006, 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:37:53.648 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:37:53.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:37:53.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:37:53.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:37:53.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:37:53.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:37:53.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:37:53.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:37:53.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:37:53.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:53.654 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.273215884999999, 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:37:53.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:37:53.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:37:53.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:37:53.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:37:53.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:37:53.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:37:53.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:37:53.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:37:53.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:37:53.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.662 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.271656139000001, 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:37:53.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:37:53.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.269158422999993, 2024-04-17T15:37:53.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:37:53.668 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.668 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.668 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.668 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:37:53.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:37:53.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:37:53.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.267537099999998, 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.673 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:37:53.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:37:53.677 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.678 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.678 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.063749631999997, 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:37:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.684 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.327831416000002, 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:37:53.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:37:53.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:37:53.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.355881332000003, 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:37:53.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:37:53.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.336914290000003, 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:37:53.696 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:37:53.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:37:53.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.306942647, 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.702 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:37:53.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:37:53.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.707 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.291728943000003, 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:37:53.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:53.713 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.262330366, 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:53.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:37:53.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:37:53.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:37:53.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:37:53.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.244831421999997, 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.188953687000001, 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:37:53.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.080516455000001, 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.730 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.054013275999999, 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.736 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.741 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.202971796, 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:53.742 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:53.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:37:53.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:37:53.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:53.747 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:53.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:53.749 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:53.749+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:53.850 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:53.846+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:53.925 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:53.926 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:53.926 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:53.926 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:53.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:53.951 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:53.950+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:54.052 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:54.049+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:54.080 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:54.080 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:54.080 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:54.080 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:54.080 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:54.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:54.181 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:54.181+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:54.253 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:54.253+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.000845241, 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030313720000000001, 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 38 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269545+0000", 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2670000000000001e-06 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269558+0000", 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3053e-05 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269589+0000", 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1276999999999999e-05 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269605+0000", 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6076e-05 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269741+0000", 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135131 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269958+0000", 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021726100000000001 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.270212+0000", 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000253918 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.271337+0000", 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011256980000000001 2024-04-17T15:37:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272406+0000", 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001068575 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272504+0000", 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7790999999999999e-05 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272574+0000", 2024-04-17T15:37:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0325000000000002e-05 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.988159506000002, 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:37:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:37:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.98154186, 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:37:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.981204220999999, 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:37:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:37:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:60 7.9 e27/26 7:93e5b521:::notify.7:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.963121733000001, 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003055341, 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307268+0000", 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.463e-06 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307278+0000", 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307326+0000", 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8736999999999998e-05 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307347+0000", 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1053999999999999e-05 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307468+0000", 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120353 2024-04-17T15:37:54.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307504+0000", 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6426e-05 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310218+0000", 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027133840000000001 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310322+0000", 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010407 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.86513927, 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033104499999999999, 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.298 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 193 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:54.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405251+0000", 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405263+0000", 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1673e-05 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405294+0000", 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1537e-05 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405311+0000", 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6478999999999999e-05 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405428+0000", 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011737 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405628+0000", 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019951800000000001 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405892+0000", 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026415500000000002 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.407420+0000", 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015283129999999999 2024-04-17T15:37:54.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408374+0000", 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0009544 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408478+0000", 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010396200000000001 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408559+0000", 2024-04-17T15:37:54.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0820000000000002e-05 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.981789141, 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.304 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:54.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:37:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:37:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.965318728, 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033682500000000002, 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.310 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 212 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:54.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305072+0000", 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305083+0000", 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1517e-05 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305112+0000", 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8486000000000001e-05 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305126+0000", 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4487e-05 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305251+0000", 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124599 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305451+0000", 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020034499999999999 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305839+0000", 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038760800000000001 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.307390+0000", 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015517459999999999 2024-04-17T15:37:54.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308276+0000", 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088547699999999997 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308364+0000", 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8619e-05 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308438+0000", 2024-04-17T15:37:54.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3133000000000006e-05 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.939093061999998, 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033421330000000002, 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.316 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 219 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331298+0000", 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4589999999999998e-06 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331311+0000", 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2257e-05 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331343+0000", 2024-04-17T15:37:54.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2156000000000002e-05 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331358+0000", 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5252999999999999e-05 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331474+0000", 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011544600000000001 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331700+0000", 2024-04-17T15:37:54.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000226102 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.332161+0000", 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046111699999999998 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.333471+0000", 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001310741 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334479+0000", 2024-04-17T15:37:54.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010074629999999999 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334565+0000", 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6093000000000004e-05 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334637+0000", 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2045999999999994e-05 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.321 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.920746344000001, 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032014919999999998, 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 224 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349644+0000", 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349655+0000", 2024-04-17T15:37:54.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0764000000000001e-05 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349687+0000", 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2085999999999997e-05 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349702+0000", 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349889+0000", 2024-04-17T15:37:54.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698599999999999 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350092+0000", 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020369100000000001 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350514+0000", 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042112699999999998 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.351874+0000", 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013607910000000001 2024-04-17T15:37:54.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352690+0000", 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081600800000000001 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352776+0000", 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6119000000000007e-05 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352843+0000", 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.669e-05 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:318 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.858470668000002, 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031343450000000002, 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.327 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 318 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411918+0000", 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0869999999999999e-06 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411938+0000", 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9788000000000001e-05 2024-04-17T15:37:54.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411952+0000", 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4066000000000001e-05 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411963+0000", 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0920999999999999e-05 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412006+0000", 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2661999999999999e-05 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412087+0000", 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.072e-05 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412286+0000", 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019964900000000001 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.413018+0000", 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000732199 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.414968+0000", 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00194908 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415019+0000", 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1039999999999999e-05 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415052+0000", 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3133000000000003e-05 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:386 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.843235077000003, 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003049118, 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.333 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 386 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427154+0000", 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9800000000000002e-07 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427159+0000", 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3000000000000001e-06 2024-04-17T15:37:54.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427171+0000", 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2079000000000001e-05 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427177+0000", 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8649999999999998e-06 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427229+0000", 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2132999999999997e-05 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427333+0000", 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010389499999999999 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427500+0000", 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016634899999999999 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.428068+0000", 2024-04-17T15:37:54.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000568115 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430137+0000", 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020691070000000002 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430172+0000", 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5556000000000003e-05 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430202+0000", 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9720999999999999e-05 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.725273835000003, 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.339 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:37:54.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:37:54.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.706086810000002, 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.345 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:54.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:37:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:680 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.625187279999999, 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031880879999999999, 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.351 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 680 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645203+0000", 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.514e-06 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645216+0000", 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3103e-05 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645252+0000", 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5549000000000001e-05 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645277+0000", 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4827000000000001e-05 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645447+0000", 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170347 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645826+0000", 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037859999999999999 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.646397+0000", 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057096999999999996 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.647773+0000", 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013760490000000001 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648242+0000", 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046900300000000001 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648326+0000", 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4320000000000006e-05 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648389+0000", 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2805999999999995e-05 2024-04-17T15:37:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.523981573999997, 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032633940000000002, 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.357 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 733 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746409+0000", 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.96e-06 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746425+0000", 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5296000000000001e-05 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746458+0000", 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2913000000000001e-05 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746473+0000", 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5147000000000001e-05 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746625+0000", 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015230199999999999 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746850+0000", 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022539899999999999 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.747194+0000", 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034325399999999998 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.748282+0000", 2024-04-17T15:37:54.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010885789999999999 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749525+0000", 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001242251 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749604+0000", 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9110000000000007e-05 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749670+0000", 2024-04-17T15:37:54.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6183e-05 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.4803414, 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035370559999999998, 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.363 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 751 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790049+0000", 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1670000000000002e-06 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790060+0000", 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1446e-05 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790089+0000", 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8517000000000002e-05 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790103+0000", 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4103e-05 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790256+0000", 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152886 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790624+0000", 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000367804 2024-04-17T15:37:54.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.791205+0000", 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058173199999999995 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.792657+0000", 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014521429999999999 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793312+0000", 2024-04-17T15:37:54.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00065417600000000002 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793469+0000", 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000157503 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793584+0000", 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114579 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.475608868999998, 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032316369999999999, 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 753 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.369 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794781+0000", 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2359999999999999e-06 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794793+0000", 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.154e-05 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794825+0000", 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2236000000000001e-05 2024-04-17T15:37:54.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794840+0000", 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5316999999999999e-05 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794966+0000", 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012540899999999999 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795214+0000", 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024765900000000001 2024-04-17T15:37:54.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795682+0000", 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046803600000000002 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.796961+0000", 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012796909999999999 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797850+0000", 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088859699999999998 2024-04-17T15:37:54.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797941+0000", 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0836999999999998e-05 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.798011+0000", 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0079000000000004e-05 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.369631513999998, 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029866200000000002, 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 796 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900759+0000", 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.193e-06 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900772+0000", 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3016999999999999e-05 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900803+0000", 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1279999999999999e-05 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900818+0000", 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4620000000000001e-05 2024-04-17T15:37:54.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900943+0000", 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012558900000000001 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901172+0000", 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022883199999999999 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901518+0000", 2024-04-17T15:37:54.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034601100000000002 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.902651+0000", 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011331620000000001 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903590+0000", 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000938487 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903677+0000", 2024-04-17T15:37:54.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7035999999999998e-05 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903743+0000", 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6392999999999999e-05 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.051569890000003, 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029942160000000001, 2024-04-17T15:37:54.380 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 931 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218821+0000", 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.807e-06 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218835+0000", 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4523e-05 2024-04-17T15:37:54.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218869+0000", 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3766000000000002e-05 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218895+0000", 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5993999999999999e-05 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219037+0000", 2024-04-17T15:37:54.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014219499999999999 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219265+0000", 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022758899999999999 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219640+0000", 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037543100000000002 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.220951+0000", 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013106509999999999 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221627+0000", 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00067609099999999997 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221713+0000", 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5470000000000007e-05 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221812+0000", 2024-04-17T15:37:54.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9698999999999995e-05 2024-04-17T15:37:54.386 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.386 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.386 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.386 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.386 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.386 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:54.387 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:37:54.388 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:54.386+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:54.388 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-17T15:37:54.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-17T15:37:54.488 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:54.485+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:54.563 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:54.563 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:54.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:54.629 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:54.629+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:54.689 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:54.686+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:54.752 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:54.752 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:54.752 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:54.752 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:54.752 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:54.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:54.790 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:54.786+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:54.886 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:54.886 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:54.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:54.886 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:54.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.886 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:54.886 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.604400675000001, 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030098299999999998, 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 42 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280322+0000", 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6360000000000001e-06 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280344+0000", 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1710000000000001e-05 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280367+0000", 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2646e-05 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280380+0000", 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3574000000000001e-05 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280494+0000", 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114288 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280703+0000", 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000208805 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280947+0000", 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024378799999999999 2024-04-17T15:37:54.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.282418+0000", 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014711030000000001 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283224+0000", 2024-04-17T15:37:54.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00080576599999999997 2024-04-17T15:37:54.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283286+0000", 2024-04-17T15:37:54.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1921999999999994e-05 2024-04-17T15:37:54.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283330+0000", 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4592000000000003e-05 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.590046528999999, 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003461703, 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 52 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294678+0000", 2024-04-17T15:37:54.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.92e-06 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294691+0000", 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3244999999999999e-05 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294739+0000", 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7778999999999998e-05 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294753+0000", 2024-04-17T15:37:54.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4297999999999999e-05 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294857+0000", 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104107 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295108+0000", 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025097299999999998 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295309+0000", 2024-04-17T15:37:54.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020123600000000001 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297594+0000", 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002284379 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297987+0000", 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039364100000000002 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298068+0000", 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1001999999999995e-05 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298136+0000", 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8122999999999998e-05 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:57 7.3 e27/26 7:c609908c:::notify.5:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.579964674999999, 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003535472, 2024-04-17T15:37:54.899 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304759+0000", 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304773+0000", 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.396e-05 2024-04-17T15:37:54.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304796+0000", 2024-04-17T15:37:54.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3961999999999999e-05 2024-04-17T15:37:54.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304813+0000", 2024-04-17T15:37:54.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6086000000000002e-05 2024-04-17T15:37:54.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304947+0000", 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013435899999999999 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304991+0000", 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4221000000000002e-05 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308226+0000", 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032346190000000002 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308292+0000", 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6282e-05 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.905 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:59 7.14 e27/26 7:2b04a3e9:::notify.6:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.577498919, 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033715469999999999, 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307224+0000", 2024-04-17T15:37:54.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6169999999999999e-06 2024-04-17T15:37:54.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307235+0000", 2024-04-17T15:37:54.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1408e-05 2024-04-17T15:37:54.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307269+0000", 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3442999999999998e-05 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307290+0000", 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1353999999999999e-05 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307413+0000", 2024-04-17T15:37:54.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000122865 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307452+0000", 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9387000000000001e-05 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310518+0000", 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030657919999999999 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310594+0000", 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5680999999999996e-05 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.491703569000002, 2024-04-17T15:37:54.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034483930000000001, 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 236 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393020+0000", 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7669999999999999e-06 2024-04-17T15:37:54.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393034+0000", 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3073e-05 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393065+0000", 2024-04-17T15:37:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1860000000000003e-05 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393082+0000", 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6855999999999999e-05 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393221+0000", 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013827300000000001 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393434+0000", 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021370199999999999 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393850+0000", 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041539700000000002 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.395194+0000", 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001344121 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396313+0000", 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011190180000000001 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396398+0000", 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5393e-05 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396466+0000", 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7933000000000002e-05 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.478665116999998, 2024-04-17T15:37:54.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002805929, 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 280 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.919 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406057+0000", 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.203e-06 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406063+0000", 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9610000000000002e-06 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406075+0000", 2024-04-17T15:37:54.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1714e-05 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406082+0000", 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5220000000000004e-06 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406136+0000", 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4211e-05 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406231+0000", 2024-04-17T15:37:54.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4871999999999996e-05 2024-04-17T15:37:54.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:54.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406377+0000", 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146448 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.407079+0000", 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000701639 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408771+0000", 2024-04-17T15:37:54.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001692432 2024-04-17T15:37:54.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408820+0000", 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9289999999999997e-05 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408862+0000", 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1637000000000001e-05 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.926 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:697 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.225242799999997, 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002810561, 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.927 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 697 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659480+0000", 2024-04-17T15:37:54.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4759999999999999e-06 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659488+0000", 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1710000000000002e-06 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659509+0000", 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0718000000000001e-05 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659525+0000", 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5894999999999999e-05 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659651+0000", 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012638300000000001 2024-04-17T15:37:54.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659781+0000", 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013031300000000001 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.660036+0000", 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025453599999999998 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.661296+0000", 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001260331 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662138+0000", 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084126399999999999 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662208+0000", 2024-04-17T15:37:54.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0188e-05 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662289+0000", 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.116914708000003, 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029789930000000001, 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 742 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.935 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767809+0000", 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7329999999999999e-06 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767822+0000", 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2663999999999999e-05 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767854+0000", 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1875999999999998e-05 2024-04-17T15:37:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767869+0000", 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768001+0000", 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013243900000000001 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768229+0000", 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022790500000000001 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768575+0000", 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034550800000000001 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.769817+0000", 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012425019999999999 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770633+0000", 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081610700000000005 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770720+0000", 2024-04-17T15:37:54.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6682999999999997e-05 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770786+0000", 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5525999999999996e-05 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:54.941 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.071501752000003, 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029893189999999998, 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 760 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813222+0000", 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-06 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813233+0000", 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1703e-05 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813266+0000", 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2772999999999999e-05 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813289+0000", 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2337e-05 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813434+0000", 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014584400000000001 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813598+0000", 2024-04-17T15:37:54.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000163752 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813883+0000", 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000285087 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.815043+0000", 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011595819999999999 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816059+0000", 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010158459999999999 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816148+0000", 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9553000000000001e-05 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816209+0000", 2024-04-17T15:37:54.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0585999999999999e-05 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.067544323, 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030744029999999999, 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 762 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817179+0000", 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-06 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817190+0000", 2024-04-17T15:37:54.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1090000000000001e-05 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817225+0000", 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5129999999999997e-05 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817244+0000", 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9029999999999999e-05 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817379+0000", 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000134475 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817606+0000", 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022773199999999999 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.818089+0000", 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048282400000000002 2024-04-17T15:37:54.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.819375+0000", 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012861680000000001 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820098+0000", 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000722841 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820184+0000", 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5500000000000005e-05 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820251+0000", 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7613000000000005e-05 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.935475551000003, 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029764269999999998, 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.955 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 817 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949248+0000", 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4099999999999998e-06 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949264+0000", 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6364000000000001e-05 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949296+0000", 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1513000000000001e-05 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949317+0000", 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1403000000000002e-05 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949509+0000", 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019130500000000001 2024-04-17T15:37:54.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949747+0000", 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000238039 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.950063+0000", 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031621399999999999 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.951228+0000", 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001165379 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952068+0000", 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000839674 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952156+0000", 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8313000000000006e-05 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952222+0000", 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5813000000000002e-05 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.931538891000002, 2024-04-17T15:37:54.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029501589999999999, 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 819 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953184+0000", 2024-04-17T15:37:54.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.973e-06 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953198+0000", 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3657e-05 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953229+0000", 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1486000000000003e-05 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953248+0000", 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187000000000001e-05 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953356+0000", 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107909 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953484+0000", 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012820600000000001 2024-04-17T15:37:54.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953773+0000", 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028948800000000002 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.954862+0000", 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001088365 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.955975+0000", 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001113326 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956061+0000", 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6470000000000004e-05 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956133+0000", 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1092000000000003e-05 2024-04-17T15:37:54.967 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.880184739999997, 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029884, 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.968 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 841 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004539+0000", 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2630000000000002e-06 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004551+0000", 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2680000000000001e-05 2024-04-17T15:37:54.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004582+0000", 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0700000000000001e-05 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004597+0000", 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.501e-05 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004732+0000", 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013490900000000001 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004956+0000", 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022391800000000001 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.005298+0000", 2024-04-17T15:37:54.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034173100000000001 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.006602+0000", 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013043810000000001 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007387+0000", 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000784635 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007467+0000", 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0661999999999994e-05 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007525+0000", 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7510999999999999e-05 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.865262596999997, 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031389679999999998, 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 847 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019461+0000", 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.277e-06 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019472+0000", 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1319e-05 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019503+0000", 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0626999999999997e-05 2024-04-17T15:37:54.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019517+0000", 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019652+0000", 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013442799999999999 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019977+0000", 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032536300000000001 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.020521+0000", 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00054383700000000003 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.021843+0000", 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001321593 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022433+0000", 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058991600000000001 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022517+0000", 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4845999999999994e-05 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022598+0000", 2024-04-17T15:37:54.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0185999999999994e-05 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.816303556000001, 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034503820000000001, 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 868 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068420+0000", 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1330000000000002e-06 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068432+0000", 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2646000000000001e-05 2024-04-17T15:37:54.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068463+0000", 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0170000000000001e-05 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068477+0000", 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4797000000000001e-05 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068645+0000", 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016787200000000001 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068999+0000", 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035414099999999998 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.069565+0000", 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056531599999999995 2024-04-17T15:37:54.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.070818+0000", 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001252932 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071707+0000", 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088886 2024-04-17T15:37:54.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071793+0000", 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6885999999999994e-05 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071868+0000", 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4629000000000007e-05 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.987 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.723657174000003, 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030204519999999999, 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.988 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 907 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:54.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161067+0000", 2024-04-17T15:37:54.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4329999999999998e-06 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161077+0000", 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0910000000000001e-05 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161109+0000", 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1288999999999998e-05 2024-04-17T15:37:54.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161123+0000", 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4739999999999999e-05 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161242+0000", 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011889 2024-04-17T15:37:54.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161468+0000", 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022609099999999999 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161805+0000", 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612099999999999 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.162878+0000", 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001073606 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.163928+0000", 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00104958 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164017+0000", 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9284999999999996e-05 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164085+0000", 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7507000000000003e-05 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.995 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.622880729000002, 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003409006, 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:54.996 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 949 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:54.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:54.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:54.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:54.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:54.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:54.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261844+0000", 2024-04-17T15:37:54.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.993e-06 2024-04-17T15:37:54.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:54.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261857+0000", 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261902+0000", 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5286e-05 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261926+0000", 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3757e-05 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262112+0000", 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018562900000000001 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262494+0000", 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038215999999999999 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262901+0000", 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040692000000000001 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.264939+0000", 2024-04-17T15:37:55.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020382400000000002 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265106+0000", 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016660500000000001 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265187+0000", 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265250+0000", 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2063000000000005e-05 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.618581235999997, 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032687240000000002, 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 951 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266142+0000", 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6640000000000001e-06 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266151+0000", 2024-04-17T15:37:55.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5829999999999996e-06 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266177+0000", 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.55e-05 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266189+0000", 2024-04-17T15:37:55.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2139e-05 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266301+0000", 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011170700000000001 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266418+0000", 2024-04-17T15:37:55.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117599 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266690+0000", 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027164099999999998 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.268256+0000", 2024-04-17T15:37:55.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001565842 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269168+0000", 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00091194099999999999 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269297+0000", 2024-04-17T15:37:55.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012897900000000001 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269409+0000", 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112129 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.012 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.607777560999999, 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030567260000000001, 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.013 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 955 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276946+0000", 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6139999999999999e-06 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276959+0000", 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.279e-05 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276992+0000", 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2981999999999997e-05 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277008+0000", 2024-04-17T15:37:55.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6127e-05 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277162+0000", 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015356199999999999 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277427+0000", 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026516799999999998 2024-04-17T15:37:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277784+0000", 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035701500000000002 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279283+0000", 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499479 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279849+0000", 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056583000000000002 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279935+0000", 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5649000000000006e-05 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280000+0000", 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5510000000000001e-05 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 48.603798959000002, 2024-04-17T15:37:55.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028646269999999998, 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 957 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280924+0000", 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.894e-06 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280934+0000", 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6299999999999993e-06 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280960+0000", 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280986+0000", 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5913000000000001e-05 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281095+0000", 2024-04-17T15:37:55.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109212 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281215+0000", 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120469 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281472+0000", 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025682199999999997 2024-04-17T15:37:55.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.282766+0000", 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001293521 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283642+0000", 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087648000000000001 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283727+0000", 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4874000000000001e-05 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283787+0000", 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9892000000000002e-05 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.028 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.028 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.028 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:55.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:55.030 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:55.026+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:55.130 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:55.129+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:55.159 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:55.159 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:55.159 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:55.160 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:55.173 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:55.265 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:55.265+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:55.331 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:55.330+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:55.344 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:55.344 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:55.344 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:55.344 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:55.345 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:55.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:55.371 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:37:55.373 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-17T15:37:55.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-17T15:37:55.445 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:55.445+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.239580271999998, 2024-04-17T15:37:55.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063603720000000004, 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "reached pg", 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 44 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253462+0000", 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253499+0000", 2024-04-17T15:37:55.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7339999999999998e-05 2024-04-17T15:37:55.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253536+0000", 2024-04-17T15:37:55.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6746999999999999e-05 2024-04-17T15:37:55.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253562+0000", 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6095999999999999e-05 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253940+0000", 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037773800000000002 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for peered", 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253962+0000", 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2566e-05 2024-04-17T15:37:55.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259497+0000", 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055350269999999997 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259819+0000", 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000321792 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040977412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.189252041000003, 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049681100000000004, 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.500 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 57 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303788+0000", 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.55e-06 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303797+0000", 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8820000000000007e-06 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303842+0000", 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4231999999999999e-05 2024-04-17T15:37:55.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303856+0000", 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4307e-05 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303983+0000", 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127577 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304194+0000", 2024-04-17T15:37:55.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000210299 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304573+0000", 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037939199999999999 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.305923+0000", 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013502500000000001 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308569+0000", 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026456159999999999 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308655+0000", 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5539999999999998e-05 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308755+0000", 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010046499999999999 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040977413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.186624621999997, 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047062060000000001, 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 59 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306416+0000", 2024-04-17T15:37:55.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:37:55.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306424+0000", 2024-04-17T15:37:55.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7519999999999996e-06 2024-04-17T15:37:55.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306446+0000", 2024-04-17T15:37:55.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2155e-05 2024-04-17T15:37:55.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306456+0000", 2024-04-17T15:37:55.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0523000000000001e-05 2024-04-17T15:37:55.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306569+0000", 2024-04-17T15:37:55.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112277 2024-04-17T15:37:55.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306739+0000", 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170688 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307048+0000", 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030829700000000002 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310444+0000", 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033961629999999998 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310828+0000", 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038433500000000003 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310956+0000", 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127997 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.311121+0000", 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016447900000000001 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.513 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.210633588999997, 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059605389999999999, 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 207 2024-04-17T15:37:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282410+0000", 2024-04-17T15:37:55.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3959999999999999e-06 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282431+0000", 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0996999999999999e-05 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282475+0000", 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4703000000000002e-05 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282501+0000", 2024-04-17T15:37:55.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5627e-05 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282659+0000", 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015803900000000001 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282916+0000", 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025698099999999998 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.283628+0000", 2024-04-17T15:37:55.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00071140199999999998 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.286242+0000", 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002614782 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288105+0000", 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862437 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288260+0000", 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015568900000000001 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288366+0000", 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000105486 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.172629002999997, 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033450900000000002, 2024-04-17T15:37:55.519 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.520 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.520 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.520 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.520 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.520 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.521 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 216 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320413+0000", 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.65e-06 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320426+0000", 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2972999999999999e-05 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2326999999999997e-05 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320473+0000", 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4763000000000001e-05 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320604+0000", 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013095899999999999 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320836+0000", 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000232012 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:55.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.321267+0000", 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043098000000000002 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.322958+0000", 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016909189999999999 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323607+0000", 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00064901100000000001 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323691+0000", 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4383999999999997e-05 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323755+0000", 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4111999999999999e-05 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:37:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.132397071, 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036511180000000001, 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 227 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:37:55.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360644+0000", 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360656+0000", 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.217e-05 2024-04-17T15:37:55.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360689+0000", 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2778999999999999e-05 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360704+0000", 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5187e-05 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360849+0000", 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144315 2024-04-17T15:37:55.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361057+0000", 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020802200000000001 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361490+0000", 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043335100000000001 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.363127+0000", 2024-04-17T15:37:55.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001636832 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364063+0000", 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093582599999999995 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364177+0000", 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011425300000000001 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364293+0000", 2024-04-17T15:37:55.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115943 2024-04-17T15:37:55.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.532 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.532 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.532 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.124462170000001, 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003177409, 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 229 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368579+0000", 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2740000000000002e-06 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368591+0000", 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1456e-05 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368623+0000", 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2474000000000001e-05 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368638+0000", 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.502e-05 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368758+0000", 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000119505 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368990+0000", 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023266199999999999 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.369391+0000", 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040097100000000002 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.370944+0000", 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015525389999999999 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371613+0000", 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00066936899999999995 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371693+0000", 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9886000000000001e-05 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371754+0000", 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1253000000000005e-05 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.117379345000003, 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033033200000000002, 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.538 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 231 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375662+0000", 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375673+0000", 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1678999999999999e-05 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375706+0000", 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2293999999999999e-05 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375721+0000", 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.522e-05 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375868+0000", 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014661200000000001 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376071+0000", 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020339199999999999 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376467+0000", 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039612099999999998 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.377887+0000", 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001419696 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378819+0000", 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093196000000000001 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378902+0000", 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2977000000000002e-05 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378963+0000", 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1241999999999994e-05 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:345 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.075823874999998, 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003233755, 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 345 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417216+0000", 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417223+0000", 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3969999999999999e-06 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417240+0000", 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7711e-05 2024-04-17T15:37:55.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417250+0000", 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3789999999999995e-06 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417308+0000", 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8663999999999999e-05 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417398+0000", 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9524000000000005e-05 2024-04-17T15:37:55.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417555+0000", 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015700299999999999 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.418480+0000", 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00092510400000000005 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420343+0000", 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862596 2024-04-17T15:37:55.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420402+0000", 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.944e-05 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420449+0000", 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6832000000000002e-05 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.549 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:398 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.059250779999999, 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041188789999999998, 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 398 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433789+0000", 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433794+0000", 2024-04-17T15:37:55.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1490000000000002e-06 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433807+0000", 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2334000000000001e-05 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433813+0000", 2024-04-17T15:37:55.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1240000000000002e-06 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433875+0000", 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2309000000000003e-05 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433976+0000", 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100577 2024-04-17T15:37:55.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434109+0000", 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013374099999999999 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434711+0000", 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060139999999999998 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437854+0000", 2024-04-17T15:37:55.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031429069999999999 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437883+0000", 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9539999999999998e-05 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437907+0000", 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3947999999999998e-05 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:402 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.057350761000002, 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047817750000000003, 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 402 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435689+0000", 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.850000000000001e-07 2024-04-17T15:37:55.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435693+0000", 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435705+0000", 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1484000000000001e-05 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435713+0000", 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6699999999999994e-06 2024-04-17T15:37:55.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435756+0000", 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3519999999999997e-05 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435812+0000", 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5998000000000002e-05 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435942+0000", 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000129596 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.436441+0000", 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049949700000000001 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440415+0000", 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039740690000000002 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440444+0000", 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9156999999999999e-05 2024-04-17T15:37:55.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440470+0000", 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5499000000000001e-05 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:522 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.986198385999998, 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031631699999999999, 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.561 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 522 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:37:55.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506842+0000", 2024-04-17T15:37:55.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1629999999999999e-06 2024-04-17T15:37:55.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506847+0000", 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506861+0000", 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3811e-05 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506871+0000", 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5429999999999999e-06 2024-04-17T15:37:55.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506925+0000", 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4740000000000001e-05 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507027+0000", 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101766 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507209+0000", 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018180900000000001 2024-04-17T15:37:55.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509722+0000", 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025127539999999999 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509938+0000", 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021666099999999999 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509978+0000", 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9987000000000002e-05 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.510004+0000", 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5316999999999998e-05 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:607 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.912416925000002, 2024-04-17T15:37:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003551916, 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 607 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580623+0000", 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4020000000000001e-06 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580632+0000", 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1459999999999996e-06 2024-04-17T15:37:55.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580654+0000", 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2446000000000002e-05 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580665+0000", 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1165000000000001e-05 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580780+0000", 2024-04-17T15:37:55.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114973 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580917+0000", 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013664300000000001 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581189+0000", 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027190100000000001 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582345+0000", 2024-04-17T15:37:55.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00115599 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583899+0000", 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015540319999999999 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584059+0000", 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016074500000000001 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584174+0000", 2024-04-17T15:37:55.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114473 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:611 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.906226975999999, 2024-04-17T15:37:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033528170000000001, 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 611 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586814+0000", 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9860000000000001e-06 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586825+0000", 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0686000000000001e-05 2024-04-17T15:37:55.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586853+0000", 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8365e-05 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586866+0000", 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587014+0000", 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014742600000000001 2024-04-17T15:37:55.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587227+0000", 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021381800000000001 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587506+0000", 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027870100000000001 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.588524+0000", 2024-04-17T15:37:55.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001018157 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.589970+0000", 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014462590000000001 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590061+0000", 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0138999999999999e-05 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590165+0000", 2024-04-17T15:37:55.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104168 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.820412298999997, 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034329339999999999, 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 703 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672629+0000", 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0080000000000001e-06 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672638+0000", 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1419999999999999e-06 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672664+0000", 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5905e-05 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672676+0000", 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2337000000000001e-05 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672840+0000", 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016395 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673166+0000", 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000326275 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673711+0000", 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000545047 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675036+0000", 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013244940000000001 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675808+0000", 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00077264900000000004 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675951+0000", 2024-04-17T15:37:55.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014292499999999999 2024-04-17T15:37:55.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.676060+0000", 2024-04-17T15:37:55.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010820200000000001 2024-04-17T15:37:55.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.791238286999999, 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003556245, 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 715 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701803+0000", 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701818+0000", 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5223e-05 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701849+0000", 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1035999999999999e-05 2024-04-17T15:37:55.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701866+0000", 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6643999999999999e-05 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702012+0000", 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014634700000000001 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702345+0000", 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033299399999999998 2024-04-17T15:37:55.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702866+0000", 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052063999999999995 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.704096+0000", 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001229988 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705095+0000", 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00099944500000000006 2024-04-17T15:37:55.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705240+0000", 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144287 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705357+0000", 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117191 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.590 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.636511675999998, 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035344460000000001, 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 778 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856530+0000", 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3199999999999998e-06 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856541+0000", 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.183e-05 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856573+0000", 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2060000000000001e-05 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856590+0000", 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6356000000000001e-05 2024-04-17T15:37:55.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856741+0000", 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158899999999999 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857099+0000", 2024-04-17T15:37:55.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035803499999999998 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857663+0000", 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056350599999999997 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859015+0000", 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013523299999999999 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859910+0000", 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00089519100000000004 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859996+0000", 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5673000000000005e-05 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.860062+0000", 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5555999999999994e-05 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.596 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.522703903, 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032371169999999999, 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 826 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.597 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970337+0000", 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:55.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970349+0000", 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1440000000000001e-05 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970381+0000", 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1896000000000001e-05 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970395+0000", 2024-04-17T15:37:55.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4867e-05 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970554+0000", 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015837199999999999 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970926+0000", 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037184099999999998 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.971531+0000", 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060493600000000004 2024-04-17T15:37:55.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.972848+0000", 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013169340000000001 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973421+0000", 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057373600000000004 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973506+0000", 2024-04-17T15:37:55.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4285999999999999e-05 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973572+0000", 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6586000000000002e-05 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.431695779999998, 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003083728, 2024-04-17T15:37:55.602 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 865 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061345+0000", 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061356+0000", 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0823e-05 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061387+0000", 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0766999999999999e-05 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061402+0000", 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5379999999999998e-05 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061519+0000", 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117265 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061739+0000", 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000219106 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.062054+0000", 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031500400000000002 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.063247+0000", 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011935979999999999 2024-04-17T15:37:55.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064266+0000", 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001019023 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064359+0000", 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3040000000000004e-05 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064427+0000", 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7665999999999999e-05 2024-04-17T15:37:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 49.260654586000001, 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031575179999999998, 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:55.608 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 937 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232386+0000", 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232398+0000", 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1864e-05 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232426+0000", 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:55.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232440+0000", 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.412e-05 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232621+0000", 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018099899999999999 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232854+0000", 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023273400000000001 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:55.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.233176+0000", 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032190499999999999 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.234217+0000", 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001040673 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235396+0000", 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001179835 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235480+0000", 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3473000000000005e-05 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235542+0000", 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2042e-05 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:55.613 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:55.614 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:37:55.615 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:55.614+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:55.616 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:55.716 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:55.714+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:55.752 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:55.752 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:55.766 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:37:55.801 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:55.801 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:55.817 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:55.817+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:55.817 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:55.818 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:55.834 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:55.835 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:55.852 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:55.872 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:55.873 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:55.890 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:55.910 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:55.910 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:55.918 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:55.914+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:55.931 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:55.931 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:55.951 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:37:56.019 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:56.017+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:56.120 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:56.117+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:56.122 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:56.122 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:56.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:37:56.221 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:56.218+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:56.264 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:56.264 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:56.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:37:56.322 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:56.321+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:56.384 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.3 to 1 (10000) 2024-04-17T15:37:56.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-17T15:37:56.422 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:56.418+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:56.459 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:56.460 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:56.474 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:37:56.523 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:56.521+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:56.624 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:56.621+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:56.636 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:56.636 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:56.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:37:56.726 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:56.722+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:56.772 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:56.772 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:56.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:37:56.827 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:56.825+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:56.928 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:56.929+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:56.956 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:56.957 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:56.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:37:57.029 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:57.029+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:57.100 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:57.100 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:57.115 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:37:57.159 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:57.158+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:57.231 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:57.229+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:57.236 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:57.236 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:57.251 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:37:57.335 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:57.334+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:57.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:37:57.402 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.4 to 1 (10000) 2024-04-17T15:37:57.412 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:57.412 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:57.427 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:37:57.429 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-17T15:37:57.472 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:57.473+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:57.534 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:57.533+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:57.600 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:57.600 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:57.614 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:37:57.660 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:57.661+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:57.735 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:57.735 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:57.735 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:57.733+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:57.750 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:37:57.840 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:57.841+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:57.911 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:57.911 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:57.926 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:37:57.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:37:57.969 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:57.969+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:58.039 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:58.037+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:58.089 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:37:58.089 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:37:58.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:37:58.121 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:37:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:37:58.138 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:37:58.138 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:37:58.140 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:58.138+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:58.157 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:37:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:37:58.176 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:37:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:37:58.210 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:37:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:37:58.231 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:37:58.231 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:37:58.241 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:58.238+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:58.253 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:58.253 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:58.253 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:58.253 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:58.254 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:37:58.254 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:37:58.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:37:58.275 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:37:58.275 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:37:58.342 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:58.341+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:58.391 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:58.392 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:58.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:37:58.407 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:37:58.408 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.5 to 1 (10000) 2024-04-17T15:37:58.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-17T15:37:58.481 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:58.481+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:58.532 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.263648140000001, 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030313720000000001, 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 38 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269545+0000", 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2670000000000001e-06 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269558+0000", 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3053e-05 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269589+0000", 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1276999999999999e-05 2024-04-17T15:37:58.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269605+0000", 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6076e-05 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269741+0000", 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135131 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269958+0000", 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021726100000000001 2024-04-17T15:37:58.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.270212+0000", 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000253918 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.271337+0000", 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011256980000000001 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272406+0000", 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001068575 2024-04-17T15:37:58.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272504+0000", 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7790999999999999e-05 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272574+0000", 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0325000000000002e-05 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.538 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.250962405000003, 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.244344759000001, 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:37:58.546 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.244007119999999, 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:60 7.9 e27/26 7:93e5b521:::notify.7:head v 27'1, mlcod=0'0)", 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.225924632000002, 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003055341, 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307268+0000", 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.463e-06 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307278+0000", 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307326+0000", 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8736999999999998e-05 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307347+0000", 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1053999999999999e-05 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307468+0000", 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120353 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307504+0000", 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6426e-05 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310218+0000", 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027133840000000001 2024-04-17T15:37:58.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310322+0000", 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010407 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.127942169000001, 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033104499999999999, 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.555 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 193 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:37:58.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405251+0000", 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405263+0000", 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1673e-05 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405294+0000", 2024-04-17T15:37:58.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1537e-05 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405311+0000", 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6478999999999999e-05 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405428+0000", 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011737 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405628+0000", 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019951800000000001 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405892+0000", 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026415500000000002 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.407420+0000", 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015283129999999999 2024-04-17T15:37:58.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408374+0000", 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0009544 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408478+0000", 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010396200000000001 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408559+0000", 2024-04-17T15:37:58.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0820000000000002e-05 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.244592040000001, 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.228121627, 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033682500000000002, 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 212 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.567 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305072+0000", 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:37:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305083+0000", 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1517e-05 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305112+0000", 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8486000000000001e-05 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305126+0000", 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4487e-05 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305251+0000", 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124599 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305451+0000", 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020034499999999999 2024-04-17T15:37:58.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305839+0000", 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038760800000000001 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.307390+0000", 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015517459999999999 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308276+0000", 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088547699999999997 2024-04-17T15:37:58.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308364+0000", 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8619e-05 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308438+0000", 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3133000000000006e-05 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.201895960999998, 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033421330000000002, 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 219 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331298+0000", 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4589999999999998e-06 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331311+0000", 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2257e-05 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331343+0000", 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2156000000000002e-05 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331358+0000", 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5252999999999999e-05 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331474+0000", 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011544600000000001 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331700+0000", 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000226102 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.332161+0000", 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046111699999999998 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.333471+0000", 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001310741 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334479+0000", 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010074629999999999 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334565+0000", 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6093000000000004e-05 2024-04-17T15:37:58.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334637+0000", 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2045999999999994e-05 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.183549243000002, 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032014919999999998, 2024-04-17T15:37:58.578 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 224 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349644+0000", 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349655+0000", 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0764000000000001e-05 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349687+0000", 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2085999999999997e-05 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349702+0000", 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349889+0000", 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698599999999999 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350092+0000", 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020369100000000001 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350514+0000", 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042112699999999998 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.351874+0000", 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013607910000000001 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352690+0000", 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081600800000000001 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352776+0000", 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6119000000000007e-05 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352843+0000", 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.669e-05 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:318 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.121273567000003, 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031343450000000002, 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 318 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:37:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411918+0000", 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0869999999999999e-06 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411938+0000", 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9788000000000001e-05 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411952+0000", 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4066000000000001e-05 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411963+0000", 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0920999999999999e-05 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412006+0000", 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2661999999999999e-05 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412087+0000", 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.072e-05 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412286+0000", 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019964900000000001 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.413018+0000", 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000732199 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.414968+0000", 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00194908 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415019+0000", 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1039999999999999e-05 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415052+0000", 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3133000000000003e-05 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:386 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.106037976000003, 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003049118, 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 386 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427154+0000", 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9800000000000002e-07 2024-04-17T15:37:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427159+0000", 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3000000000000001e-06 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427171+0000", 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2079000000000001e-05 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427177+0000", 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8649999999999998e-06 2024-04-17T15:37:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427229+0000", 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2132999999999997e-05 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427333+0000", 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010389499999999999 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427500+0000", 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016634899999999999 2024-04-17T15:37:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.428068+0000", 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000568115 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430137+0000", 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020691070000000002 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430172+0000", 2024-04-17T15:37:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5556000000000003e-05 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430202+0000", 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9720999999999999e-05 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.988076734000003, 2024-04-17T15:37:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:37:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:37:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.968889709000003, 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:37:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:37:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:680 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.887990178999999, 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031880879999999999, 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 680 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645203+0000", 2024-04-17T15:37:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.514e-06 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645216+0000", 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3103e-05 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645252+0000", 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5549000000000001e-05 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645277+0000", 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4827000000000001e-05 2024-04-17T15:37:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645447+0000", 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170347 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645826+0000", 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037859999999999999 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.646397+0000", 2024-04-17T15:37:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057096999999999996 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.647773+0000", 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013760490000000001 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648242+0000", 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046900300000000001 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648326+0000", 2024-04-17T15:37:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4320000000000006e-05 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648389+0000", 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2805999999999995e-05 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.786784472999997, 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032633940000000002, 2024-04-17T15:37:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 733 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746409+0000", 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.96e-06 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746425+0000", 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5296000000000001e-05 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746458+0000", 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2913000000000001e-05 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746473+0000", 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5147000000000001e-05 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746625+0000", 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015230199999999999 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746850+0000", 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022539899999999999 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.747194+0000", 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034325399999999998 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.748282+0000", 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010885789999999999 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749525+0000", 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001242251 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749604+0000", 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9110000000000007e-05 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749670+0000", 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6183e-05 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.743144299000001, 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035370559999999998, 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 751 2024-04-17T15:37:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790049+0000", 2024-04-17T15:37:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1670000000000002e-06 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790060+0000", 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1446e-05 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790089+0000", 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8517000000000002e-05 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790103+0000", 2024-04-17T15:37:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4103e-05 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790256+0000", 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152886 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790624+0000", 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000367804 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.791205+0000", 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058173199999999995 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.792657+0000", 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014521429999999999 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793312+0000", 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00065417600000000002 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793469+0000", 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000157503 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793584+0000", 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114579 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.738411767999999, 2024-04-17T15:37:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032316369999999999, 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 753 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794781+0000", 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2359999999999999e-06 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794793+0000", 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.154e-05 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794825+0000", 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2236000000000001e-05 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794840+0000", 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5316999999999999e-05 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794966+0000", 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012540899999999999 2024-04-17T15:37:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795214+0000", 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024765900000000001 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795682+0000", 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046803600000000002 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.796961+0000", 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012796909999999999 2024-04-17T15:37:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797850+0000", 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088859699999999998 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797941+0000", 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0836999999999998e-05 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.798011+0000", 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0079000000000004e-05 2024-04-17T15:37:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.632434412999999, 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029866200000000002, 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 796 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900759+0000", 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.193e-06 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900772+0000", 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3016999999999999e-05 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900803+0000", 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1279999999999999e-05 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900818+0000", 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4620000000000001e-05 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900943+0000", 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012558900000000001 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901172+0000", 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022883199999999999 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901518+0000", 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034601100000000002 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.902651+0000", 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011331620000000001 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903590+0000", 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000938487 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903677+0000", 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7035999999999998e-05 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903743+0000", 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6392999999999999e-05 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.314372788999997, 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029942160000000001, 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 931 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218821+0000", 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.807e-06 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218835+0000", 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4523e-05 2024-04-17T15:37:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218869+0000", 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3766000000000002e-05 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218895+0000", 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5993999999999999e-05 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219037+0000", 2024-04-17T15:37:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014219499999999999 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219265+0000", 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022758899999999999 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219640+0000", 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037543100000000002 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.220951+0000", 2024-04-17T15:37:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013106509999999999 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221627+0000", 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00067609099999999997 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221713+0000", 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5470000000000007e-05 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221812+0000", 2024-04-17T15:37:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9698999999999995e-05 2024-04-17T15:37:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:58.640 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:58.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:37:58.642 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:58.642+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:58.742 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:58.738+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:58.762 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:58.762 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:58.763 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:58.763 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:58.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:37:58.843 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:37:58.841+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:37:58.893 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:58.893 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:58.893 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:58.893 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:58.893 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:58.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:37:58.944 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:37:58.942+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:37:59.045 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:59.045+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.799307843999998, 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030098299999999998, 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.082 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 42 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280322+0000", 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6360000000000001e-06 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280344+0000", 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1710000000000001e-05 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280367+0000", 2024-04-17T15:37:59.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2646e-05 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280380+0000", 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3574000000000001e-05 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280494+0000", 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114288 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280703+0000", 2024-04-17T15:37:59.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000208805 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280947+0000", 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024378799999999999 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.282418+0000", 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014711030000000001 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283224+0000", 2024-04-17T15:37:59.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00080576599999999997 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283286+0000", 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1921999999999994e-05 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283330+0000", 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4592000000000003e-05 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.784953698000002, 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003461703, 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 52 2024-04-17T15:37:59.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294678+0000", 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.92e-06 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294691+0000", 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3244999999999999e-05 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294739+0000", 2024-04-17T15:37:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7778999999999998e-05 2024-04-17T15:37:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294753+0000", 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4297999999999999e-05 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294857+0000", 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104107 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295108+0000", 2024-04-17T15:37:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025097299999999998 2024-04-17T15:37:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:37:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295309+0000", 2024-04-17T15:37:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020123600000000001 2024-04-17T15:37:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297594+0000", 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002284379 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297987+0000", 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039364100000000002 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298068+0000", 2024-04-17T15:37:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1001999999999995e-05 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298136+0000", 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8122999999999998e-05 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:57 7.3 e27/26 7:c609908c:::notify.5:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.774871844000003, 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003535472, 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304759+0000", 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304773+0000", 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.396e-05 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304796+0000", 2024-04-17T15:37:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3961999999999999e-05 2024-04-17T15:37:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304813+0000", 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6086000000000002e-05 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304947+0000", 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013435899999999999 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304991+0000", 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4221000000000002e-05 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308226+0000", 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032346190000000002 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308292+0000", 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6282e-05 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:59 7.14 e27/26 7:2b04a3e9:::notify.6:head v 27'2, mlcod=0'0)", 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.772406087999997, 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033715469999999999, 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.102 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307224+0000", 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6169999999999999e-06 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307235+0000", 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1408e-05 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307269+0000", 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3442999999999998e-05 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307290+0000", 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1353999999999999e-05 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307413+0000", 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000122865 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307452+0000", 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9387000000000001e-05 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310518+0000", 2024-04-17T15:37:59.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030657919999999999 2024-04-17T15:37:59.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310594+0000", 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5680999999999996e-05 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.686610737999999, 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034483930000000001, 2024-04-17T15:37:59.107 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 236 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393020+0000", 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7669999999999999e-06 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393034+0000", 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3073e-05 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393065+0000", 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1860000000000003e-05 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393082+0000", 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6855999999999999e-05 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393221+0000", 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013827300000000001 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393434+0000", 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021370199999999999 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393850+0000", 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041539700000000002 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.395194+0000", 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001344121 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396313+0000", 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011190180000000001 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396398+0000", 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5393e-05 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396466+0000", 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7933000000000002e-05 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.673572286000002, 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002805929, 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.113 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 280 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:37:59.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406057+0000", 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.203e-06 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406063+0000", 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9610000000000002e-06 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406075+0000", 2024-04-17T15:37:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1714e-05 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406082+0000", 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5220000000000004e-06 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406136+0000", 2024-04-17T15:37:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4211e-05 2024-04-17T15:37:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406231+0000", 2024-04-17T15:37:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4871999999999996e-05 2024-04-17T15:37:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406377+0000", 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146448 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.407079+0000", 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000701639 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408771+0000", 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001692432 2024-04-17T15:37:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408820+0000", 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9289999999999997e-05 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408862+0000", 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1637000000000001e-05 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.119 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:697 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.420149969000001, 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002810561, 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 697 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659480+0000", 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4759999999999999e-06 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659488+0000", 2024-04-17T15:37:59.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1710000000000002e-06 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659509+0000", 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0718000000000001e-05 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659525+0000", 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5894999999999999e-05 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659651+0000", 2024-04-17T15:37:59.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012638300000000001 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659781+0000", 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013031300000000001 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.660036+0000", 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025453599999999998 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.661296+0000", 2024-04-17T15:37:59.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001260331 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662138+0000", 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084126399999999999 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662208+0000", 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0188e-05 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662289+0000", 2024-04-17T15:37:59.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.311821877, 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029789930000000001, 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 742 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767809+0000", 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7329999999999999e-06 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767822+0000", 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2663999999999999e-05 2024-04-17T15:37:59.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767854+0000", 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1875999999999998e-05 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767869+0000", 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768001+0000", 2024-04-17T15:37:59.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013243900000000001 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768229+0000", 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022790500000000001 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768575+0000", 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034550800000000001 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.769817+0000", 2024-04-17T15:37:59.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012425019999999999 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770633+0000", 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081610700000000005 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770720+0000", 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6682999999999997e-05 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770786+0000", 2024-04-17T15:37:59.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5525999999999996e-05 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.266408921, 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029893189999999998, 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.131 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 760 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813222+0000", 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-06 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813233+0000", 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1703e-05 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813266+0000", 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2772999999999999e-05 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813289+0000", 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2337e-05 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813434+0000", 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014584400000000001 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813598+0000", 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000163752 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813883+0000", 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000285087 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.815043+0000", 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011595819999999999 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816059+0000", 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010158459999999999 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816148+0000", 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9553000000000001e-05 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816209+0000", 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0585999999999999e-05 2024-04-17T15:37:59.136 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.262451491999997, 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030744029999999999, 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.137 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.138 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 762 2024-04-17T15:37:59.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.138 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:59.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817179+0000", 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-06 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817190+0000", 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1090000000000001e-05 2024-04-17T15:37:59.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817225+0000", 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5129999999999997e-05 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817244+0000", 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9029999999999999e-05 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817379+0000", 2024-04-17T15:37:59.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000134475 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817606+0000", 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022773199999999999 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.818089+0000", 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048282400000000002 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.819375+0000", 2024-04-17T15:37:59.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012861680000000001 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820098+0000", 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000722841 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820184+0000", 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5500000000000005e-05 2024-04-17T15:37:59.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820251+0000", 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7613000000000005e-05 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.13038272, 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029764269999999998, 2024-04-17T15:37:59.143 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 817 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949248+0000", 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4099999999999998e-06 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949264+0000", 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6364000000000001e-05 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949296+0000", 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1513000000000001e-05 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949317+0000", 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1403000000000002e-05 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949509+0000", 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019130500000000001 2024-04-17T15:37:59.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949747+0000", 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000238039 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.950063+0000", 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031621399999999999 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.951228+0000", 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001165379 2024-04-17T15:37:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952068+0000", 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000839674 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952156+0000", 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8313000000000006e-05 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952222+0000", 2024-04-17T15:37:59.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5813000000000002e-05 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.126446059999999, 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029501589999999999, 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.149 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 819 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953184+0000", 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.973e-06 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953198+0000", 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3657e-05 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953229+0000", 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1486000000000003e-05 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953248+0000", 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187000000000001e-05 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953356+0000", 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107909 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953484+0000", 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012820600000000001 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953773+0000", 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028948800000000002 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.954862+0000", 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001088365 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.955975+0000", 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001113326 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956061+0000", 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6470000000000004e-05 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956133+0000", 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1092000000000003e-05 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.075091909000001, 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029884, 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 841 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004539+0000", 2024-04-17T15:37:59.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2630000000000002e-06 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004551+0000", 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2680000000000001e-05 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004582+0000", 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0700000000000001e-05 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004597+0000", 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.501e-05 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004732+0000", 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013490900000000001 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004956+0000", 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022391800000000001 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.005298+0000", 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034173100000000001 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.006602+0000", 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013043810000000001 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007387+0000", 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000784635 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007467+0000", 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0661999999999994e-05 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007525+0000", 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7510999999999999e-05 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.060169766000001, 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031389679999999998, 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.161 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 847 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:37:59.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019461+0000", 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.277e-06 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019472+0000", 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1319e-05 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019503+0000", 2024-04-17T15:37:59.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0626999999999997e-05 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019517+0000", 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019652+0000", 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013442799999999999 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019977+0000", 2024-04-17T15:37:59.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032536300000000001 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.020521+0000", 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00054383700000000003 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.021843+0000", 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001321593 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022433+0000", 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058991600000000001 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022517+0000", 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4845999999999994e-05 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022598+0000", 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0185999999999994e-05 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.011210724999998, 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034503820000000001, 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 868 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068420+0000", 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1330000000000002e-06 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068432+0000", 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2646000000000001e-05 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068463+0000", 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0170000000000001e-05 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068477+0000", 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4797000000000001e-05 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068645+0000", 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016787200000000001 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068999+0000", 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035414099999999998 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.069565+0000", 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056531599999999995 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.170 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.070818+0000", 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001252932 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071707+0000", 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088886 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071793+0000", 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6885999999999994e-05 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071868+0000", 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4629000000000007e-05 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.918564343, 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030204519999999999, 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.172 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 907 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161067+0000", 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4329999999999998e-06 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161077+0000", 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0910000000000001e-05 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161109+0000", 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1288999999999998e-05 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161123+0000", 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4739999999999999e-05 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161242+0000", 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011889 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.175 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161468+0000", 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022609099999999999 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161805+0000", 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612099999999999 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.162878+0000", 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001073606 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.176 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.163928+0000", 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00104958 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164017+0000", 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9284999999999996e-05 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164085+0000", 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7507000000000003e-05 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.177 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.817787897999999, 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003409006, 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 949 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.178 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261844+0000", 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.993e-06 2024-04-17T15:37:59.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261857+0000", 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261902+0000", 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5286e-05 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261926+0000", 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3757e-05 2024-04-17T15:37:59.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262112+0000", 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018562900000000001 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262494+0000", 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038215999999999999 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262901+0000", 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040692000000000001 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.264939+0000", 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020382400000000002 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265106+0000", 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016660500000000001 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265187+0000", 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:37:59.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265250+0000", 2024-04-17T15:37:59.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2063000000000005e-05 2024-04-17T15:37:59.183 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.183 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.183 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.185 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.185 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.813488405000001, 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032687240000000002, 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 951 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266142+0000", 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6640000000000001e-06 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266151+0000", 2024-04-17T15:37:59.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5829999999999996e-06 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266177+0000", 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.55e-05 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266189+0000", 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2139e-05 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266301+0000", 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011170700000000001 2024-04-17T15:37:59.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266418+0000", 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117599 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266690+0000", 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027164099999999998 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.268256+0000", 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001565842 2024-04-17T15:37:59.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269168+0000", 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00091194099999999999 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269297+0000", 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012897900000000001 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269409+0000", 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112129 2024-04-17T15:37:59.190 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.802684730000003, 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030567260000000001, 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 955 2024-04-17T15:37:59.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276946+0000", 2024-04-17T15:37:59.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6139999999999999e-06 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276959+0000", 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.279e-05 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276992+0000", 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2981999999999997e-05 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277008+0000", 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6127e-05 2024-04-17T15:37:59.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277162+0000", 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015356199999999999 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277427+0000", 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026516799999999998 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277784+0000", 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035701500000000002 2024-04-17T15:37:59.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279283+0000", 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499479 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279849+0000", 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056583000000000002 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279935+0000", 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5649000000000006e-05 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280000+0000", 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5510000000000001e-05 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.798706127999999, 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028646269999999998, 2024-04-17T15:37:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 957 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280924+0000", 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.894e-06 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280934+0000", 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6299999999999993e-06 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280960+0000", 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280986+0000", 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5913000000000001e-05 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281095+0000", 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109212 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281215+0000", 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120469 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281472+0000", 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025682199999999997 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.282766+0000", 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001293521 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283642+0000", 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087648000000000001 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283727+0000", 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4874000000000001e-05 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283787+0000", 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9892000000000002e-05 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.201 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.202 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:59.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:37:59.203 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:59.198+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:59.304 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:37:59.302+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:37:59.385 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:59.385 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:59.385 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:37:59.385 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:59.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:37:59.417 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.6 to 1 (10000) 2024-04-17T15:37:59.420 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:59.421+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:59.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-17T15:37:59.523 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:59.523 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:37:59.524 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:37:59.524 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:37:59.524 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:59.524 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:37:59.521+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:37:59.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:37:59.628 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:37:59.629+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:37:59.707 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:37:59.706+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:37:59.713 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:37:59.713 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:37:59.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:37:59.713 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:37:59.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.713 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-17T15:37:59.713 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:37:59.713 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 59.458737696999997, 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063603720000000004, 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "reached pg", 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 44 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:37:59.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253462+0000", 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253499+0000", 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7339999999999998e-05 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253536+0000", 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6746999999999999e-05 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253562+0000", 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6095999999999999e-05 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253940+0000", 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037773800000000002 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for peered", 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253962+0000", 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2566e-05 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259497+0000", 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055350269999999997 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259819+0000", 2024-04-17T15:37:59.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000321792 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040977412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.408409466000002, 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049681100000000004, 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 57 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303788+0000", 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.55e-06 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303797+0000", 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8820000000000007e-06 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303842+0000", 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4231999999999999e-05 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303856+0000", 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4307e-05 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303983+0000", 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127577 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304194+0000", 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000210299 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304573+0000", 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037939199999999999 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.305923+0000", 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013502500000000001 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308569+0000", 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026456159999999999 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308655+0000", 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5539999999999998e-05 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308755+0000", 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010046499999999999 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.723 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040977413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.405782047000002, 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047062060000000001, 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 59 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306416+0000", 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306424+0000", 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7519999999999996e-06 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306446+0000", 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2155e-05 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306456+0000", 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0523000000000001e-05 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306569+0000", 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112277 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306739+0000", 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170688 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307048+0000", 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030829700000000002 2024-04-17T15:37:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310444+0000", 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033961629999999998 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310828+0000", 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038433500000000003 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310956+0000", 2024-04-17T15:37:59.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127997 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.311121+0000", 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016447900000000001 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.429791014000003, 2024-04-17T15:37:59.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059605389999999999, 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 207 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282410+0000", 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3959999999999999e-06 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282431+0000", 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0996999999999999e-05 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282475+0000", 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4703000000000002e-05 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282501+0000", 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5627e-05 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282659+0000", 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015803900000000001 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282916+0000", 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025698099999999998 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.283628+0000", 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00071140199999999998 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.286242+0000", 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002614782 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288105+0000", 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862437 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288260+0000", 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015568900000000001 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288366+0000", 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000105486 2024-04-17T15:37:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.391786428000003, 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033450900000000002, 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 216 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320413+0000", 2024-04-17T15:37:59.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.65e-06 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320426+0000", 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2972999999999999e-05 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2326999999999997e-05 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320473+0000", 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4763000000000001e-05 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320604+0000", 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013095899999999999 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320836+0000", 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000232012 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.321267+0000", 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043098000000000002 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.322958+0000", 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016909189999999999 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323607+0000", 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00064901100000000001 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323691+0000", 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4383999999999997e-05 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323755+0000", 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4111999999999999e-05 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.740 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.351554495999999, 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036511180000000001, 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.741 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 227 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360644+0000", 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360656+0000", 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.217e-05 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360689+0000", 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2778999999999999e-05 2024-04-17T15:37:59.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360704+0000", 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5187e-05 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360849+0000", 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144315 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361057+0000", 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020802200000000001 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361490+0000", 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043335100000000001 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.363127+0000", 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001636832 2024-04-17T15:37:59.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364063+0000", 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093582599999999995 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364177+0000", 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011425300000000001 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364293+0000", 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115943 2024-04-17T15:37:59.746 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.343619595, 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003177409, 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.747 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 229 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368579+0000", 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2740000000000002e-06 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368591+0000", 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1456e-05 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368623+0000", 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2474000000000001e-05 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368638+0000", 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.502e-05 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368758+0000", 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000119505 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368990+0000", 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023266199999999999 2024-04-17T15:37:59.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.369391+0000", 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040097100000000002 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.370944+0000", 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015525389999999999 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371613+0000", 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00066936899999999995 2024-04-17T15:37:59.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371693+0000", 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9886000000000001e-05 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371754+0000", 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1253000000000005e-05 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.336536770000002, 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033033200000000002, 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.753 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 231 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375662+0000", 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375673+0000", 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1678999999999999e-05 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375706+0000", 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2293999999999999e-05 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375721+0000", 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.522e-05 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375868+0000", 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014661200000000001 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376071+0000", 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020339199999999999 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376467+0000", 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039612099999999998 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.377887+0000", 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001419696 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378819+0000", 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093196000000000001 2024-04-17T15:37:59.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378902+0000", 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2977000000000002e-05 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378963+0000", 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1241999999999994e-05 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.758 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:345 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.294981300000003, 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003233755, 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 345 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417216+0000", 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417223+0000", 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3969999999999999e-06 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417240+0000", 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7711e-05 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417250+0000", 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3789999999999995e-06 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417308+0000", 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8663999999999999e-05 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417398+0000", 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9524000000000005e-05 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417555+0000", 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015700299999999999 2024-04-17T15:37:59.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.418480+0000", 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00092510400000000005 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420343+0000", 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862596 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420402+0000", 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.944e-05 2024-04-17T15:37:59.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420449+0000", 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6832000000000002e-05 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:398 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:37:59.764 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.278408204999998, 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041188789999999998, 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 398 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433789+0000", 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433794+0000", 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1490000000000002e-06 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433807+0000", 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2334000000000001e-05 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433813+0000", 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1240000000000002e-06 2024-04-17T15:37:59.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433875+0000", 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2309000000000003e-05 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433976+0000", 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100577 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434109+0000", 2024-04-17T15:37:59.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013374099999999999 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434711+0000", 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060139999999999998 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437854+0000", 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031429069999999999 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437883+0000", 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9539999999999998e-05 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437907+0000", 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3947999999999998e-05 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:402 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.276508186000001, 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047817750000000003, 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 402 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:37:59.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435689+0000", 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.850000000000001e-07 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435693+0000", 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435705+0000", 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1484000000000001e-05 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435713+0000", 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6699999999999994e-06 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435756+0000", 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3519999999999997e-05 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435812+0000", 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5998000000000002e-05 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435942+0000", 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000129596 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.436441+0000", 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049949700000000001 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440415+0000", 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039740690000000002 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440444+0000", 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9156999999999999e-05 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440470+0000", 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5499000000000001e-05 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:522 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.205355810999997, 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031631699999999999, 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.776 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 522 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506842+0000", 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1629999999999999e-06 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506847+0000", 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506861+0000", 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3811e-05 2024-04-17T15:37:59.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506871+0000", 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5429999999999999e-06 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506925+0000", 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4740000000000001e-05 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507027+0000", 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101766 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507209+0000", 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018180900000000001 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509722+0000", 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025127539999999999 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509938+0000", 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021666099999999999 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509978+0000", 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9987000000000002e-05 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.510004+0000", 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5316999999999998e-05 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:607 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.131574350000001, 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003551916, 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 607 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.782 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580623+0000", 2024-04-17T15:37:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4020000000000001e-06 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580632+0000", 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1459999999999996e-06 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580654+0000", 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2446000000000002e-05 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580665+0000", 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1165000000000001e-05 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580780+0000", 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114973 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580917+0000", 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013664300000000001 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581189+0000", 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027190100000000001 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582345+0000", 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00115599 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583899+0000", 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015540319999999999 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584059+0000", 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016074500000000001 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584174+0000", 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114473 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.787 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:611 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.125384400999998, 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033528170000000001, 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 611 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586814+0000", 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9860000000000001e-06 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586825+0000", 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0686000000000001e-05 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586853+0000", 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8365e-05 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586866+0000", 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587014+0000", 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014742600000000001 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587227+0000", 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021381800000000001 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587506+0000", 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027870100000000001 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.588524+0000", 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001018157 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.589970+0000", 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014462590000000001 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590061+0000", 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0138999999999999e-05 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590165+0000", 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104168 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.039569724000003, 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034329339999999999, 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.793 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 703 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672629+0000", 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0080000000000001e-06 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672638+0000", 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1419999999999999e-06 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672664+0000", 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5905e-05 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672676+0000", 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2337000000000001e-05 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672840+0000", 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016395 2024-04-17T15:37:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673166+0000", 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000326275 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673711+0000", 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000545047 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675036+0000", 2024-04-17T15:37:59.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013244940000000001 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675808+0000", 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00077264900000000004 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675951+0000", 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014292499999999999 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.676060+0000", 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010820200000000001 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 54.010395711999998, 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003556245, 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.799 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 715 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:37:59.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701803+0000", 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701818+0000", 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5223e-05 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701849+0000", 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1035999999999999e-05 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701866+0000", 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6643999999999999e-05 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702012+0000", 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014634700000000001 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702345+0000", 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033299399999999998 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702866+0000", 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052063999999999995 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.704096+0000", 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001229988 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705095+0000", 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00099944500000000006 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705240+0000", 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144287 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705357+0000", 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117191 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.804 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.855669100999997, 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035344460000000001, 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 778 2024-04-17T15:37:59.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856530+0000", 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3199999999999998e-06 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856541+0000", 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.183e-05 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856573+0000", 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2060000000000001e-05 2024-04-17T15:37:59.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856590+0000", 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6356000000000001e-05 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856741+0000", 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158899999999999 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857099+0000", 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035803499999999998 2024-04-17T15:37:59.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857663+0000", 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056350599999999997 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859015+0000", 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013523299999999999 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859910+0000", 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00089519100000000004 2024-04-17T15:37:59.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859996+0000", 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5673000000000005e-05 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.860062+0000", 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5555999999999994e-05 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.741861327999999, 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032371169999999999, 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 826 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970337+0000", 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970349+0000", 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1440000000000001e-05 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970381+0000", 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1896000000000001e-05 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970395+0000", 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4867e-05 2024-04-17T15:37:59.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970554+0000", 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015837199999999999 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970926+0000", 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037184099999999998 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.971531+0000", 2024-04-17T15:37:59.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060493600000000004 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.972848+0000", 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013169340000000001 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973421+0000", 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057373600000000004 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973506+0000", 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4285999999999999e-05 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973572+0000", 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6586000000000002e-05 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.816 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.650853204999997, 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003083728, 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 865 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061345+0000", 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:37:59.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061356+0000", 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0823e-05 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061387+0000", 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0766999999999999e-05 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061402+0000", 2024-04-17T15:37:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5379999999999998e-05 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061519+0000", 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117265 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061739+0000", 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000219106 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.062054+0000", 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031500400000000002 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.063247+0000", 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011935979999999999 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064266+0000", 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001019023 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064359+0000", 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3040000000000004e-05 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064427+0000", 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7665999999999999e-05 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 53.479812011, 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031575179999999998, 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 937 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232386+0000", 2024-04-17T15:37:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232398+0000", 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1864e-05 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232426+0000", 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232440+0000", 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.412e-05 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232621+0000", 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018099899999999999 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232854+0000", 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023273400000000001 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.233176+0000", 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032190499999999999 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.234217+0000", 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001040673 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235396+0000", 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001179835 2024-04-17T15:37:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235480+0000", 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3473000000000005e-05 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235542+0000", 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2042e-05 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:37:59.828 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:37:59.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:37:59.830 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:37:59.829+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:37:59.931 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:37:59.930+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:37:59.965 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:37:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:37:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:37:59.965 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:37:59.979 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:00.032 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:00.029+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:00.133 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:00.133+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:00.162 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:00.162 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:00.162 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:00.162 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:00.162 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:00.177 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:00.234 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:00.233+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:00.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:46 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.030227791999998, 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006071562, 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.305 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273829+0000", 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.984e-06 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273845+0000", 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.541e-05 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273886+0000", 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1556e-05 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273920+0000", 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3668999999999999e-05 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274134+0000", 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000213952 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274182+0000", 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7706e-05 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279811+0000", 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056294029999999998 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279899+0000", 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7881999999999996e-05 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.309 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:47 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.020954533000001, 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048203359999999997, 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283103+0000", 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283119+0000", 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6509000000000001e-05 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283153+0000", 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4037e-05 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283175+0000", 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1212999999999998e-05 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283298+0000", 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123712 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283344+0000", 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6136e-05 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287839+0000", 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004494634 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287921+0000", 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1932000000000001e-05 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.313 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.001604041999997, 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032981249999999998, 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 211 2024-04-17T15:38:00.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302454+0000", 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302467+0000", 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2996999999999999e-05 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302501+0000", 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4075999999999997e-05 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302525+0000", 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3737e-05 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302682+0000", 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157038 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302937+0000", 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025471400000000001 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:00.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.303366+0000", 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042908300000000003 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305046+0000", 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001680193 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305575+0000", 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052928199999999995 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305676+0000", 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100382 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305749+0000", 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3510000000000006e-05 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.319 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.923829517999998, 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032452660000000001, 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 232 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380228+0000", 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380240+0000", 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380274+0000", 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3957e-05 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380297+0000", 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3319000000000002e-05 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380435+0000", 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137596 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380662+0000", 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022724099999999999 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.381091+0000", 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000429336 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.382850+0000", 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017586800000000001 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383310+0000", 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000460092 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383400+0000", 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9575999999999998e-05 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383471+0000", 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1268999999999998e-05 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.897408425999998, 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036624269999999998, 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.325 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 278 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:00.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406649+0000", 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6000000000000001e-06 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406663+0000", 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3845999999999999e-05 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406699+0000", 2024-04-17T15:38:00.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5726000000000003e-05 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406722+0000", 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.304e-05 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406888+0000", 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166272 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407203+0000", 2024-04-17T15:38:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031472299999999999 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407899+0000", 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069595699999999998 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.409321+0000", 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014219759999999999 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410041+0000", 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00072015299999999996 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410183+0000", 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142003 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410309+0000", 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126131 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:353 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.885071240999999, 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047116850000000002, 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 353 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.331 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418987+0000", 2024-04-17T15:38:00.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.853e-06 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419003+0000", 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5973000000000001e-05 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419043+0000", 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9975999999999998e-05 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419064+0000", 2024-04-17T15:38:00.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1607000000000002e-05 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419233+0000", 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168908 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419516+0000", 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028298800000000002 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:00.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419933+0000", 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000416329 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421589+0000", 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016564139999999999 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423544+0000", 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019552250000000001 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423632+0000", 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7416000000000005e-05 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423696+0000", 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3996000000000002e-05 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:398 6.6 e30/24 6:66924383:reshard::reshard.0000000005:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.868803599000003, 2024-04-17T15:38:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033955729999999998, 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435253+0000", 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.666e-06 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435266+0000", 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2564e-05 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435303+0000", 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7568999999999999e-05 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435322+0000", 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8743e-05 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435474+0000", 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015201900000000001 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435532+0000", 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7902000000000002e-05 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438561+0000", 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030286449999999999 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438647+0000", 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6465000000000006e-05 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.809947381999997, 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003409586, 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.341 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494109+0000", 2024-04-17T15:38:00.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.595e-06 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494118+0000", 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1969999999999996e-06 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494140+0000", 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2617e-05 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494151+0000", 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1174e-05 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494293+0000", 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014123900000000001 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494691+0000", 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039822399999999997 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495275+0000", 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058460000000000001 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497150+0000", 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018747550000000001 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497292+0000", 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141321 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497400+0000", 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010853099999999999 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497517+0000", 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117333 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:551 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.770589184000002, 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003045336, 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 551 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.347 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533469+0000", 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.897e-06 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533486+0000", 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816e-05 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533523+0000", 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6993999999999999e-05 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533540+0000", 2024-04-17T15:38:00.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7186000000000001e-05 2024-04-17T15:38:00.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533699+0000", 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015882799999999999 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534082+0000", 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038348700000000001 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534670+0000", 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058795799999999997 2024-04-17T15:38:00.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.535977+0000", 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001306357 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536289+0000", 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000312906 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536410+0000", 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120999 2024-04-17T15:38:00.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536511+0000", 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100908 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:649 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.685093467000002, 2024-04-17T15:38:00.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031209179999999999, 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 649 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618964+0000", 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6120000000000001e-06 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618977+0000", 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2574e-05 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619012+0000", 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5051e-05 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619032+0000", 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0071000000000001e-05 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619181+0000", 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148627 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619432+0000", 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251081 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619949+0000", 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051755200000000001 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621369+0000", 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00141994 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621936+0000", 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056712400000000001 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622018+0000", 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1652999999999999e-05 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622083+0000", 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4633000000000003e-05 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.360 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.360 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:00.360 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.615667555999998, 2024-04-17T15:38:00.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032122729999999999, 2024-04-17T15:38:00.360 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.360 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 709 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688390+0000", 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3039999999999999e-06 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688402+0000", 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2082999999999999e-05 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688432+0000", 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0332999999999999e-05 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688447+0000", 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5046e-05 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688568+0000", 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121026 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688772+0000", 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020336799999999999 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.689092+0000", 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032027999999999999 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.690444+0000", 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013523470000000001 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691292+0000", 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084744900000000001 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691459+0000", 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166692 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691600+0000", 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141345 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.573636643999997, 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002981652, 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.366 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 726 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730421+0000", 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1399999999999998e-06 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730436+0000", 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5233e-05 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730468+0000", 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1574e-05 2024-04-17T15:38:00.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730482+0000", 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4693e-05 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730616+0000", 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013382800000000001 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730851+0000", 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000235455 2024-04-17T15:38:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.731336+0000", 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048426600000000002 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.732933+0000", 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001597198 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733250+0000", 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031682299999999999 2024-04-17T15:38:00.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733330+0000", 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9752999999999993e-05 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733400+0000", 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0689e-05 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.371 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.570299542000001, 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003233166, 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 727 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733758+0000", 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.114e-06 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733769+0000", 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1226000000000001e-05 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733792+0000", 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2580000000000001e-05 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733804+0000", 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2763e-05 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733944+0000", 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013943199999999999 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734191+0000", 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024684799999999998 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734584+0000", 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039304900000000002 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.735780+0000", 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011960320000000001 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736834+0000", 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010541400000000001 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736925+0000", 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1101999999999996e-05 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736989+0000", 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3880000000000005e-05 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.377 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.206071794000003, 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033824100000000002, 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 880 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:00.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097987+0000", 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1159999999999999e-06 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098022+0000", 2024-04-17T15:38:00.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-05 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098054+0000", 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1983000000000002e-05 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098069+0000", 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512999999999999e-05 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098228+0000", 2024-04-17T15:38:00.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015874500000000001 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098633+0000", 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040438300000000002 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.099238+0000", 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060534800000000002 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.100508+0000", 2024-04-17T15:38:00.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00127024 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101208+0000", 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069981399999999999 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101295+0000", 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6722000000000001e-05 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101366+0000", 2024-04-17T15:38:00.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1145999999999999e-05 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.201578175000002, 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032254129999999999, 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.383 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 882 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102479+0000", 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102490+0000", 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0380000000000001e-05 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102521+0000", 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1529999999999998e-05 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102537+0000", 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.577e-05 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102681+0000", 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102934+0000", 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025325100000000002 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.103425+0000", 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049086500000000005 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.104689+0000", 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012646879999999999 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105549+0000", 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085963200000000004 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105637+0000", 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8438999999999998e-05 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105702+0000", 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5005999999999994e-05 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.388 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.198092291000002, 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030913970000000001, 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:00.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105965+0000", 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105975+0000", 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9729999999999992e-06 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106001+0000", 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6253000000000001e-05 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106015+0000", 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3353000000000001e-05 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106141+0000", 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012648600000000001 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106412+0000", 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027110699999999998 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106757+0000", 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000344657 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108260+0000", 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015027949999999999 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108842+0000", 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058205799999999999 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108934+0000", 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1792999999999993e-05 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.109054+0000", 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120665 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.127978249000002, 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030928700000000002, 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.394 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 913 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:00.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176080+0000", 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8030000000000001e-06 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176092+0000", 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2306999999999999e-05 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176122+0000", 2024-04-17T15:38:00.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9569000000000001e-05 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176143+0000", 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.156e-05 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176345+0000", 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020190099999999999 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176576+0000", 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231091 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176903+0000", 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000326874 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.178180+0000", 2024-04-17T15:38:00.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001276868 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179011+0000", 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083103199999999999 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179102+0000", 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0919000000000001e-05 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179170+0000", 2024-04-17T15:38:00.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.099332642999997, 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031669530000000001, 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 925 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204725+0000", 2024-04-17T15:38:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204737+0000", 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2116000000000001e-05 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204768+0000", 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0676999999999998e-05 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204789+0000", 2024-04-17T15:38:00.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1739999999999999e-05 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204946+0000", 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015635099999999999 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205169+0000", 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223062 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205492+0000", 2024-04-17T15:38:00.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032312699999999998 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.206626+0000", 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011343589999999999 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207735+0000", 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011090659999999999 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207824+0000", 2024-04-17T15:38:00.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8603000000000005e-05 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207890+0000", 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5642000000000006e-05 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.091933077, 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030226580000000001, 2024-04-17T15:38:00.405 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 928 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212124+0000", 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1840000000000002e-06 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212136+0000", 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2106000000000001e-05 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212176+0000", 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9643e-05 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212196+0000", 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212325+0000", 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012877200000000001 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212601+0000", 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000275588 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212945+0000", 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034397600000000001 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214619+0000", 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016741779999999999 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214908+0000", 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028898299999999998 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215028+0000", 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120456 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215145+0000", 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116369 2024-04-17T15:38:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.087768093000001, 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032898250000000001, 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 930 2024-04-17T15:38:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:00.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216288+0000", 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3260000000000001e-06 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216297+0000", 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0770000000000008e-06 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216318+0000", 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1869999999999999e-05 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216329+0000", 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.079e-05 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216469+0000", 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013962499999999999 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216725+0000", 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025639100000000002 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.217223+0000", 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049742899999999997 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.218588+0000", 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00136539 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219283+0000", 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069527 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219452+0000", 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168708 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219577+0000", 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012494900000000001 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.418 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:00.418 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:00.418 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:00.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:00.420 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:00.417+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:00.423 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.7 to 1 (10000) 2024-04-17T15:38:00.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:38:00.450 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-17T15:38:00.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:38:00.460 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:00.460 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:00.478 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:00.479 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:00.496 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:00.496 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:00.515 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:00.520 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:00.517+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:00.534 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:00.534 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:00.551 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:00.551 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:00.559 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:00.566 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:00.587 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:00.587 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:00.619 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:00.619 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:00.621 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:00.621+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:00.694 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:00.694 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:00.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:00.722 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:00.721+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:00.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:38:00.798 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:38:00.806 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-17T15:38:00.422733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":809,"num_read_kb":552,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230680,"kb_used_data":6168,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744040,"statfs":{"total":773094113280,"available":772857896960,"internally_reserved":0,"allocated":6316032,"data_stored":3750438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046897"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050190+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:37:56.050190+0000","last_peered":"2024-04-17T15:37:56.050190+0000","last_clean":"2024-04-17T15:37:56.050190+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:37:56.050190+0000","last_undegraded":"2024-04-17T15:37:56.050190+0000","last_fullsized":"2024-04-17T15:37:56.050190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048583+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:37:56.048583+0000","last_peered":"2024-04-17T15:37:56.048583+0000","last_clean":"2024-04-17T15:37:56.048583+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:37:56.048583+0000","last_undegraded":"2024-04-17T15:37:56.048583+0000","last_fullsized":"2024-04-17T15:37:56.048583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385194+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:37:55.385194+0000","last_peered":"2024-04-17T15:37:55.385194+0000","last_clean":"2024-04-17T15:37:55.385194+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:37:55.385194+0000","last_undegraded":"2024-04-17T15:37:55.385194+0000","last_fullsized":"2024-04-17T15:37:55.385194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048150+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:37:56.048150+0000","last_peered":"2024-04-17T15:37:56.048150+0000","last_clean":"2024-04-17T15:37:56.048150+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:37:56.048150+0000","last_undegraded":"2024-04-17T15:37:56.048150+0000","last_fullsized":"2024-04-17T15:37:56.048150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050404+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:37:56.050404+0000","last_peered":"2024-04-17T15:37:56.050404+0000","last_clean":"2024-04-17T15:37:56.050404+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:37:56.050404+0000","last_undegraded":"2024-04-17T15:37:56.050404+0000","last_fullsized":"2024-04-17T15:37:56.050404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048765+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:37:56.048765+0000","last_peered":"2024-04-17T15:37:56.048765+0000","last_clean":"2024-04-17T15:37:56.048765+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:37:56.048765+0000","last_undegraded":"2024-04-17T15:37:56.048765+0000","last_fullsized":"2024-04-17T15:37:56.048765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053175+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:37:56.053175+0000","last_peered":"2024-04-17T15:37:56.053175+0000","last_clean":"2024-04-17T15:37:56.053175+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:37:56.053175+0000","last_undegraded":"2024-04-17T15:37:56.053175+0000","last_fullsized":"2024-04-17T15:37:56.053175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050405+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:37:56.050405+0000","last_peered":"2024-04-17T15:37:56.050405+0000","last_clean":"2024-04-17T15:37:56.050405+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:37:56.050405+0000","last_undegraded":"2024-04-17T15:37:56.050405+0000","last_fullsized":"2024-04-17T15:37:56.050405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050448+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:37:56.050448+0000","last_peered":"2024-04-17T15:37:56.050448+0000","last_clean":"2024-04-17T15:37:56.050448+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:37:56.050448+0000","last_undegraded":"2024-04-17T15:37:56.050448+0000","last_fullsized":"2024-04-17T15:37:56.050448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381066+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:37:55.381066+0000","last_peered":"2024-04-17T15:37:55.381066+0000","last_clean":"2024-04-17T15:37:55.381066+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:37:55.381066+0000","last_undegraded":"2024-04-17T15:37:55.381066+0000","last_fullsized":"2024-04-17T15:37:55.381066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051999+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:37:56.051999+0000","last_peered":"2024-04-17T15:37:56.051999+0000","last_clean":"2024-04-17T15:37:56.051999+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:37:56.051999+0000","last_undegraded":"2024-04-17T15:37:56.051999+0000","last_fullsized":"2024-04-17T15:37:56.051999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050556+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:37:56.050556+0000","last_peered":"2024-04-17T15:37:56.050556+0000","last_clean":"2024-04-17T15:37:56.050556+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:37:56.050556+0000","last_undegraded":"2024-04-17T15:37:56.050556+0000","last_fullsized":"2024-04-17T15:37:56.050556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048374+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:37:56.048374+0000","last_peered":"2024-04-17T15:37:56.048374+0000","last_clean":"2024-04-17T15:37:56.048374+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:37:56.048374+0000","last_undegraded":"2024-04-17T15:37:56.048374+0000","last_fullsized":"2024-04-17T15:37:56.048374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053609+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:37:56.053609+0000","last_peered":"2024-04-17T15:37:56.053609+0000","last_clean":"2024-04-17T15:37:56.053609+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:37:56.053609+0000","last_undegraded":"2024-04-17T15:37:56.053609+0000","last_fullsized":"2024-04-17T15:37:56.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382070+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:37:56.382070+0000","last_peered":"2024-04-17T15:37:56.382070+0000","last_clean":"2024-04-17T15:37:56.382070+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:37:56.382070+0000","last_undegraded":"2024-04-17T15:37:56.382070+0000","last_fullsized":"2024-04-17T15:37:56.382070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839570+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:37:55.839570+0000","last_peered":"2024-04-17T15:37:55.839570+0000","last_clean":"2024-04-17T15:37:55.839570+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:37:55.839570+0000","last_undegraded":"2024-04-17T15:37:55.839570+0000","last_fullsized":"2024-04-17T15:37:55.839570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050709+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:37:56.050709+0000","last_peered":"2024-04-17T15:37:56.050709+0000","last_clean":"2024-04-17T15:37:56.050709+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:37:56.050709+0000","last_undegraded":"2024-04-17T15:37:56.050709+0000","last_fullsized":"2024-04-17T15:37:56.050709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050309+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:37:56.050309+0000","last_peered":"2024-04-17T15:37:56.050309+0000","last_clean":"2024-04-17T15:37:56.050309+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:37:56.050309+0000","last_undegraded":"2024-04-17T15:37:56.050309+0000","last_fullsized":"2024-04-17T15:37:56.050309+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048258+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:37:56.048258+0000","last_peered":"2024-04-17T15:37:56.048258+0000","last_clean":"2024-04-17T15:37:56.048258+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:37:56.048258+0000","last_undegraded":"2024-04-17T15:37:56.048258+0000","last_fullsized":"2024-04-17T15:37:56.048258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381793+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:37:55.381793+0000","last_peered":"2024-04-17T15:37:55.381793+0000","last_clean":"2024-04-17T15:37:55.381793+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:37:55.381793+0000","last_undegraded":"2024-04-17T15:37:55.381793+0000","last_fullsized":"2024-04-17T15:37:55.381793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052222+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:37:56.052222+0000","last_peered":"2024-04-17T15:37:56.052222+0000","last_clean":"2024-04-17T15:37:56.052222+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:37:56.052222+0000","last_undegraded":"2024-04-17T15:37:56.052222+0000","last_fullsized":"2024-04-17T15:37:56.052222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381942+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:37:55.381942+0000","last_peered":"2024-04-17T15:37:55.381942+0000","last_clean":"2024-04-17T15:37:55.381942+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:37:55.381942+0000","last_undegraded":"2024-04-17T15:37:55.381942+0000","last_fullsized":"2024-04-17T15:37:55.381942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839097+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:37:55.839097+0000","last_peered":"2024-04-17T15:37:55.839097+0000","last_clean":"2024-04-17T15:37:55.839097+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:37:55.839097+0000","last_undegraded":"2024-04-17T15:37:55.839097+0000","last_fullsized":"2024-04-17T15:37:55.839097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049324+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:37:56.049324+0000","last_peered":"2024-04-17T15:37:56.049324+0000","last_clean":"2024-04-17T15:37:56.049324+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:37:56.049324+0000","last_undegraded":"2024-04-17T15:37:56.049324+0000","last_fullsized":"2024-04-17T15:37:56.049324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839190+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:37:55.839190+0000","last_peered":"2024-04-17T15:37:55.839190+0000","last_clean":"2024-04-17T15:37:55.839190+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:37:55.839190+0000","last_undegraded":"2024-04-17T15:37:55.839190+0000","last_fullsized":"2024-04-17T15:37:55.839190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384094+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:37:56.384094+0000","last_peered":"2024-04-17T15:37:56.384094+0000","last_clean":"2024-04-17T15:37:56.384094+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:37:56.384094+0000","last_undegraded":"2024-04-17T15:37:56.384094+0000","last_fullsized":"2024-04-17T15:37:56.384094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050588+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:37:56.050588+0000","last_peered":"2024-04-17T15:37:56.050588+0000","last_clean":"2024-04-17T15:37:56.050588+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:37:56.050588+0000","last_undegraded":"2024-04-17T15:37:56.050588+0000","last_fullsized":"2024-04-17T15:37:56.050588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050426+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:37:56.050426+0000","last_peered":"2024-04-17T15:37:56.050426+0000","last_clean":"2024-04-17T15:37:56.050426+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:37:56.050426+0000","last_undegraded":"2024-04-17T15:37:56.050426+0000","last_fullsized":"2024-04-17T15:37:56.050426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047828+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:37:56.047828+0000","last_peered":"2024-04-17T15:37:56.047828+0000","last_clean":"2024-04-17T15:37:56.047828+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:37:56.047828+0000","last_undegraded":"2024-04-17T15:37:56.047828+0000","last_fullsized":"2024-04-17T15:37:56.047828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384771+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:37:56.384771+0000","last_peered":"2024-04-17T15:37:56.384771+0000","last_clean":"2024-04-17T15:37:56.384771+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:37:56.384771+0000","last_undegraded":"2024-04-17T15:37:56.384771+0000","last_fullsized":"2024-04-17T15:37:56.384771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049168+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:37:56.049168+0000","last_peered":"2024-04-17T15:37:56.049168+0000","last_clean":"2024-04-17T15:37:56.049168+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:37:56.049168+0000","last_undegraded":"2024-04-17T15:37:56.049168+0000","last_fullsized":"2024-04-17T15:37:56.049168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053111+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:37:56.053111+0000","last_peered":"2024-04-17T15:37:56.053111+0000","last_clean":"2024-04-17T15:37:56.053111+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:37:56.053111+0000","last_undegraded":"2024-04-17T15:37:56.053111+0000","last_fullsized":"2024-04-17T15:37:56.053111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050540+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:37:56.050540+0000","last_peered":"2024-04-17T15:37:56.050540+0000","last_clean":"2024-04-17T15:37:56.050540+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:37:56.050540+0000","last_undegraded":"2024-04-17T15:37:56.050540+0000","last_fullsized":"2024-04-17T15:37:56.050540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049939+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:37:56.049939+0000","last_peered":"2024-04-17T15:37:56.049939+0000","last_clean":"2024-04-17T15:37:56.049939+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:37:56.049939+0000","last_undegraded":"2024-04-17T15:37:56.049939+0000","last_fullsized":"2024-04-17T15:37:56.049939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051321+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:37:56.051321+0000","last_peered":"2024-04-17T15:37:56.051321+0000","last_clean":"2024-04-17T15:37:56.051321+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:37:56.051321+0000","last_undegraded":"2024-04-17T15:37:56.051321+0000","last_fullsized":"2024-04-17T15:37:56.051321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053446+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:37:56.053446+0000","last_peered":"2024-04-17T15:37:56.053446+0000","last_clean":"2024-04-17T15:37:56.053446+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:37:56.053446+0000","last_undegraded":"2024-04-17T15:37:56.053446+0000","last_fullsized":"2024-04-17T15:37:56.053446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050245+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:37:56.050245+0000","last_peered":"2024-04-17T15:37:56.050245+0000","last_clean":"2024-04-17T15:37:56.050245+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:37:56.050245+0000","last_undegraded":"2024-04-17T15:37:56.050245+0000","last_fullsized":"2024-04-17T15:37:56.050245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384370+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:37:56.384370+0000","last_peered":"2024-04-17T15:37:56.384370+0000","last_clean":"2024-04-17T15:37:56.384370+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:37:56.384370+0000","last_undegraded":"2024-04-17T15:37:56.384370+0000","last_fullsized":"2024-04-17T15:37:56.384370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050538+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:37:56.050538+0000","last_peered":"2024-04-17T15:37:56.050538+0000","last_clean":"2024-04-17T15:37:56.050538+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:37:56.050538+0000","last_undegraded":"2024-04-17T15:37:56.050538+0000","last_fullsized":"2024-04-17T15:37:56.050538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050923+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:37:56.050923+0000","last_peered":"2024-04-17T15:37:56.050923+0000","last_clean":"2024-04-17T15:37:56.050923+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:37:56.050923+0000","last_undegraded":"2024-04-17T15:37:56.050923+0000","last_fullsized":"2024-04-17T15:37:56.050923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049636+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:37:56.049636+0000","last_peered":"2024-04-17T15:37:56.049636+0000","last_clean":"2024-04-17T15:37:56.049636+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:37:56.049636+0000","last_undegraded":"2024-04-17T15:37:56.049636+0000","last_fullsized":"2024-04-17T15:37:56.049636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051775+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:37:56.051775+0000","last_peered":"2024-04-17T15:37:56.051775+0000","last_clean":"2024-04-17T15:37:56.051775+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:37:56.051775+0000","last_undegraded":"2024-04-17T15:37:56.051775+0000","last_fullsized":"2024-04-17T15:37:56.051775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048489+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:37:56.048489+0000","last_peered":"2024-04-17T15:37:56.048489+0000","last_clean":"2024-04-17T15:37:56.048489+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:37:56.048489+0000","last_undegraded":"2024-04-17T15:37:56.048489+0000","last_fullsized":"2024-04-17T15:37:56.048489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384800+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:37:56.384800+0000","last_peered":"2024-04-17T15:37:56.384800+0000","last_clean":"2024-04-17T15:37:56.384800+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:37:56.384800+0000","last_undegraded":"2024-04-17T15:37:56.384800+0000","last_fullsized":"2024-04-17T15:37:56.384800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838962+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:37:55.838962+0000","last_peered":"2024-04-17T15:37:55.838962+0000","last_clean":"2024-04-17T15:37:55.838962+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:37:55.838962+0000","last_undegraded":"2024-04-17T15:37:55.838962+0000","last_fullsized":"2024-04-17T15:37:55.838962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049625+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:37:56.049625+0000","last_peered":"2024-04-17T15:37:56.049625+0000","last_clean":"2024-04-17T15:37:56.049625+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:37:56.049625+0000","last_undegraded":"2024-04-17T15:37:56.049625+0000","last_fullsized":"2024-04-17T15:37:56.049625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049566+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:37:56.049566+0000","last_peered":"2024-04-17T15:37:56.049566+0000","last_clean":"2024-04-17T15:37:56.049566+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:37:56.049566+0000","last_undegraded":"2024-04-17T15:37:56.049566+0000","last_fullsized":"2024-04-17T15:37:56.049566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384029+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:37:56.384029+0000","last_peered":"2024-04-17T15:37:56.384029+0000","last_clean":"2024-04-17T15:37:56.384029+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:37:56.384029+0000","last_undegraded":"2024-04-17T15:37:56.384029+0000","last_fullsized":"2024-04-17T15:37:56.384029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380222+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:37:55.380222+0000","last_peered":"2024-04-17T15:37:55.380222+0000","last_clean":"2024-04-17T15:37:55.380222+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:37:55.380222+0000","last_undegraded":"2024-04-17T15:37:55.380222+0000","last_fullsized":"2024-04-17T15:37:55.380222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053291+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:37:56.053291+0000","last_peered":"2024-04-17T15:37:56.053291+0000","last_clean":"2024-04-17T15:37:56.053291+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:37:56.053291+0000","last_undegraded":"2024-04-17T15:37:56.053291+0000","last_fullsized":"2024-04-17T15:37:56.053291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049898+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:37:56.049898+0000","last_peered":"2024-04-17T15:37:56.049898+0000","last_clean":"2024-04-17T15:37:56.049898+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:37:56.049898+0000","last_undegraded":"2024-04-17T15:37:56.049898+0000","last_fullsized":"2024-04-17T15:37:56.049898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383516+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:37:56.383516+0000","last_peered":"2024-04-17T15:37:56.383516+0000","last_clean":"2024-04-17T15:37:56.383516+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:37:56.383516+0000","last_undegraded":"2024-04-17T15:37:56.383516+0000","last_fullsized":"2024-04-17T15:37:56.383516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048915+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:37:56.048915+0000","last_peered":"2024-04-17T15:37:56.048915+0000","last_clean":"2024-04-17T15:37:56.048915+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:37:56.048915+0000","last_undegraded":"2024-04-17T15:37:56.048915+0000","last_fullsized":"2024-04-17T15:37:56.048915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050447+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:37:56.050447+0000","last_peered":"2024-04-17T15:37:56.050447+0000","last_clean":"2024-04-17T15:37:56.050447+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:37:56.050447+0000","last_undegraded":"2024-04-17T15:37:56.050447+0000","last_fullsized":"2024-04-17T15:37:56.050447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048021+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:37:56.048021+0000","last_peered":"2024-04-17T15:37:56.048021+0000","last_clean":"2024-04-17T15:37:56.048021+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:37:56.048021+0000","last_undegraded":"2024-04-17T15:37:56.048021+0000","last_fullsized":"2024-04-17T15:37:56.048021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":96,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051662+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:37:56.051662+0000","last_peered":"2024-04-17T15:37:56.051662+0000","last_clean":"2024-04-17T15:37:56.051662+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:37:56.051662+0000","last_undegraded":"2024-04-17T15:37:56.051662+0000","last_fullsized":"2024-04-17T15:37:56.051662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381485+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:37:55.381485+0000","last_peered":"2024-04-17T15:37:55.381485+0000","last_clean":"2024-04-17T15:37:55.381485+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:37:55.381485+0000","last_undegraded":"2024-04-17T15:37:55.381485+0000","last_fullsized":"2024-04-17T15:37:55.381485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052909+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:37:56.052909+0000","last_peered":"2024-04-17T15:37:56.052909+0000","last_clean":"2024-04-17T15:37:56.052909+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:37:56.052909+0000","last_undegraded":"2024-04-17T15:37:56.052909+0000","last_fullsized":"2024-04-17T15:37:56.052909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048636+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:37:56.048636+0000","last_peered":"2024-04-17T15:37:56.048636+0000","last_clean":"2024-04-17T15:37:56.048636+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:37:56.048636+0000","last_undegraded":"2024-04-17T15:37:56.048636+0000","last_fullsized":"2024-04-17T15:37:56.048636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049802+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:37:56.049802+0000","last_peered":"2024-04-17T15:37:56.049802+0000","last_clean":"2024-04-17T15:37:56.049802+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:37:56.049802+0000","last_undegraded":"2024-04-17T15:37:56.049802+0000","last_fullsized":"2024-04-17T15:37:56.049802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838737+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:37:55.838737+0000","last_peered":"2024-04-17T15:37:55.838737+0000","last_clean":"2024-04-17T15:37:55.838737+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:37:55.838737+0000","last_undegraded":"2024-04-17T15:37:55.838737+0000","last_fullsized":"2024-04-17T15:37:55.838737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.385253+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:37:56.385253+0000","last_peered":"2024-04-17T15:37:56.385253+0000","last_clean":"2024-04-17T15:37:56.385253+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:37:56.385253+0000","last_undegraded":"2024-04-17T15:37:56.385253+0000","last_fullsized":"2024-04-17T15:37:56.385253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382419+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:37:56.382419+0000","last_peered":"2024-04-17T15:37:56.382419+0000","last_clean":"2024-04-17T15:37:56.382419+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:37:56.382419+0000","last_undegraded":"2024-04-17T15:37:56.382419+0000","last_fullsized":"2024-04-17T15:37:56.382419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381116+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:37:55.381116+0000","last_peered":"2024-04-17T15:37:55.381116+0000","last_clean":"2024-04-17T15:37:55.381116+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:37:55.381116+0000","last_undegraded":"2024-04-17T15:37:55.381116+0000","last_fullsized":"2024-04-17T15:37:55.381116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380676+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:37:55.380676+0000","last_peered":"2024-04-17T15:37:55.380676+0000","last_clean":"2024-04-17T15:37:55.380676+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:37:55.380676+0000","last_undegraded":"2024-04-17T15:37:55.380676+0000","last_fullsized":"2024-04-17T15:37:55.380676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050609+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:37:56.050609+0000","last_peered":"2024-04-17T15:37:56.050609+0000","last_clean":"2024-04-17T15:37:56.050609+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:37:56.050609+0000","last_undegraded":"2024-04-17T15:37:56.050609+0000","last_fullsized":"2024-04-17T15:37:56.050609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839416+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:37:55.839416+0000","last_peered":"2024-04-17T15:37:55.839416+0000","last_clean":"2024-04-17T15:37:55.839416+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:37:55.839416+0000","last_undegraded":"2024-04-17T15:37:55.839416+0000","last_fullsized":"2024-04-17T15:37:55.839416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048259+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:37:56.048259+0000","last_peered":"2024-04-17T15:37:56.048259+0000","last_clean":"2024-04-17T15:37:56.048259+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:37:56.048259+0000","last_undegraded":"2024-04-17T15:37:56.048259+0000","last_fullsized":"2024-04-17T15:37:56.048259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048968+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:37:56.048968+0000","last_peered":"2024-04-17T15:37:56.048968+0000","last_clean":"2024-04-17T15:37:56.048968+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:37:56.048968+0000","last_undegraded":"2024-04-17T15:37:56.048968+0000","last_fullsized":"2024-04-17T15:37:56.048968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050722+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:37:56.050722+0000","last_peered":"2024-04-17T15:37:56.050722+0000","last_clean":"2024-04-17T15:37:56.050722+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:37:56.050722+0000","last_undegraded":"2024-04-17T15:37:56.050722+0000","last_fullsized":"2024-04-17T15:37:56.050722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051604+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:37:56.051604+0000","last_peered":"2024-04-17T15:37:56.051604+0000","last_clean":"2024-04-17T15:37:56.051604+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:37:56.051604+0000","last_undegraded":"2024-04-17T15:37:56.051604+0000","last_fullsized":"2024-04-17T15:37:56.051604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053356+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:37:56.053356+0000","last_peered":"2024-04-17T15:37:56.053356+0000","last_clean":"2024-04-17T15:37:56.053356+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:37:56.053356+0000","last_undegraded":"2024-04-17T15:37:56.053356+0000","last_fullsized":"2024-04-17T15:37:56.053356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838944+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:37:55.838944+0000","last_peered":"2024-04-17T15:37:55.838944+0000","last_clean":"2024-04-17T15:37:55.838944+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:37:55.838944+0000","last_undegraded":"2024-04-17T15:37:55.838944+0000","last_fullsized":"2024-04-17T15:37:55.838944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049543+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:37:56.049543+0000","last_peered":"2024-04-17T15:37:56.049543+0000","last_clean":"2024-04-17T15:37:56.049543+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:37:56.049543+0000","last_undegraded":"2024-04-17T15:37:56.049543+0000","last_fullsized":"2024-04-17T15:37:56.049543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838662+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:37:55.838662+0000","last_peered":"2024-04-17T15:37:55.838662+0000","last_clean":"2024-04-17T15:37:55.838662+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:37:55.838662+0000","last_undegraded":"2024-04-17T15:37:55.838662+0000","last_fullsized":"2024-04-17T15:37:55.838662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385423+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:37:55.385423+0000","last_peered":"2024-04-17T15:37:55.385423+0000","last_clean":"2024-04-17T15:37:55.385423+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:37:55.385423+0000","last_undegraded":"2024-04-17T15:37:55.385423+0000","last_fullsized":"2024-04-17T15:37:55.385423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049803+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:37:56.049803+0000","last_peered":"2024-04-17T15:37:56.049803+0000","last_clean":"2024-04-17T15:37:56.049803+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:37:56.049803+0000","last_undegraded":"2024-04-17T15:37:56.049803+0000","last_fullsized":"2024-04-17T15:37:56.049803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383421+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:37:56.383421+0000","last_peered":"2024-04-17T15:37:56.383421+0000","last_clean":"2024-04-17T15:37:56.383421+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:37:56.383421+0000","last_undegraded":"2024-04-17T15:37:56.383421+0000","last_fullsized":"2024-04-17T15:37:56.383421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839046+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:37:55.839046+0000","last_peered":"2024-04-17T15:37:55.839046+0000","last_clean":"2024-04-17T15:37:55.839046+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:37:55.839046+0000","last_undegraded":"2024-04-17T15:37:55.839046+0000","last_fullsized":"2024-04-17T15:37:55.839046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051024+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:37:56.051024+0000","last_peered":"2024-04-17T15:37:56.051024+0000","last_clean":"2024-04-17T15:37:56.051024+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:37:56.051024+0000","last_undegraded":"2024-04-17T15:37:56.051024+0000","last_fullsized":"2024-04-17T15:37:56.051024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050596+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:37:56.050596+0000","last_peered":"2024-04-17T15:37:56.050596+0000","last_clean":"2024-04-17T15:37:56.050596+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:37:56.050596+0000","last_undegraded":"2024-04-17T15:37:56.050596+0000","last_fullsized":"2024-04-17T15:37:56.050596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381353+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:37:56.381353+0000","last_peered":"2024-04-17T15:37:56.381353+0000","last_clean":"2024-04-17T15:37:56.381353+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:37:56.381353+0000","last_undegraded":"2024-04-17T15:37:56.381353+0000","last_fullsized":"2024-04-17T15:37:56.381353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050829+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:37:56.050829+0000","last_peered":"2024-04-17T15:37:56.050829+0000","last_clean":"2024-04-17T15:37:56.050829+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:37:56.050829+0000","last_undegraded":"2024-04-17T15:37:56.050829+0000","last_fullsized":"2024-04-17T15:37:56.050829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380855+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:37:55.380855+0000","last_peered":"2024-04-17T15:37:55.380855+0000","last_clean":"2024-04-17T15:37:55.380855+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:37:55.380855+0000","last_undegraded":"2024-04-17T15:37:55.380855+0000","last_fullsized":"2024-04-17T15:37:55.380855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384605+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:37:55.384605+0000","last_peered":"2024-04-17T15:37:55.384605+0000","last_clean":"2024-04-17T15:37:55.384605+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:37:55.384605+0000","last_undegraded":"2024-04-17T15:37:55.384605+0000","last_fullsized":"2024-04-17T15:37:55.384605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839387+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:37:55.839387+0000","last_peered":"2024-04-17T15:37:55.839387+0000","last_clean":"2024-04-17T15:37:55.839387+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:37:55.839387+0000","last_undegraded":"2024-04-17T15:37:55.839387+0000","last_fullsized":"2024-04-17T15:37:55.839387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839210+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:37:55.839210+0000","last_peered":"2024-04-17T15:37:55.839210+0000","last_clean":"2024-04-17T15:37:55.839210+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:37:55.839210+0000","last_undegraded":"2024-04-17T15:37:55.839210+0000","last_fullsized":"2024-04-17T15:37:55.839210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381363+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:37:55.381363+0000","last_peered":"2024-04-17T15:37:55.381363+0000","last_clean":"2024-04-17T15:37:55.381363+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:37:55.381363+0000","last_undegraded":"2024-04-17T15:37:55.381363+0000","last_fullsized":"2024-04-17T15:37:55.381363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051433+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:37:56.051433+0000","last_peered":"2024-04-17T15:37:56.051433+0000","last_clean":"2024-04-17T15:37:56.051433+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:37:56.051433+0000","last_undegraded":"2024-04-17T15:37:56.051433+0000","last_fullsized":"2024-04-17T15:37:56.051433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049187+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:37:56.049187+0000","last_peered":"2024-04-17T15:37:56.049187+0000","last_clean":"2024-04-17T15:37:56.049187+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:37:56.049187+0000","last_undegraded":"2024-04-17T15:37:56.049187+0000","last_fullsized":"2024-04-17T15:37:56.049187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053468+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:37:56.053468+0000","last_peered":"2024-04-17T15:37:56.053468+0000","last_clean":"2024-04-17T15:37:56.053468+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:37:56.053468+0000","last_undegraded":"2024-04-17T15:37:56.053468+0000","last_fullsized":"2024-04-17T15:37:56.053468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383803+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:37:56.383803+0000","last_peered":"2024-04-17T15:37:56.383803+0000","last_clean":"2024-04-17T15:37:56.383803+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:37:56.383803+0000","last_undegraded":"2024-04-17T15:37:56.383803+0000","last_fullsized":"2024-04-17T15:37:56.383803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381324+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:37:55.381324+0000","last_peered":"2024-04-17T15:37:55.381324+0000","last_clean":"2024-04-17T15:37:55.381324+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:37:55.381324+0000","last_undegraded":"2024-04-17T15:37:55.381324+0000","last_fullsized":"2024-04-17T15:37:55.381324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048649+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:37:56.048649+0000","last_peered":"2024-04-17T15:37:56.048649+0000","last_clean":"2024-04-17T15:37:56.048649+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:37:56.048649+0000","last_undegraded":"2024-04-17T15:37:56.048649+0000","last_fullsized":"2024-04-17T15:37:56.048649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385710+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:37:55.385710+0000","last_peered":"2024-04-17T15:37:55.385710+0000","last_clean":"2024-04-17T15:37:55.385710+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:37:55.385710+0000","last_undegraded":"2024-04-17T15:37:55.385710+0000","last_fullsized":"2024-04-17T15:37:55.385710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382324+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:37:56.382324+0000","last_peered":"2024-04-17T15:37:56.382324+0000","last_clean":"2024-04-17T15:37:56.382324+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:37:56.382324+0000","last_undegraded":"2024-04-17T15:37:56.382324+0000","last_fullsized":"2024-04-17T15:37:56.382324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051236+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:37:56.051236+0000","last_peered":"2024-04-17T15:37:56.051236+0000","last_clean":"2024-04-17T15:37:56.051236+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:37:56.051236+0000","last_undegraded":"2024-04-17T15:37:56.051236+0000","last_fullsized":"2024-04-17T15:37:56.051236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053090+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:37:56.053090+0000","last_peered":"2024-04-17T15:37:56.053090+0000","last_clean":"2024-04-17T15:37:56.053090+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:37:56.053090+0000","last_undegraded":"2024-04-17T15:37:56.053090+0000","last_fullsized":"2024-04-17T15:37:56.053090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380356+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:37:55.380356+0000","last_peered":"2024-04-17T15:37:55.380356+0000","last_clean":"2024-04-17T15:37:55.380356+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:37:55.380356+0000","last_undegraded":"2024-04-17T15:37:55.380356+0000","last_fullsized":"2024-04-17T15:37:55.380356+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381399+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:37:55.381399+0000","last_peered":"2024-04-17T15:37:55.381399+0000","last_clean":"2024-04-17T15:37:55.381399+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:37:55.381399+0000","last_undegraded":"2024-04-17T15:37:55.381399+0000","last_fullsized":"2024-04-17T15:37:55.381399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381633+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:37:55.381633+0000","last_peered":"2024-04-17T15:37:55.381633+0000","last_clean":"2024-04-17T15:37:55.381633+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:37:55.381633+0000","last_undegraded":"2024-04-17T15:37:55.381633+0000","last_fullsized":"2024-04-17T15:37:55.381633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048387+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:37:56.048387+0000","last_peered":"2024-04-17T15:37:56.048387+0000","last_clean":"2024-04-17T15:37:56.048387+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:37:56.048387+0000","last_undegraded":"2024-04-17T15:37:56.048387+0000","last_fullsized":"2024-04-17T15:37:56.048387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052947+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:37:56.052947+0000","last_peered":"2024-04-17T15:37:56.052947+0000","last_clean":"2024-04-17T15:37:56.052947+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:37:56.052947+0000","last_undegraded":"2024-04-17T15:37:56.052947+0000","last_fullsized":"2024-04-17T15:37:56.052947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383317+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:37:56.383317+0000","last_peered":"2024-04-17T15:37:56.383317+0000","last_clean":"2024-04-17T15:37:56.383317+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:37:56.383317+0000","last_undegraded":"2024-04-17T15:37:56.383317+0000","last_fullsized":"2024-04-17T15:37:56.383317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051013+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:37:56.051013+0000","last_peered":"2024-04-17T15:37:56.051013+0000","last_clean":"2024-04-17T15:37:56.051013+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:37:56.051013+0000","last_undegraded":"2024-04-17T15:37:56.051013+0000","last_fullsized":"2024-04-17T15:37:56.051013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053502+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:37:56.053502+0000","last_peered":"2024-04-17T15:37:56.053502+0000","last_clean":"2024-04-17T15:37:56.053502+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:37:56.053502+0000","last_undegraded":"2024-04-17T15:37:56.053502+0000","last_fullsized":"2024-04-17T15:37:56.053502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051059+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:37:56.051059+0000","last_peered":"2024-04-17T15:37:56.051059+0000","last_clean":"2024-04-17T15:37:56.051059+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:37:56.051059+0000","last_undegraded":"2024-04-17T15:37:56.051059+0000","last_fullsized":"2024-04-17T15:37:56.051059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379763+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:37:55.379763+0000","last_peered":"2024-04-17T15:37:55.379763+0000","last_clean":"2024-04-17T15:37:55.379763+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:37:55.379763+0000","last_undegraded":"2024-04-17T15:37:55.379763+0000","last_fullsized":"2024-04-17T15:37:55.379763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051599+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:37:56.051599+0000","last_peered":"2024-04-17T15:37:56.051599+0000","last_clean":"2024-04-17T15:37:56.051599+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:37:56.051599+0000","last_undegraded":"2024-04-17T15:37:56.051599+0000","last_fullsized":"2024-04-17T15:37:56.051599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048139+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:37:56.048139+0000","last_peered":"2024-04-17T15:37:56.048139+0000","last_clean":"2024-04-17T15:37:56.048139+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:37:56.048139+0000","last_undegraded":"2024-04-17T15:37:56.048139+0000","last_fullsized":"2024-04-17T15:37:56.048139+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049552+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:37:56.049552+0000","last_peered":"2024-04-17T15:37:56.049552+0000","last_clean":"2024-04-17T15:37:56.049552+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:37:56.049552+0000","last_undegraded":"2024-04-17T15:37:56.049552+0000","last_fullsized":"2024-04-17T15:37:56.049552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053800+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:37:56.053800+0000","last_peered":"2024-04-17T15:37:56.053800+0000","last_clean":"2024-04-17T15:37:56.053800+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:37:56.053800+0000","last_undegraded":"2024-04-17T15:37:56.053800+0000","last_fullsized":"2024-04-17T15:37:56.053800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384562+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:37:55.384562+0000","last_peered":"2024-04-17T15:37:55.384562+0000","last_clean":"2024-04-17T15:37:55.384562+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:37:55.384562+0000","last_undegraded":"2024-04-17T15:37:55.384562+0000","last_fullsized":"2024-04-17T15:37:55.384562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049769+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:37:56.049769+0000","last_peered":"2024-04-17T15:37:56.049769+0000","last_clean":"2024-04-17T15:37:56.049769+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:37:56.049769+0000","last_undegraded":"2024-04-17T15:37:56.049769+0000","last_fullsized":"2024-04-17T15:37:56.049769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381186+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:37:55.381186+0000","last_peered":"2024-04-17T15:37:55.381186+0000","last_clean":"2024-04-17T15:37:55.381186+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:37:55.381186+0000","last_undegraded":"2024-04-17T15:37:55.381186+0000","last_fullsized":"2024-04-17T15:37:55.381186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385794+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:37:55.385794+0000","last_peered":"2024-04-17T15:37:55.385794+0000","last_clean":"2024-04-17T15:37:55.385794+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:37:55.385794+0000","last_undegraded":"2024-04-17T15:37:55.385794+0000","last_fullsized":"2024-04-17T15:37:55.385794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838910+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:37:55.838910+0000","last_peered":"2024-04-17T15:37:55.838910+0000","last_clean":"2024-04-17T15:37:55.838910+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:37:55.838910+0000","last_undegraded":"2024-04-17T15:37:55.838910+0000","last_fullsized":"2024-04-17T15:37:55.838910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381118+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:37:55.381118+0000","last_peered":"2024-04-17T15:37:55.381118+0000","last_clean":"2024-04-17T15:37:55.381118+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:37:55.381118+0000","last_undegraded":"2024-04-17T15:37:55.381118+0000","last_fullsized":"2024-04-17T15:37:55.381118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839389+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:37:55.839389+0000","last_peered":"2024-04-17T15:37:55.839389+0000","last_clean":"2024-04-17T15:37:55.839389+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:37:55.839389+0000","last_undegraded":"2024-04-17T15:37:55.839389+0000","last_fullsized":"2024-04-17T15:37:55.839389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050171+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:37:56.050171+0000","last_peered":"2024-04-17T15:37:56.050171+0000","last_clean":"2024-04-17T15:37:56.050171+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:37:56.050171+0000","last_undegraded":"2024-04-17T15:37:56.050171+0000","last_fullsized":"2024-04-17T15:37:56.050171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050397+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:37:56.050397+0000","last_peered":"2024-04-17T15:37:56.050397+0000","last_clean":"2024-04-17T15:37:56.050397+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:37:56.050397+0000","last_undegraded":"2024-04-17T15:37:56.050397+0000","last_fullsized":"2024-04-17T15:37:56.050397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384596+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:37:56.384596+0000","last_peered":"2024-04-17T15:37:56.384596+0000","last_clean":"2024-04-17T15:37:56.384596+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:37:56.384596+0000","last_undegraded":"2024-04-17T15:37:56.384596+0000","last_fullsized":"2024-04-17T15:37:56.384596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384775+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:37:55.384775+0000","last_peered":"2024-04-17T15:37:55.384775+0000","last_clean":"2024-04-17T15:37:55.384775+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:37:55.384775+0000","last_undegraded":"2024-04-17T15:37:55.384775+0000","last_fullsized":"2024-04-17T15:37:55.384775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052627+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:37:56.052627+0000","last_peered":"2024-04-17T15:37:56.052627+0000","last_clean":"2024-04-17T15:37:56.052627+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:37:56.052627+0000","last_undegraded":"2024-04-17T15:37:56.052627+0000","last_fullsized":"2024-04-17T15:37:56.052627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050193+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:37:56.050193+0000","last_peered":"2024-04-17T15:37:56.050193+0000","last_clean":"2024-04-17T15:37:56.050193+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:37:56.050193+0000","last_undegraded":"2024-04-17T15:37:56.050193+0000","last_fullsized":"2024-04-17T15:37:56.050193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050006+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:37:56.050006+0000","last_peered":"2024-04-17T15:37:56.050006+0000","last_clean":"2024-04-17T15:37:56.050006+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:37:56.050006+0000","last_undegraded":"2024-04-17T15:37:56.050006+0000","last_fullsized":"2024-04-17T15:37:56.050006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383059+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:37:56.383059+0000","last_peered":"2024-04-17T15:37:56.383059+0000","last_clean":"2024-04-17T15:37:56.383059+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:37:56.383059+0000","last_undegraded":"2024-04-17T15:37:56.383059+0000","last_fullsized":"2024-04-17T15:37:56.383059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381854+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:37:55.381854+0000","last_peered":"2024-04-17T15:37:55.381854+0000","last_clean":"2024-04-17T15:37:55.381854+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:37:55.381854+0000","last_undegraded":"2024-04-17T15:37:55.381854+0000","last_fullsized":"2024-04-17T15:37:55.381854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048283+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:37:56.048283+0000","last_peered":"2024-04-17T15:37:56.048283+0000","last_clean":"2024-04-17T15:37:56.048283+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:37:56.048283+0000","last_undegraded":"2024-04-17T15:37:56.048283+0000","last_fullsized":"2024-04-17T15:37:56.048283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381493+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:37:55.381493+0000","last_peered":"2024-04-17T15:37:55.381493+0000","last_clean":"2024-04-17T15:37:55.381493+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:37:55.381493+0000","last_undegraded":"2024-04-17T15:37:55.381493+0000","last_fullsized":"2024-04-17T15:37:55.381493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053691+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:37:56.053691+0000","last_peered":"2024-04-17T15:37:56.053691+0000","last_clean":"2024-04-17T15:37:56.053691+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:37:56.053691+0000","last_undegraded":"2024-04-17T15:37:56.053691+0000","last_fullsized":"2024-04-17T15:37:56.053691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384967+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:37:55.384967+0000","last_peered":"2024-04-17T15:37:55.384967+0000","last_clean":"2024-04-17T15:37:55.384967+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:37:55.384967+0000","last_undegraded":"2024-04-17T15:37:55.384967+0000","last_fullsized":"2024-04-17T15:37:55.384967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051051+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:37:56.051051+0000","last_peered":"2024-04-17T15:37:56.051051+0000","last_clean":"2024-04-17T15:37:56.051051+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:37:56.051051+0000","last_undegraded":"2024-04-17T15:37:56.051051+0000","last_fullsized":"2024-04-17T15:37:56.051051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049447+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:37:56.049447+0000","last_peered":"2024-04-17T15:37:56.049447+0000","last_clean":"2024-04-17T15:37:56.049447+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:37:56.049447+0000","last_undegraded":"2024-04-17T15:37:56.049447+0000","last_fullsized":"2024-04-17T15:37:56.049447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048217+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:37:56.048217+0000","last_peered":"2024-04-17T15:37:56.048217+0000","last_clean":"2024-04-17T15:37:56.048217+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:37:56.048217+0000","last_undegraded":"2024-04-17T15:37:56.048217+0000","last_fullsized":"2024-04-17T15:37:56.048217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050091+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:37:56.050091+0000","last_peered":"2024-04-17T15:37:56.050091+0000","last_clean":"2024-04-17T15:37:56.050091+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:37:56.050091+0000","last_undegraded":"2024-04-17T15:37:56.050091+0000","last_fullsized":"2024-04-17T15:37:56.050091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051550+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:37:56.051550+0000","last_peered":"2024-04-17T15:37:56.051550+0000","last_clean":"2024-04-17T15:37:56.051550+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:37:56.051550+0000","last_undegraded":"2024-04-17T15:37:56.051550+0000","last_fullsized":"2024-04-17T15:37:56.051550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384895+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:37:55.384895+0000","last_peered":"2024-04-17T15:37:55.384895+0000","last_clean":"2024-04-17T15:37:55.384895+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:37:55.384895+0000","last_undegraded":"2024-04-17T15:37:55.384895+0000","last_fullsized":"2024-04-17T15:37:55.384895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050941+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:37:56.050941+0000","last_peered":"2024-04-17T15:37:56.050941+0000","last_clean":"2024-04-17T15:37:56.050941+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:37:56.050941+0000","last_undegraded":"2024-04-17T15:37:56.050941+0000","last_fullsized":"2024-04-17T15:37:56.050941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380251+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:37:55.380251+0000","last_peered":"2024-04-17T15:37:55.380251+0000","last_clean":"2024-04-17T15:37:55.380251+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:37:55.380251+0000","last_undegraded":"2024-04-17T15:37:55.380251+0000","last_fullsized":"2024-04-17T15:37:55.380251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380998+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:37:55.380998+0000","last_peered":"2024-04-17T15:37:55.380998+0000","last_clean":"2024-04-17T15:37:55.380998+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:37:55.380998+0000","last_undegraded":"2024-04-17T15:37:55.380998+0000","last_fullsized":"2024-04-17T15:37:55.380998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048709+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:37:56.048709+0000","last_peered":"2024-04-17T15:37:56.048709+0000","last_clean":"2024-04-17T15:37:56.048709+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:37:56.048709+0000","last_undegraded":"2024-04-17T15:37:56.048709+0000","last_fullsized":"2024-04-17T15:37:56.048709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384440+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:37:56.384440+0000","last_peered":"2024-04-17T15:37:56.384440+0000","last_clean":"2024-04-17T15:37:56.384440+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:37:56.384440+0000","last_undegraded":"2024-04-17T15:37:56.384440+0000","last_fullsized":"2024-04-17T15:37:56.384440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381849+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:37:56.381849+0000","last_peered":"2024-04-17T15:37:56.381849+0000","last_clean":"2024-04-17T15:37:56.381849+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:37:56.381849+0000","last_undegraded":"2024-04-17T15:37:56.381849+0000","last_fullsized":"2024-04-17T15:37:56.381849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382581+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:37:56.382581+0000","last_peered":"2024-04-17T15:37:56.382581+0000","last_clean":"2024-04-17T15:37:56.382581+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:37:56.382581+0000","last_undegraded":"2024-04-17T15:37:56.382581+0000","last_fullsized":"2024-04-17T15:37:56.382581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385275+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:37:55.385275+0000","last_peered":"2024-04-17T15:37:55.385275+0000","last_clean":"2024-04-17T15:37:55.385275+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:37:55.385275+0000","last_undegraded":"2024-04-17T15:37:55.385275+0000","last_fullsized":"2024-04-17T15:37:55.385275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048512+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:37:56.048512+0000","last_peered":"2024-04-17T15:37:56.048512+0000","last_clean":"2024-04-17T15:37:56.048512+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:37:56.048512+0000","last_undegraded":"2024-04-17T15:37:56.048512+0000","last_fullsized":"2024-04-17T15:37:56.048512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048861+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:37:56.048861+0000","last_peered":"2024-04-17T15:37:56.048861+0000","last_clean":"2024-04-17T15:37:56.048861+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:37:56.048861+0000","last_undegraded":"2024-04-17T15:37:56.048861+0000","last_fullsized":"2024-04-17T15:37:56.048861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.386124+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:37:56.386124+0000","last_peered":"2024-04-17T15:37:56.386124+0000","last_clean":"2024-04-17T15:37:56.386124+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:37:56.386124+0000","last_undegraded":"2024-04-17T15:37:56.386124+0000","last_fullsized":"2024-04-17T15:37:56.386124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050693+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:37:56.050693+0000","last_peered":"2024-04-17T15:37:56.050693+0000","last_clean":"2024-04-17T15:37:56.050693+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:37:56.050693+0000","last_undegraded":"2024-04-17T15:37:56.050693+0000","last_fullsized":"2024-04-17T15:37:56.050693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048768+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:37:56.048768+0000","last_peered":"2024-04-17T15:37:56.048768+0000","last_clean":"2024-04-17T15:37:56.048768+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:37:56.048768+0000","last_undegraded":"2024-04-17T15:37:56.048768+0000","last_fullsized":"2024-04-17T15:37:56.048768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051808+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:37:56.051808+0000","last_peered":"2024-04-17T15:37:56.051808+0000","last_clean":"2024-04-17T15:37:56.051808+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:37:56.051808+0000","last_undegraded":"2024-04-17T15:37:56.051808+0000","last_fullsized":"2024-04-17T15:37:56.051808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.382287+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:37:55.382287+0000","last_peered":"2024-04-17T15:37:55.382287+0000","last_clean":"2024-04-17T15:37:55.382287+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:37:55.382287+0000","last_undegraded":"2024-04-17T15:37:55.382287+0000","last_fullsized":"2024-04-17T15:37:55.382287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381640+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:37:56.381640+0000","last_peered":"2024-04-17T15:37:56.381640+0000","last_clean":"2024-04-17T15:37:56.381640+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:37:56.381640+0000","last_undegraded":"2024-04-17T15:37:56.381640+0000","last_fullsized":"2024-04-17T15:37:56.381640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048604+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:37:56.048604+0000","last_peered":"2024-04-17T15:37:56.048604+0000","last_clean":"2024-04-17T15:37:56.048604+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:37:56.048604+0000","last_undegraded":"2024-04-17T15:37:56.048604+0000","last_fullsized":"2024-04-17T15:37:56.048604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382686+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:37:56.382686+0000","last_peered":"2024-04-17T15:37:56.382686+0000","last_clean":"2024-04-17T15:37:56.382686+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:37:56.382686+0000","last_undegraded":"2024-04-17T15:37:56.382686+0000","last_fullsized":"2024-04-17T15:37:56.382686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052977+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:37:56.052977+0000","last_peered":"2024-04-17T15:37:56.052977+0000","last_clean":"2024-04-17T15:37:56.052977+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:37:56.052977+0000","last_undegraded":"2024-04-17T15:37:56.052977+0000","last_fullsized":"2024-04-17T15:37:56.052977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050226+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:37:56.050226+0000","last_peered":"2024-04-17T15:37:56.050226+0000","last_clean":"2024-04-17T15:37:56.050226+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:37:56.050226+0000","last_undegraded":"2024-04-17T15:37:56.050226+0000","last_fullsized":"2024-04-17T15:37:56.050226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049834+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:37:56.049834+0000","last_peered":"2024-04-17T15:37:56.049834+0000","last_clean":"2024-04-17T15:37:56.049834+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:37:56.049834+0000","last_undegraded":"2024-04-17T15:37:56.049834+0000","last_fullsized":"2024-04-17T15:37:56.049834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049197+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:37:56.049197+0000","last_peered":"2024-04-17T15:37:56.049197+0000","last_clean":"2024-04-17T15:37:56.049197+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:37:56.049197+0000","last_undegraded":"2024-04-17T15:37:56.049197+0000","last_fullsized":"2024-04-17T15:37:56.049197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381458+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:37:55.381458+0000","last_peered":"2024-04-17T15:37:55.381458+0000","last_clean":"2024-04-17T15:37:55.381458+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:37:55.381458+0000","last_undegraded":"2024-04-17T15:37:55.381458+0000","last_fullsized":"2024-04-17T15:37:55.381458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381921+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:37:56.381921+0000","last_peered":"2024-04-17T15:37:56.381921+0000","last_clean":"2024-04-17T15:37:56.381921+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:37:56.381921+0000","last_undegraded":"2024-04-17T15:37:56.381921+0000","last_fullsized":"2024-04-17T15:37:56.381921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381378+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:37:56.381378+0000","last_peered":"2024-04-17T15:37:56.381378+0000","last_clean":"2024-04-17T15:37:56.381378+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:37:56.381378+0000","last_undegraded":"2024-04-17T15:37:56.381378+0000","last_fullsized":"2024-04-17T15:37:56.381378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382306+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:37:56.382306+0000","last_peered":"2024-04-17T15:37:56.382306+0000","last_clean":"2024-04-17T15:37:56.382306+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:37:56.382306+0000","last_undegraded":"2024-04-17T15:37:56.382306+0000","last_fullsized":"2024-04-17T15:37:56.382306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051519+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:37:56.051519+0000","last_peered":"2024-04-17T15:37:56.051519+0000","last_clean":"2024-04-17T15:37:56.051519+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:37:56.051519+0000","last_undegraded":"2024-04-17T15:37:56.051519+0000","last_fullsized":"2024-04-17T15:37:56.051519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050482+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:37:56.050482+0000","last_peered":"2024-04-17T15:37:56.050482+0000","last_clean":"2024-04-17T15:37:56.050482+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:37:56.050482+0000","last_undegraded":"2024-04-17T15:37:56.050482+0000","last_fullsized":"2024-04-17T15:37:56.050482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384341+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:37:56.384341+0000","last_peered":"2024-04-17T15:37:56.384341+0000","last_clean":"2024-04-17T15:37:56.384341+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:37:56.384341+0000","last_undegraded":"2024-04-17T15:37:56.384341+0000","last_fullsized":"2024-04-17T15:37:56.384341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"42'5","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049273+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:37:56.049273+0000","last_peered":"2024-04-17T15:37:56.049273+0000","last_clean":"2024-04-17T15:37:56.049273+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:37:56.049273+0000","last_undegraded":"2024-04-17T15:37:56.049273+0000","last_fullsized":"2024-04-17T15:37:56.049273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051128+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:37:56.051128+0000","last_peered":"2024-04-17T15:37:56.051128+0000","last_clean":"2024-04-17T15:37:56.051128+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:37:56.051128+0000","last_undegraded":"2024-04-17T15:37:56.051128+0000","last_fullsized":"2024-04-17T15:37:56.051128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050935+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:37:56.050935+0000","last_peered":"2024-04-17T15:37:56.050935+0000","last_clean":"2024-04-17T15:37:56.050935+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:37:56.050935+0000","last_undegraded":"2024-04-17T15:37:56.050935+0000","last_fullsized":"2024-04-17T15:37:56.050935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382771+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:37:56.382771+0000","last_peered":"2024-04-17T15:37:56.382771+0000","last_clean":"2024-04-17T15:37:56.382771+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:37:56.382771+0000","last_undegraded":"2024-04-17T15:37:56.382771+0000","last_fullsized":"2024-04-17T15:37:56.382771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839276+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:37:55.839276+0000","last_peered":"2024-04-17T15:37:55.839276+0000","last_clean":"2024-04-17T15:37:55.839276+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:37:55.839276+0000","last_undegraded":"2024-04-17T15:37:55.839276+0000","last_fullsized":"2024-04-17T15:37:55.839276+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047673+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:37:56.047673+0000","last_peered":"2024-04-17T15:37:56.047673+0000","last_clean":"2024-04-17T15:37:56.047673+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:37:56.047673+0000","last_undegraded":"2024-04-17T15:37:56.047673+0000","last_fullsized":"2024-04-17T15:37:56.047673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383828+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:37:56.383828+0000","last_peered":"2024-04-17T15:37:56.383828+0000","last_clean":"2024-04-17T15:37:56.383828+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:37:56.383828+0000","last_undegraded":"2024-04-17T15:37:56.383828+0000","last_fullsized":"2024-04-17T15:37:56.383828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380206+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:37:55.380206+0000","last_peered":"2024-04-17T15:37:55.380206+0000","last_clean":"2024-04-17T15:37:55.380206+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:37:55.380206+0000","last_undegraded":"2024-04-17T15:37:55.380206+0000","last_fullsized":"2024-04-17T15:37:55.380206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052899+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:37:56.052899+0000","last_peered":"2024-04-17T15:37:56.052899+0000","last_clean":"2024-04-17T15:37:56.052899+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:37:56.052899+0000","last_undegraded":"2024-04-17T15:37:56.052899+0000","last_fullsized":"2024-04-17T15:37:56.052899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382027+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:37:56.382027+0000","last_peered":"2024-04-17T15:37:56.382027+0000","last_clean":"2024-04-17T15:37:56.382027+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:37:56.382027+0000","last_undegraded":"2024-04-17T15:37:56.382027+0000","last_fullsized":"2024-04-17T15:37:56.382027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051106+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:37:56.051106+0000","last_peered":"2024-04-17T15:37:56.051106+0000","last_clean":"2024-04-17T15:37:56.051106+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:37:56.051106+0000","last_undegraded":"2024-04-17T15:37:56.051106+0000","last_fullsized":"2024-04-17T15:37:56.051106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380473+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:37:55.380473+0000","last_peered":"2024-04-17T15:37:55.380473+0000","last_clean":"2024-04-17T15:37:55.380473+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:37:55.380473+0000","last_undegraded":"2024-04-17T15:37:55.380473+0000","last_fullsized":"2024-04-17T15:37:55.380473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048693+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:37:56.048693+0000","last_peered":"2024-04-17T15:37:56.048693+0000","last_clean":"2024-04-17T15:37:56.048693+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:37:56.048693+0000","last_undegraded":"2024-04-17T15:37:56.048693+0000","last_fullsized":"2024-04-17T15:37:56.048693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049972+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:37:56.049972+0000","last_peered":"2024-04-17T15:37:56.049972+0000","last_clean":"2024-04-17T15:37:56.049972+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:37:56.049972+0000","last_undegraded":"2024-04-17T15:37:56.049972+0000","last_fullsized":"2024-04-17T15:37:56.049972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.382141+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:37:55.382141+0000","last_peered":"2024-04-17T15:37:55.382141+0000","last_clean":"2024-04-17T15:37:55.382141+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:37:55.382141+0000","last_undegraded":"2024-04-17T15:37:55.382141+0000","last_fullsized":"2024-04-17T15:37:55.382141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382574+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:37:56.382574+0000","last_peered":"2024-04-17T15:37:56.382574+0000","last_clean":"2024-04-17T15:37:56.382574+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:37:56.382574+0000","last_undegraded":"2024-04-17T15:37:56.382574+0000","last_fullsized":"2024-04-17T15:37:56.382574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051333+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:37:56.051333+0000","last_peered":"2024-04-17T15:37:56.051333+0000","last_clean":"2024-04-17T15:37:56.051333+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:37:56.051333+0000","last_undegraded":"2024-04-17T15:37:56.051333+0000","last_fullsized":"2024-04-17T15:37:56.051333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384771+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:37:55.384771+0000","last_peered":"2024-04-17T15:37:55.384771+0000","last_clean":"2024-04-17T15:37:55.384771+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:37:55.384771+0000","last_undegraded":"2024-04-17T15:37:55.384771+0000","last_fullsized":"2024-04-17T15:37:55.384771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053050+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:37:56.053050+0000","last_peered":"2024-04-17T15:37:56.053050+0000","last_clean":"2024-04-17T15:37:56.053050+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:37:56.053050+0000","last_undegraded":"2024-04-17T15:37:56.053050+0000","last_fullsized":"2024-04-17T15:37:56.053050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383115+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:37:56.383115+0000","last_peered":"2024-04-17T15:37:56.383115+0000","last_clean":"2024-04-17T15:37:56.383115+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:37:56.383115+0000","last_undegraded":"2024-04-17T15:37:56.383115+0000","last_fullsized":"2024-04-17T15:37:56.383115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051425+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:37:56.051425+0000","last_peered":"2024-04-17T15:37:56.051425+0000","last_clean":"2024-04-17T15:37:56.051425+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:37:56.051425+0000","last_undegraded":"2024-04-17T15:37:56.051425+0000","last_fullsized":"2024-04-17T15:37:56.051425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.383098+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:37:55.383098+0000","last_peered":"2024-04-17T15:37:55.383098+0000","last_clean":"2024-04-17T15:37:55.383098+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:37:55.383098+0000","last_undegraded":"2024-04-17T15:37:55.383098+0000","last_fullsized":"2024-04-17T15:37:55.383098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381850+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:37:55.381850+0000","last_peered":"2024-04-17T15:37:55.381850+0000","last_clean":"2024-04-17T15:37:55.381850+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:37:55.381850+0000","last_undegraded":"2024-04-17T15:37:55.381850+0000","last_fullsized":"2024-04-17T15:37:55.381850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049376+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:37:56.049376+0000","last_peered":"2024-04-17T15:37:56.049376+0000","last_clean":"2024-04-17T15:37:56.049376+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:37:56.049376+0000","last_undegraded":"2024-04-17T15:37:56.049376+0000","last_fullsized":"2024-04-17T15:37:56.049376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384882+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:37:55.384882+0000","last_peered":"2024-04-17T15:37:55.384882+0000","last_clean":"2024-04-17T15:37:55.384882+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:37:55.384882+0000","last_undegraded":"2024-04-17T15:37:55.384882+0000","last_fullsized":"2024-04-17T15:37:55.384882+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379909+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:37:55.379909+0000","last_peered":"2024-04-17T15:37:55.379909+0000","last_clean":"2024-04-17T15:37:55.379909+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:37:55.379909+0000","last_undegraded":"2024-04-17T15:37:55.379909+0000","last_fullsized":"2024-04-17T15:37:55.379909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382166+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:37:56.382166+0000","last_peered":"2024-04-17T15:37:56.382166+0000","last_clean":"2024-04-17T15:37:56.382166+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:37:56.382166+0000","last_undegraded":"2024-04-17T15:37:56.382166+0000","last_fullsized":"2024-04-17T15:37:56.382166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049237+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:37:56.049237+0000","last_peered":"2024-04-17T15:37:56.049237+0000","last_clean":"2024-04-17T15:37:56.049237+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:37:56.049237+0000","last_undegraded":"2024-04-17T15:37:56.049237+0000","last_fullsized":"2024-04-17T15:37:56.049237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050190+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:37:56.050190+0000","last_peered":"2024-04-17T15:37:56.050190+0000","last_clean":"2024-04-17T15:37:56.050190+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:37:56.050190+0000","last_undegraded":"2024-04-17T15:37:56.050190+0000","last_fullsized":"2024-04-17T15:37:56.050190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384655+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:37:56.384655+0000","last_peered":"2024-04-17T15:37:56.384655+0000","last_clean":"2024-04-17T15:37:56.384655+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:37:56.384655+0000","last_undegraded":"2024-04-17T15:37:56.384655+0000","last_fullsized":"2024-04-17T15:37:56.384655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384807+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:37:55.384807+0000","last_peered":"2024-04-17T15:37:55.384807+0000","last_clean":"2024-04-17T15:37:55.384807+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:37:55.384807+0000","last_undegraded":"2024-04-17T15:37:55.384807+0000","last_fullsized":"2024-04-17T15:37:55.384807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051408+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:37:56.051408+0000","last_peered":"2024-04-17T15:37:56.051408+0000","last_clean":"2024-04-17T15:37:56.051408+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:37:56.051408+0000","last_undegraded":"2024-04-17T15:37:56.051408+0000","last_fullsized":"2024-04-17T15:37:56.051408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839297+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:37:55.839297+0000","last_peered":"2024-04-17T15:37:55.839297+0000","last_clean":"2024-04-17T15:37:55.839297+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:37:55.839297+0000","last_undegraded":"2024-04-17T15:37:55.839297+0000","last_fullsized":"2024-04-17T15:37:55.839297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050116+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:37:56.050116+0000","last_peered":"2024-04-17T15:37:56.050116+0000","last_clean":"2024-04-17T15:37:56.050116+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:37:56.050116+0000","last_undegraded":"2024-04-17T15:37:56.050116+0000","last_fullsized":"2024-04-17T15:37:56.050116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385189+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:37:55.385189+0000","last_peered":"2024-04-17T15:37:55.385189+0000","last_clean":"2024-04-17T15:37:55.385189+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:37:55.385189+0000","last_undegraded":"2024-04-17T15:37:55.385189+0000","last_fullsized":"2024-04-17T15:37:55.385189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051132+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:37:56.051132+0000","last_peered":"2024-04-17T15:37:56.051132+0000","last_clean":"2024-04-17T15:37:56.051132+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:37:56.051132+0000","last_undegraded":"2024-04-17T15:37:56.051132+0000","last_fullsized":"2024-04-17T15:37:56.051132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381614+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:37:55.381614+0000","last_peered":"2024-04-17T15:37:55.381614+0000","last_clean":"2024-04-17T15:37:55.381614+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:37:55.381614+0000","last_undegraded":"2024-04-17T15:37:55.381614+0000","last_fullsized":"2024-04-17T15:37:55.381614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047513+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:37:56.047513+0000","last_peered":"2024-04-17T15:37:56.047513+0000","last_clean":"2024-04-17T15:37:56.047513+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:37:56.047513+0000","last_undegraded":"2024-04-17T15:37:56.047513+0000","last_fullsized":"2024-04-17T15:37:56.047513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049707+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:37:56.049707+0000","last_peered":"2024-04-17T15:37:56.049707+0000","last_clean":"2024-04-17T15:37:56.049707+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:37:56.049707+0000","last_undegraded":"2024-04-17T15:37:56.049707+0000","last_fullsized":"2024-04-17T15:37:56.049707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053177+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:37:56.053177+0000","last_peered":"2024-04-17T15:37:56.053177+0000","last_clean":"2024-04-17T15:37:56.053177+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:37:56.053177+0000","last_undegraded":"2024-04-17T15:37:56.053177+0000","last_fullsized":"2024-04-17T15:37:56.053177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048815+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:37:56.048815+0000","last_peered":"2024-04-17T15:37:56.048815+0000","last_clean":"2024-04-17T15:37:56.048815+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:37:56.048815+0000","last_undegraded":"2024-04-17T15:37:56.048815+0000","last_fullsized":"2024-04-17T15:37:56.048815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051551+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:37:56.051551+0000","last_peered":"2024-04-17T15:37:56.051551+0000","last_clean":"2024-04-17T15:37:56.051551+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:37:56.051551+0000","last_undegraded":"2024-04-17T15:37:56.051551+0000","last_fullsized":"2024-04-17T15:37:56.051551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048723+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:37:56.048723+0000","last_peered":"2024-04-17T15:37:56.048723+0000","last_clean":"2024-04-17T15:37:56.048723+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:37:56.048723+0000","last_undegraded":"2024-04-17T15:37:56.048723+0000","last_fullsized":"2024-04-17T15:37:56.048723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050579+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:37:56.050579+0000","last_peered":"2024-04-17T15:37:56.050579+0000","last_clean":"2024-04-17T15:37:56.050579+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:37:56.050579+0000","last_undegraded":"2024-04-17T15:37:56.050579+0000","last_fullsized":"2024-04-17T15:37:56.050579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048967+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:37:56.048967+0000","last_peered":"2024-04-17T15:37:56.048967+0000","last_clean":"2024-04-17T15:37:56.048967+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:37:56.048967+0000","last_undegraded":"2024-04-17T15:37:56.048967+0000","last_fullsized":"2024-04-17T15:37:56.048967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053569+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:37:56.053569+0000","last_peered":"2024-04-17T15:37:56.053569+0000","last_clean":"2024-04-17T15:37:56.053569+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:37:56.053569+0000","last_undegraded":"2024-04-17T15:37:56.053569+0000","last_fullsized":"2024-04-17T15:37:56.053569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052818+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:37:56.052818+0000","last_peered":"2024-04-17T15:37:56.052818+0000","last_clean":"2024-04-17T15:37:56.052818+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:37:56.052818+0000","last_undegraded":"2024-04-17T15:37:56.052818+0000","last_fullsized":"2024-04-17T15:37:56.052818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048725+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:37:56.048725+0000","last_peered":"2024-04-17T15:37:56.048725+0000","last_clean":"2024-04-17T15:37:56.048725+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:37:56.048725+0000","last_undegraded":"2024-04-17T15:37:56.048725+0000","last_fullsized":"2024-04-17T15:37:56.048725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379926+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:37:55.379926+0000","last_peered":"2024-04-17T15:37:55.379926+0000","last_clean":"2024-04-17T15:37:55.379926+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:37:55.379926+0000","last_undegraded":"2024-04-17T15:37:55.379926+0000","last_fullsized":"2024-04-17T15:37:55.379926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382603+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:37:56.382603+0000","last_peered":"2024-04-17T15:37:56.382603+0000","last_clean":"2024-04-17T15:37:56.382603+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:37:56.382603+0000","last_undegraded":"2024-04-17T15:37:56.382603+0000","last_fullsized":"2024-04-17T15:37:56.382603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383013+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:37:56.383013+0000","last_peered":"2024-04-17T15:37:56.383013+0000","last_clean":"2024-04-17T15:37:56.383013+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:37:56.383013+0000","last_undegraded":"2024-04-17T15:37:56.383013+0000","last_fullsized":"2024-04-17T15:37:56.383013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383670+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:37:56.383670+0000","last_peered":"2024-04-17T15:37:56.383670+0000","last_clean":"2024-04-17T15:37:56.383670+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:37:56.383670+0000","last_undegraded":"2024-04-17T15:37:56.383670+0000","last_fullsized":"2024-04-17T15:37:56.383670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047956+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:37:56.047956+0000","last_peered":"2024-04-17T15:37:56.047956+0000","last_clean":"2024-04-17T15:37:56.047956+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:37:56.047956+0000","last_undegraded":"2024-04-17T15:37:56.047956+0000","last_fullsized":"2024-04-17T15:37:56.047956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.385798+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:37:56.385798+0000","last_peered":"2024-04-17T15:37:56.385798+0000","last_clean":"2024-04-17T15:37:56.385798+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:37:56.385798+0000","last_undegraded":"2024-04-17T15:37:56.385798+0000","last_fullsized":"2024-04-17T15:37:56.385798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048313+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:37:56.048313+0000","last_peered":"2024-04-17T15:37:56.048313+0000","last_clean":"2024-04-17T15:37:56.048313+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:37:56.048313+0000","last_undegraded":"2024-04-17T15:37:56.048313+0000","last_fullsized":"2024-04-17T15:37:56.048313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050038+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:37:56.050038+0000","last_peered":"2024-04-17T15:37:56.050038+0000","last_clean":"2024-04-17T15:37:56.050038+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:37:56.050038+0000","last_undegraded":"2024-04-17T15:37:56.050038+0000","last_fullsized":"2024-04-17T15:37:56.050038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048193+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:37:56.048193+0000","last_peered":"2024-04-17T15:37:56.048193+0000","last_clean":"2024-04-17T15:37:56.048193+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:37:56.048193+0000","last_undegraded":"2024-04-17T15:37:56.048193+0000","last_fullsized":"2024-04-17T15:37:56.048193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050881+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:37:56.050881+0000","last_peered":"2024-04-17T15:37:56.050881+0000","last_clean":"2024-04-17T15:37:56.050881+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:37:56.050881+0000","last_undegraded":"2024-04-17T15:37:56.050881+0000","last_fullsized":"2024-04-17T15:37:56.050881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381105+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:37:55.381105+0000","last_peered":"2024-04-17T15:37:55.381105+0000","last_clean":"2024-04-17T15:37:55.381105+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:37:55.381105+0000","last_undegraded":"2024-04-17T15:37:55.381105+0000","last_fullsized":"2024-04-17T15:37:55.381105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048478+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:37:56.048478+0000","last_peered":"2024-04-17T15:37:56.048478+0000","last_clean":"2024-04-17T15:37:56.048478+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:37:56.048478+0000","last_undegraded":"2024-04-17T15:37:56.048478+0000","last_fullsized":"2024-04-17T15:37:56.048478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049425+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:37:56.049425+0000","last_peered":"2024-04-17T15:37:56.049425+0000","last_clean":"2024-04-17T15:37:56.049425+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:37:56.049425+0000","last_undegraded":"2024-04-17T15:37:56.049425+0000","last_fullsized":"2024-04-17T15:37:56.049425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050310+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:37:56.050310+0000","last_peered":"2024-04-17T15:37:56.050310+0000","last_clean":"2024-04-17T15:37:56.050310+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:37:56.050310+0000","last_undegraded":"2024-04-17T15:37:56.050310+0000","last_fullsized":"2024-04-17T15:37:56.050310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385607+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:37:55.385607+0000","last_peered":"2024-04-17T15:37:55.385607+0000","last_clean":"2024-04-17T15:37:55.385607+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:37:55.385607+0000","last_undegraded":"2024-04-17T15:37:55.385607+0000","last_fullsized":"2024-04-17T15:37:55.385607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379908+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:37:55.379908+0000","last_peered":"2024-04-17T15:37:55.379908+0000","last_clean":"2024-04-17T15:37:55.379908+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:37:55.379908+0000","last_undegraded":"2024-04-17T15:37:55.379908+0000","last_fullsized":"2024-04-17T15:37:55.379908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385063+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:37:55.385063+0000","last_peered":"2024-04-17T15:37:55.385063+0000","last_clean":"2024-04-17T15:37:55.385063+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:37:55.385063+0000","last_undegraded":"2024-04-17T15:37:55.385063+0000","last_fullsized":"2024-04-17T15:37:55.385063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838811+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:37:55.838811+0000","last_peered":"2024-04-17T15:37:55.838811+0000","last_clean":"2024-04-17T15:37:55.838811+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:37:55.838811+0000","last_undegraded":"2024-04-17T15:37:55.838811+0000","last_fullsized":"2024-04-17T15:37:55.838811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053245+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:37:56.053245+0000","last_peered":"2024-04-17T15:37:56.053245+0000","last_clean":"2024-04-17T15:37:56.053245+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:37:56.053245+0000","last_undegraded":"2024-04-17T15:37:56.053245+0000","last_fullsized":"2024-04-17T15:37:56.053245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052490+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:37:56.052490+0000","last_peered":"2024-04-17T15:37:56.052490+0000","last_clean":"2024-04-17T15:37:56.052490+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:37:56.052490+0000","last_undegraded":"2024-04-17T15:37:56.052490+0000","last_fullsized":"2024-04-17T15:37:56.052490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384870+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:37:55.384870+0000","last_peered":"2024-04-17T15:37:55.384870+0000","last_clean":"2024-04-17T15:37:55.384870+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:37:55.384870+0000","last_undegraded":"2024-04-17T15:37:55.384870+0000","last_fullsized":"2024-04-17T15:37:55.384870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050725+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:37:56.050725+0000","last_peered":"2024-04-17T15:37:56.050725+0000","last_clean":"2024-04-17T15:37:56.050725+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:37:56.050725+0000","last_undegraded":"2024-04-17T15:37:56.050725+0000","last_fullsized":"2024-04-17T15:37:56.050725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.385006+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:37:56.385006+0000","last_peered":"2024-04-17T15:37:56.385006+0000","last_clean":"2024-04-17T15:37:56.385006+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:37:56.385006+0000","last_undegraded":"2024-04-17T15:37:56.385006+0000","last_fullsized":"2024-04-17T15:37:56.385006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839080+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:37:55.839080+0000","last_peered":"2024-04-17T15:37:55.839080+0000","last_clean":"2024-04-17T15:37:55.839080+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:37:55.839080+0000","last_undegraded":"2024-04-17T15:37:55.839080+0000","last_fullsized":"2024-04-17T15:37:55.839080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049131+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:37:56.049131+0000","last_peered":"2024-04-17T15:37:56.049131+0000","last_clean":"2024-04-17T15:37:56.049131+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:37:56.049131+0000","last_undegraded":"2024-04-17T15:37:56.049131+0000","last_fullsized":"2024-04-17T15:37:56.049131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385422+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:37:55.385422+0000","last_peered":"2024-04-17T15:37:55.385422+0000","last_clean":"2024-04-17T15:37:55.385422+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:37:55.385422+0000","last_undegraded":"2024-04-17T15:37:55.385422+0000","last_fullsized":"2024-04-17T15:37:55.385422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382630+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:37:56.382630+0000","last_peered":"2024-04-17T15:37:56.382630+0000","last_clean":"2024-04-17T15:37:56.382630+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:37:56.382630+0000","last_undegraded":"2024-04-17T15:37:56.382630+0000","last_fullsized":"2024-04-17T15:37:56.382630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.382080+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:37:55.382080+0000","last_peered":"2024-04-17T15:37:55.382080+0000","last_clean":"2024-04-17T15:37:55.382080+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:37:55.382080+0000","last_undegraded":"2024-04-17T15:37:55.382080+0000","last_fullsized":"2024-04-17T15:37:55.382080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379770+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:37:55.379770+0000","last_peered":"2024-04-17T15:37:55.379770+0000","last_clean":"2024-04-17T15:37:55.379770+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:37:55.379770+0000","last_undegraded":"2024-04-17T15:37:55.379770+0000","last_fullsized":"2024-04-17T15:37:55.379770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384319+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:37:56.384319+0000","last_peered":"2024-04-17T15:37:56.384319+0000","last_clean":"2024-04-17T15:37:56.384319+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:37:56.384319+0000","last_undegraded":"2024-04-17T15:37:56.384319+0000","last_fullsized":"2024-04-17T15:37:56.384319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050897+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:37:56.050897+0000","last_peered":"2024-04-17T15:37:56.050897+0000","last_clean":"2024-04-17T15:37:56.050897+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:37:56.050897+0000","last_undegraded":"2024-04-17T15:37:56.050897+0000","last_fullsized":"2024-04-17T15:37:56.050897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049164+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:37:56.049164+0000","last_peered":"2024-04-17T15:37:56.049164+0000","last_clean":"2024-04-17T15:37:56.049164+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:37:56.049164+0000","last_undegraded":"2024-04-17T15:37:56.049164+0000","last_fullsized":"2024-04-17T15:37:56.049164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051335+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:37:56.051335+0000","last_peered":"2024-04-17T15:37:56.051335+0000","last_clean":"2024-04-17T15:37:56.051335+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:37:56.051335+0000","last_undegraded":"2024-04-17T15:37:56.051335+0000","last_fullsized":"2024-04-17T15:37:56.051335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383105+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:37:56.383105+0000","last_peered":"2024-04-17T15:37:56.383105+0000","last_clean":"2024-04-17T15:37:56.383105+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:37:56.383105+0000","last_undegraded":"2024-04-17T15:37:56.383105+0000","last_fullsized":"2024-04-17T15:37:56.383105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839199+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:37:55.839199+0000","last_peered":"2024-04-17T15:37:55.839199+0000","last_clean":"2024-04-17T15:37:55.839199+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:37:55.839199+0000","last_undegraded":"2024-04-17T15:37:55.839199+0000","last_fullsized":"2024-04-17T15:37:55.839199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052356+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:37:56.052356+0000","last_peered":"2024-04-17T15:37:56.052356+0000","last_clean":"2024-04-17T15:37:56.052356+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:37:56.052356+0000","last_undegraded":"2024-04-17T15:37:56.052356+0000","last_fullsized":"2024-04-17T15:37:56.052356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049927+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:37:56.049927+0000","last_peered":"2024-04-17T15:37:56.049927+0000","last_clean":"2024-04-17T15:37:56.049927+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:37:56.049927+0000","last_undegraded":"2024-04-17T15:37:56.049927+0000","last_fullsized":"2024-04-17T15:37:56.049927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051251+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:37:56.051251+0000","last_peered":"2024-04-17T15:37:56.051251+0000","last_clean":"2024-04-17T15:37:56.051251+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:37:56.051251+0000","last_undegraded":"2024-04-17T15:37:56.051251+0000","last_fullsized":"2024-04-17T15:37:56.051251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048883+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:37:56.048883+0000","last_peered":"2024-04-17T15:37:56.048883+0000","last_clean":"2024-04-17T15:37:56.048883+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:37:56.048883+0000","last_undegraded":"2024-04-17T15:37:56.048883+0000","last_fullsized":"2024-04-17T15:37:56.048883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381351+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:37:55.381351+0000","last_peered":"2024-04-17T15:37:55.381351+0000","last_clean":"2024-04-17T15:37:55.381351+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:37:55.381351+0000","last_undegraded":"2024-04-17T15:37:55.381351+0000","last_fullsized":"2024-04-17T15:37:55.381351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049419+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:37:56.049419+0000","last_peered":"2024-04-17T15:37:56.049419+0000","last_clean":"2024-04-17T15:37:56.049419+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:37:56.049419+0000","last_undegraded":"2024-04-17T15:37:56.049419+0000","last_fullsized":"2024-04-17T15:37:56.049419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050820+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:37:56.050820+0000","last_peered":"2024-04-17T15:37:56.050820+0000","last_clean":"2024-04-17T15:37:56.050820+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:37:56.050820+0000","last_undegraded":"2024-04-17T15:37:56.050820+0000","last_fullsized":"2024-04-17T15:37:56.050820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838734+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:37:55.838734+0000","last_peered":"2024-04-17T15:37:55.838734+0000","last_clean":"2024-04-17T15:37:55.838734+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:37:55.838734+0000","last_undegraded":"2024-04-17T15:37:55.838734+0000","last_fullsized":"2024-04-17T15:37:55.838734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839500+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:37:55.839500+0000","last_peered":"2024-04-17T15:37:55.839500+0000","last_clean":"2024-04-17T15:37:55.839500+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:37:55.839500+0000","last_undegraded":"2024-04-17T15:37:55.839500+0000","last_fullsized":"2024-04-17T15:37:55.839500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047945+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:37:56.047945+0000","last_peered":"2024-04-17T15:37:56.047945+0000","last_clean":"2024-04-17T15:37:56.047945+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:37:56.047945+0000","last_undegraded":"2024-04-17T15:37:56.047945+0000","last_fullsized":"2024-04-17T15:37:56.047945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839283+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:37:55.839283+0000","last_peered":"2024-04-17T15:37:55.839283+0000","last_clean":"2024-04-17T15:37:55.839283+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:37:55.839283+0000","last_undegraded":"2024-04-17T15:37:55.839283+0000","last_fullsized":"2024-04-17T15:37:55.839283+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049038+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:37:56.049038+0000","last_peered":"2024-04-17T15:37:56.049038+0000","last_clean":"2024-04-17T15:37:56.049038+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:37:56.049038+0000","last_undegraded":"2024-04-17T15:37:56.049038+0000","last_fullsized":"2024-04-17T15:37:56.049038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050684+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:37:56.050684+0000","last_peered":"2024-04-17T15:37:56.050684+0000","last_clean":"2024-04-17T15:37:56.050684+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:37:56.050684+0000","last_undegraded":"2024-04-17T15:37:56.050684+0000","last_fullsized":"2024-04-17T15:37:56.050684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381586+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:37:55.381586+0000","last_peered":"2024-04-17T15:37:55.381586+0000","last_clean":"2024-04-17T15:37:55.381586+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:37:55.381586+0000","last_undegraded":"2024-04-17T15:37:55.381586+0000","last_fullsized":"2024-04-17T15:37:55.381586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053565+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:37:56.053565+0000","last_peered":"2024-04-17T15:37:56.053565+0000","last_clean":"2024-04-17T15:37:56.053565+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:37:56.053565+0000","last_undegraded":"2024-04-17T15:37:56.053565+0000","last_fullsized":"2024-04-17T15:37:56.053565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1241088,"data_stored":907802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":316774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":318038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":324120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":655360,"data_stored":326011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":316336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":325308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1236992,"data_stored":916049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:38:00.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:38:00.834 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:00.834 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:00.850 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:00.849+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:00.851 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:00.924 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:00.921+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:00.977 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:00.977 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:00.991 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:01.039 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:01.038+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:01.119 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:01.119 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:01.127 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:01.122+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:01.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:01.179 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:38:01.185 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:38:01.197 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-17T15:38:00.422733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":809,"num_read_kb":552,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230680,"kb_used_data":6168,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744040,"statfs":{"total":773094113280,"available":772857896960,"internally_reserved":0,"allocated":6316032,"data_stored":3750438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046897"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050190+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:37:56.050190+0000","last_peered":"2024-04-17T15:37:56.050190+0000","last_clean":"2024-04-17T15:37:56.050190+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:37:56.050190+0000","last_undegraded":"2024-04-17T15:37:56.050190+0000","last_fullsized":"2024-04-17T15:37:56.050190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048583+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:37:56.048583+0000","last_peered":"2024-04-17T15:37:56.048583+0000","last_clean":"2024-04-17T15:37:56.048583+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:37:56.048583+0000","last_undegraded":"2024-04-17T15:37:56.048583+0000","last_fullsized":"2024-04-17T15:37:56.048583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385194+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:37:55.385194+0000","last_peered":"2024-04-17T15:37:55.385194+0000","last_clean":"2024-04-17T15:37:55.385194+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:37:55.385194+0000","last_undegraded":"2024-04-17T15:37:55.385194+0000","last_fullsized":"2024-04-17T15:37:55.385194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048150+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:37:56.048150+0000","last_peered":"2024-04-17T15:37:56.048150+0000","last_clean":"2024-04-17T15:37:56.048150+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:37:56.048150+0000","last_undegraded":"2024-04-17T15:37:56.048150+0000","last_fullsized":"2024-04-17T15:37:56.048150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050404+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:37:56.050404+0000","last_peered":"2024-04-17T15:37:56.050404+0000","last_clean":"2024-04-17T15:37:56.050404+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:37:56.050404+0000","last_undegraded":"2024-04-17T15:37:56.050404+0000","last_fullsized":"2024-04-17T15:37:56.050404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048765+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:37:56.048765+0000","last_peered":"2024-04-17T15:37:56.048765+0000","last_clean":"2024-04-17T15:37:56.048765+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:37:56.048765+0000","last_undegraded":"2024-04-17T15:37:56.048765+0000","last_fullsized":"2024-04-17T15:37:56.048765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053175+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:37:56.053175+0000","last_peered":"2024-04-17T15:37:56.053175+0000","last_clean":"2024-04-17T15:37:56.053175+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:37:56.053175+0000","last_undegraded":"2024-04-17T15:37:56.053175+0000","last_fullsized":"2024-04-17T15:37:56.053175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050405+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:37:56.050405+0000","last_peered":"2024-04-17T15:37:56.050405+0000","last_clean":"2024-04-17T15:37:56.050405+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:37:56.050405+0000","last_undegraded":"2024-04-17T15:37:56.050405+0000","last_fullsized":"2024-04-17T15:37:56.050405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050448+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:37:56.050448+0000","last_peered":"2024-04-17T15:37:56.050448+0000","last_clean":"2024-04-17T15:37:56.050448+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:37:56.050448+0000","last_undegraded":"2024-04-17T15:37:56.050448+0000","last_fullsized":"2024-04-17T15:37:56.050448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381066+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:37:55.381066+0000","last_peered":"2024-04-17T15:37:55.381066+0000","last_clean":"2024-04-17T15:37:55.381066+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:37:55.381066+0000","last_undegraded":"2024-04-17T15:37:55.381066+0000","last_fullsized":"2024-04-17T15:37:55.381066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051999+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:37:56.051999+0000","last_peered":"2024-04-17T15:37:56.051999+0000","last_clean":"2024-04-17T15:37:56.051999+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:37:56.051999+0000","last_undegraded":"2024-04-17T15:37:56.051999+0000","last_fullsized":"2024-04-17T15:37:56.051999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050556+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:37:56.050556+0000","last_peered":"2024-04-17T15:37:56.050556+0000","last_clean":"2024-04-17T15:37:56.050556+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:37:56.050556+0000","last_undegraded":"2024-04-17T15:37:56.050556+0000","last_fullsized":"2024-04-17T15:37:56.050556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048374+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:37:56.048374+0000","last_peered":"2024-04-17T15:37:56.048374+0000","last_clean":"2024-04-17T15:37:56.048374+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:37:56.048374+0000","last_undegraded":"2024-04-17T15:37:56.048374+0000","last_fullsized":"2024-04-17T15:37:56.048374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053609+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:37:56.053609+0000","last_peered":"2024-04-17T15:37:56.053609+0000","last_clean":"2024-04-17T15:37:56.053609+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:37:56.053609+0000","last_undegraded":"2024-04-17T15:37:56.053609+0000","last_fullsized":"2024-04-17T15:37:56.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382070+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:37:56.382070+0000","last_peered":"2024-04-17T15:37:56.382070+0000","last_clean":"2024-04-17T15:37:56.382070+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:37:56.382070+0000","last_undegraded":"2024-04-17T15:37:56.382070+0000","last_fullsized":"2024-04-17T15:37:56.382070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839570+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:37:55.839570+0000","last_peered":"2024-04-17T15:37:55.839570+0000","last_clean":"2024-04-17T15:37:55.839570+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:37:55.839570+0000","last_undegraded":"2024-04-17T15:37:55.839570+0000","last_fullsized":"2024-04-17T15:37:55.839570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050709+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:37:56.050709+0000","last_peered":"2024-04-17T15:37:56.050709+0000","last_clean":"2024-04-17T15:37:56.050709+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:37:56.050709+0000","last_undegraded":"2024-04-17T15:37:56.050709+0000","last_fullsized":"2024-04-17T15:37:56.050709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050309+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:37:56.050309+0000","last_peered":"2024-04-17T15:37:56.050309+0000","last_clean":"2024-04-17T15:37:56.050309+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:37:56.050309+0000","last_undegraded":"2024-04-17T15:37:56.050309+0000","last_fullsized":"2024-04-17T15:37:56.050309+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048258+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:37:56.048258+0000","last_peered":"2024-04-17T15:37:56.048258+0000","last_clean":"2024-04-17T15:37:56.048258+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:37:56.048258+0000","last_undegraded":"2024-04-17T15:37:56.048258+0000","last_fullsized":"2024-04-17T15:37:56.048258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381793+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:37:55.381793+0000","last_peered":"2024-04-17T15:37:55.381793+0000","last_clean":"2024-04-17T15:37:55.381793+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:37:55.381793+0000","last_undegraded":"2024-04-17T15:37:55.381793+0000","last_fullsized":"2024-04-17T15:37:55.381793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052222+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:37:56.052222+0000","last_peered":"2024-04-17T15:37:56.052222+0000","last_clean":"2024-04-17T15:37:56.052222+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:37:56.052222+0000","last_undegraded":"2024-04-17T15:37:56.052222+0000","last_fullsized":"2024-04-17T15:37:56.052222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381942+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:37:55.381942+0000","last_peered":"2024-04-17T15:37:55.381942+0000","last_clean":"2024-04-17T15:37:55.381942+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:37:55.381942+0000","last_undegraded":"2024-04-17T15:37:55.381942+0000","last_fullsized":"2024-04-17T15:37:55.381942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839097+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:37:55.839097+0000","last_peered":"2024-04-17T15:37:55.839097+0000","last_clean":"2024-04-17T15:37:55.839097+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:37:55.839097+0000","last_undegraded":"2024-04-17T15:37:55.839097+0000","last_fullsized":"2024-04-17T15:37:55.839097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049324+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:37:56.049324+0000","last_peered":"2024-04-17T15:37:56.049324+0000","last_clean":"2024-04-17T15:37:56.049324+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:37:56.049324+0000","last_undegraded":"2024-04-17T15:37:56.049324+0000","last_fullsized":"2024-04-17T15:37:56.049324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839190+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:37:55.839190+0000","last_peered":"2024-04-17T15:37:55.839190+0000","last_clean":"2024-04-17T15:37:55.839190+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:37:55.839190+0000","last_undegraded":"2024-04-17T15:37:55.839190+0000","last_fullsized":"2024-04-17T15:37:55.839190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384094+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:37:56.384094+0000","last_peered":"2024-04-17T15:37:56.384094+0000","last_clean":"2024-04-17T15:37:56.384094+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:37:56.384094+0000","last_undegraded":"2024-04-17T15:37:56.384094+0000","last_fullsized":"2024-04-17T15:37:56.384094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050588+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:37:56.050588+0000","last_peered":"2024-04-17T15:37:56.050588+0000","last_clean":"2024-04-17T15:37:56.050588+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:37:56.050588+0000","last_undegraded":"2024-04-17T15:37:56.050588+0000","last_fullsized":"2024-04-17T15:37:56.050588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050426+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:37:56.050426+0000","last_peered":"2024-04-17T15:37:56.050426+0000","last_clean":"2024-04-17T15:37:56.050426+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:37:56.050426+0000","last_undegraded":"2024-04-17T15:37:56.050426+0000","last_fullsized":"2024-04-17T15:37:56.050426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047828+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:37:56.047828+0000","last_peered":"2024-04-17T15:37:56.047828+0000","last_clean":"2024-04-17T15:37:56.047828+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:37:56.047828+0000","last_undegraded":"2024-04-17T15:37:56.047828+0000","last_fullsized":"2024-04-17T15:37:56.047828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384771+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:37:56.384771+0000","last_peered":"2024-04-17T15:37:56.384771+0000","last_clean":"2024-04-17T15:37:56.384771+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:37:56.384771+0000","last_undegraded":"2024-04-17T15:37:56.384771+0000","last_fullsized":"2024-04-17T15:37:56.384771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049168+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:37:56.049168+0000","last_peered":"2024-04-17T15:37:56.049168+0000","last_clean":"2024-04-17T15:37:56.049168+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:37:56.049168+0000","last_undegraded":"2024-04-17T15:37:56.049168+0000","last_fullsized":"2024-04-17T15:37:56.049168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053111+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:37:56.053111+0000","last_peered":"2024-04-17T15:37:56.053111+0000","last_clean":"2024-04-17T15:37:56.053111+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:37:56.053111+0000","last_undegraded":"2024-04-17T15:37:56.053111+0000","last_fullsized":"2024-04-17T15:37:56.053111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050540+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:37:56.050540+0000","last_peered":"2024-04-17T15:37:56.050540+0000","last_clean":"2024-04-17T15:37:56.050540+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:37:56.050540+0000","last_undegraded":"2024-04-17T15:37:56.050540+0000","last_fullsized":"2024-04-17T15:37:56.050540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049939+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:37:56.049939+0000","last_peered":"2024-04-17T15:37:56.049939+0000","last_clean":"2024-04-17T15:37:56.049939+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:37:56.049939+0000","last_undegraded":"2024-04-17T15:37:56.049939+0000","last_fullsized":"2024-04-17T15:37:56.049939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051321+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:37:56.051321+0000","last_peered":"2024-04-17T15:37:56.051321+0000","last_clean":"2024-04-17T15:37:56.051321+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:37:56.051321+0000","last_undegraded":"2024-04-17T15:37:56.051321+0000","last_fullsized":"2024-04-17T15:37:56.051321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053446+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:37:56.053446+0000","last_peered":"2024-04-17T15:37:56.053446+0000","last_clean":"2024-04-17T15:37:56.053446+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:37:56.053446+0000","last_undegraded":"2024-04-17T15:37:56.053446+0000","last_fullsized":"2024-04-17T15:37:56.053446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050245+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:37:56.050245+0000","last_peered":"2024-04-17T15:37:56.050245+0000","last_clean":"2024-04-17T15:37:56.050245+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:37:56.050245+0000","last_undegraded":"2024-04-17T15:37:56.050245+0000","last_fullsized":"2024-04-17T15:37:56.050245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384370+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:37:56.384370+0000","last_peered":"2024-04-17T15:37:56.384370+0000","last_clean":"2024-04-17T15:37:56.384370+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:37:56.384370+0000","last_undegraded":"2024-04-17T15:37:56.384370+0000","last_fullsized":"2024-04-17T15:37:56.384370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050538+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:37:56.050538+0000","last_peered":"2024-04-17T15:37:56.050538+0000","last_clean":"2024-04-17T15:37:56.050538+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:37:56.050538+0000","last_undegraded":"2024-04-17T15:37:56.050538+0000","last_fullsized":"2024-04-17T15:37:56.050538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050923+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:37:56.050923+0000","last_peered":"2024-04-17T15:37:56.050923+0000","last_clean":"2024-04-17T15:37:56.050923+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:37:56.050923+0000","last_undegraded":"2024-04-17T15:37:56.050923+0000","last_fullsized":"2024-04-17T15:37:56.050923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049636+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:37:56.049636+0000","last_peered":"2024-04-17T15:37:56.049636+0000","last_clean":"2024-04-17T15:37:56.049636+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:37:56.049636+0000","last_undegraded":"2024-04-17T15:37:56.049636+0000","last_fullsized":"2024-04-17T15:37:56.049636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051775+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:37:56.051775+0000","last_peered":"2024-04-17T15:37:56.051775+0000","last_clean":"2024-04-17T15:37:56.051775+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:37:56.051775+0000","last_undegraded":"2024-04-17T15:37:56.051775+0000","last_fullsized":"2024-04-17T15:37:56.051775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048489+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:37:56.048489+0000","last_peered":"2024-04-17T15:37:56.048489+0000","last_clean":"2024-04-17T15:37:56.048489+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:37:56.048489+0000","last_undegraded":"2024-04-17T15:37:56.048489+0000","last_fullsized":"2024-04-17T15:37:56.048489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384800+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:37:56.384800+0000","last_peered":"2024-04-17T15:37:56.384800+0000","last_clean":"2024-04-17T15:37:56.384800+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:37:56.384800+0000","last_undegraded":"2024-04-17T15:37:56.384800+0000","last_fullsized":"2024-04-17T15:37:56.384800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838962+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:37:55.838962+0000","last_peered":"2024-04-17T15:37:55.838962+0000","last_clean":"2024-04-17T15:37:55.838962+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:37:55.838962+0000","last_undegraded":"2024-04-17T15:37:55.838962+0000","last_fullsized":"2024-04-17T15:37:55.838962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049625+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:37:56.049625+0000","last_peered":"2024-04-17T15:37:56.049625+0000","last_clean":"2024-04-17T15:37:56.049625+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:37:56.049625+0000","last_undegraded":"2024-04-17T15:37:56.049625+0000","last_fullsized":"2024-04-17T15:37:56.049625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049566+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:37:56.049566+0000","last_peered":"2024-04-17T15:37:56.049566+0000","last_clean":"2024-04-17T15:37:56.049566+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:37:56.049566+0000","last_undegraded":"2024-04-17T15:37:56.049566+0000","last_fullsized":"2024-04-17T15:37:56.049566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384029+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:37:56.384029+0000","last_peered":"2024-04-17T15:37:56.384029+0000","last_clean":"2024-04-17T15:37:56.384029+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:37:56.384029+0000","last_undegraded":"2024-04-17T15:37:56.384029+0000","last_fullsized":"2024-04-17T15:37:56.384029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380222+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:37:55.380222+0000","last_peered":"2024-04-17T15:37:55.380222+0000","last_clean":"2024-04-17T15:37:55.380222+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:37:55.380222+0000","last_undegraded":"2024-04-17T15:37:55.380222+0000","last_fullsized":"2024-04-17T15:37:55.380222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053291+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:37:56.053291+0000","last_peered":"2024-04-17T15:37:56.053291+0000","last_clean":"2024-04-17T15:37:56.053291+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:37:56.053291+0000","last_undegraded":"2024-04-17T15:37:56.053291+0000","last_fullsized":"2024-04-17T15:37:56.053291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049898+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:37:56.049898+0000","last_peered":"2024-04-17T15:37:56.049898+0000","last_clean":"2024-04-17T15:37:56.049898+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:37:56.049898+0000","last_undegraded":"2024-04-17T15:37:56.049898+0000","last_fullsized":"2024-04-17T15:37:56.049898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383516+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:37:56.383516+0000","last_peered":"2024-04-17T15:37:56.383516+0000","last_clean":"2024-04-17T15:37:56.383516+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:37:56.383516+0000","last_undegraded":"2024-04-17T15:37:56.383516+0000","last_fullsized":"2024-04-17T15:37:56.383516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048915+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:37:56.048915+0000","last_peered":"2024-04-17T15:37:56.048915+0000","last_clean":"2024-04-17T15:37:56.048915+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:37:56.048915+0000","last_undegraded":"2024-04-17T15:37:56.048915+0000","last_fullsized":"2024-04-17T15:37:56.048915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050447+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:37:56.050447+0000","last_peered":"2024-04-17T15:37:56.050447+0000","last_clean":"2024-04-17T15:37:56.050447+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:37:56.050447+0000","last_undegraded":"2024-04-17T15:37:56.050447+0000","last_fullsized":"2024-04-17T15:37:56.050447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048021+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:37:56.048021+0000","last_peered":"2024-04-17T15:37:56.048021+0000","last_clean":"2024-04-17T15:37:56.048021+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:37:56.048021+0000","last_undegraded":"2024-04-17T15:37:56.048021+0000","last_fullsized":"2024-04-17T15:37:56.048021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":96,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051662+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:37:56.051662+0000","last_peered":"2024-04-17T15:37:56.051662+0000","last_clean":"2024-04-17T15:37:56.051662+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:37:56.051662+0000","last_undegraded":"2024-04-17T15:37:56.051662+0000","last_fullsized":"2024-04-17T15:37:56.051662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381485+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:37:55.381485+0000","last_peered":"2024-04-17T15:37:55.381485+0000","last_clean":"2024-04-17T15:37:55.381485+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:37:55.381485+0000","last_undegraded":"2024-04-17T15:37:55.381485+0000","last_fullsized":"2024-04-17T15:37:55.381485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052909+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:37:56.052909+0000","last_peered":"2024-04-17T15:37:56.052909+0000","last_clean":"2024-04-17T15:37:56.052909+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:37:56.052909+0000","last_undegraded":"2024-04-17T15:37:56.052909+0000","last_fullsized":"2024-04-17T15:37:56.052909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048636+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:37:56.048636+0000","last_peered":"2024-04-17T15:37:56.048636+0000","last_clean":"2024-04-17T15:37:56.048636+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:37:56.048636+0000","last_undegraded":"2024-04-17T15:37:56.048636+0000","last_fullsized":"2024-04-17T15:37:56.048636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049802+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:37:56.049802+0000","last_peered":"2024-04-17T15:37:56.049802+0000","last_clean":"2024-04-17T15:37:56.049802+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:37:56.049802+0000","last_undegraded":"2024-04-17T15:37:56.049802+0000","last_fullsized":"2024-04-17T15:37:56.049802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838737+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:37:55.838737+0000","last_peered":"2024-04-17T15:37:55.838737+0000","last_clean":"2024-04-17T15:37:55.838737+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:37:55.838737+0000","last_undegraded":"2024-04-17T15:37:55.838737+0000","last_fullsized":"2024-04-17T15:37:55.838737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.385253+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:37:56.385253+0000","last_peered":"2024-04-17T15:37:56.385253+0000","last_clean":"2024-04-17T15:37:56.385253+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:37:56.385253+0000","last_undegraded":"2024-04-17T15:37:56.385253+0000","last_fullsized":"2024-04-17T15:37:56.385253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382419+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:37:56.382419+0000","last_peered":"2024-04-17T15:37:56.382419+0000","last_clean":"2024-04-17T15:37:56.382419+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:37:56.382419+0000","last_undegraded":"2024-04-17T15:37:56.382419+0000","last_fullsized":"2024-04-17T15:37:56.382419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381116+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:37:55.381116+0000","last_peered":"2024-04-17T15:37:55.381116+0000","last_clean":"2024-04-17T15:37:55.381116+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:37:55.381116+0000","last_undegraded":"2024-04-17T15:37:55.381116+0000","last_fullsized":"2024-04-17T15:37:55.381116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380676+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:37:55.380676+0000","last_peered":"2024-04-17T15:37:55.380676+0000","last_clean":"2024-04-17T15:37:55.380676+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:37:55.380676+0000","last_undegraded":"2024-04-17T15:37:55.380676+0000","last_fullsized":"2024-04-17T15:37:55.380676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050609+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:37:56.050609+0000","last_peered":"2024-04-17T15:37:56.050609+0000","last_clean":"2024-04-17T15:37:56.050609+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:37:56.050609+0000","last_undegraded":"2024-04-17T15:37:56.050609+0000","last_fullsized":"2024-04-17T15:37:56.050609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839416+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:37:55.839416+0000","last_peered":"2024-04-17T15:37:55.839416+0000","last_clean":"2024-04-17T15:37:55.839416+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:37:55.839416+0000","last_undegraded":"2024-04-17T15:37:55.839416+0000","last_fullsized":"2024-04-17T15:37:55.839416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048259+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:37:56.048259+0000","last_peered":"2024-04-17T15:37:56.048259+0000","last_clean":"2024-04-17T15:37:56.048259+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:37:56.048259+0000","last_undegraded":"2024-04-17T15:37:56.048259+0000","last_fullsized":"2024-04-17T15:37:56.048259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048968+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:37:56.048968+0000","last_peered":"2024-04-17T15:37:56.048968+0000","last_clean":"2024-04-17T15:37:56.048968+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:37:56.048968+0000","last_undegraded":"2024-04-17T15:37:56.048968+0000","last_fullsized":"2024-04-17T15:37:56.048968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050722+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:37:56.050722+0000","last_peered":"2024-04-17T15:37:56.050722+0000","last_clean":"2024-04-17T15:37:56.050722+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:37:56.050722+0000","last_undegraded":"2024-04-17T15:37:56.050722+0000","last_fullsized":"2024-04-17T15:37:56.050722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051604+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:37:56.051604+0000","last_peered":"2024-04-17T15:37:56.051604+0000","last_clean":"2024-04-17T15:37:56.051604+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:37:56.051604+0000","last_undegraded":"2024-04-17T15:37:56.051604+0000","last_fullsized":"2024-04-17T15:37:56.051604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053356+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:37:56.053356+0000","last_peered":"2024-04-17T15:37:56.053356+0000","last_clean":"2024-04-17T15:37:56.053356+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:37:56.053356+0000","last_undegraded":"2024-04-17T15:37:56.053356+0000","last_fullsized":"2024-04-17T15:37:56.053356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838944+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:37:55.838944+0000","last_peered":"2024-04-17T15:37:55.838944+0000","last_clean":"2024-04-17T15:37:55.838944+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:37:55.838944+0000","last_undegraded":"2024-04-17T15:37:55.838944+0000","last_fullsized":"2024-04-17T15:37:55.838944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049543+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:37:56.049543+0000","last_peered":"2024-04-17T15:37:56.049543+0000","last_clean":"2024-04-17T15:37:56.049543+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:37:56.049543+0000","last_undegraded":"2024-04-17T15:37:56.049543+0000","last_fullsized":"2024-04-17T15:37:56.049543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838662+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:37:55.838662+0000","last_peered":"2024-04-17T15:37:55.838662+0000","last_clean":"2024-04-17T15:37:55.838662+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:37:55.838662+0000","last_undegraded":"2024-04-17T15:37:55.838662+0000","last_fullsized":"2024-04-17T15:37:55.838662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385423+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:37:55.385423+0000","last_peered":"2024-04-17T15:37:55.385423+0000","last_clean":"2024-04-17T15:37:55.385423+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:37:55.385423+0000","last_undegraded":"2024-04-17T15:37:55.385423+0000","last_fullsized":"2024-04-17T15:37:55.385423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049803+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:37:56.049803+0000","last_peered":"2024-04-17T15:37:56.049803+0000","last_clean":"2024-04-17T15:37:56.049803+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:37:56.049803+0000","last_undegraded":"2024-04-17T15:37:56.049803+0000","last_fullsized":"2024-04-17T15:37:56.049803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383421+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:37:56.383421+0000","last_peered":"2024-04-17T15:37:56.383421+0000","last_clean":"2024-04-17T15:37:56.383421+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:37:56.383421+0000","last_undegraded":"2024-04-17T15:37:56.383421+0000","last_fullsized":"2024-04-17T15:37:56.383421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839046+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:37:55.839046+0000","last_peered":"2024-04-17T15:37:55.839046+0000","last_clean":"2024-04-17T15:37:55.839046+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:37:55.839046+0000","last_undegraded":"2024-04-17T15:37:55.839046+0000","last_fullsized":"2024-04-17T15:37:55.839046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051024+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:37:56.051024+0000","last_peered":"2024-04-17T15:37:56.051024+0000","last_clean":"2024-04-17T15:37:56.051024+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:37:56.051024+0000","last_undegraded":"2024-04-17T15:37:56.051024+0000","last_fullsized":"2024-04-17T15:37:56.051024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050596+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:37:56.050596+0000","last_peered":"2024-04-17T15:37:56.050596+0000","last_clean":"2024-04-17T15:37:56.050596+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:37:56.050596+0000","last_undegraded":"2024-04-17T15:37:56.050596+0000","last_fullsized":"2024-04-17T15:37:56.050596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381353+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:37:56.381353+0000","last_peered":"2024-04-17T15:37:56.381353+0000","last_clean":"2024-04-17T15:37:56.381353+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:37:56.381353+0000","last_undegraded":"2024-04-17T15:37:56.381353+0000","last_fullsized":"2024-04-17T15:37:56.381353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050829+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:37:56.050829+0000","last_peered":"2024-04-17T15:37:56.050829+0000","last_clean":"2024-04-17T15:37:56.050829+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:37:56.050829+0000","last_undegraded":"2024-04-17T15:37:56.050829+0000","last_fullsized":"2024-04-17T15:37:56.050829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380855+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:37:55.380855+0000","last_peered":"2024-04-17T15:37:55.380855+0000","last_clean":"2024-04-17T15:37:55.380855+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:37:55.380855+0000","last_undegraded":"2024-04-17T15:37:55.380855+0000","last_fullsized":"2024-04-17T15:37:55.380855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384605+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:37:55.384605+0000","last_peered":"2024-04-17T15:37:55.384605+0000","last_clean":"2024-04-17T15:37:55.384605+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:37:55.384605+0000","last_undegraded":"2024-04-17T15:37:55.384605+0000","last_fullsized":"2024-04-17T15:37:55.384605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839387+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:37:55.839387+0000","last_peered":"2024-04-17T15:37:55.839387+0000","last_clean":"2024-04-17T15:37:55.839387+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:37:55.839387+0000","last_undegraded":"2024-04-17T15:37:55.839387+0000","last_fullsized":"2024-04-17T15:37:55.839387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839210+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:37:55.839210+0000","last_peered":"2024-04-17T15:37:55.839210+0000","last_clean":"2024-04-17T15:37:55.839210+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:37:55.839210+0000","last_undegraded":"2024-04-17T15:37:55.839210+0000","last_fullsized":"2024-04-17T15:37:55.839210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381363+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:37:55.381363+0000","last_peered":"2024-04-17T15:37:55.381363+0000","last_clean":"2024-04-17T15:37:55.381363+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:37:55.381363+0000","last_undegraded":"2024-04-17T15:37:55.381363+0000","last_fullsized":"2024-04-17T15:37:55.381363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051433+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:37:56.051433+0000","last_peered":"2024-04-17T15:37:56.051433+0000","last_clean":"2024-04-17T15:37:56.051433+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:37:56.051433+0000","last_undegraded":"2024-04-17T15:37:56.051433+0000","last_fullsized":"2024-04-17T15:37:56.051433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049187+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:37:56.049187+0000","last_peered":"2024-04-17T15:37:56.049187+0000","last_clean":"2024-04-17T15:37:56.049187+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:37:56.049187+0000","last_undegraded":"2024-04-17T15:37:56.049187+0000","last_fullsized":"2024-04-17T15:37:56.049187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053468+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:37:56.053468+0000","last_peered":"2024-04-17T15:37:56.053468+0000","last_clean":"2024-04-17T15:37:56.053468+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:37:56.053468+0000","last_undegraded":"2024-04-17T15:37:56.053468+0000","last_fullsized":"2024-04-17T15:37:56.053468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":82,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383803+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:37:56.383803+0000","last_peered":"2024-04-17T15:37:56.383803+0000","last_clean":"2024-04-17T15:37:56.383803+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:37:56.383803+0000","last_undegraded":"2024-04-17T15:37:56.383803+0000","last_fullsized":"2024-04-17T15:37:56.383803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381324+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:37:55.381324+0000","last_peered":"2024-04-17T15:37:55.381324+0000","last_clean":"2024-04-17T15:37:55.381324+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:37:55.381324+0000","last_undegraded":"2024-04-17T15:37:55.381324+0000","last_fullsized":"2024-04-17T15:37:55.381324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048649+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:37:56.048649+0000","last_peered":"2024-04-17T15:37:56.048649+0000","last_clean":"2024-04-17T15:37:56.048649+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:37:56.048649+0000","last_undegraded":"2024-04-17T15:37:56.048649+0000","last_fullsized":"2024-04-17T15:37:56.048649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385710+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:37:55.385710+0000","last_peered":"2024-04-17T15:37:55.385710+0000","last_clean":"2024-04-17T15:37:55.385710+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:37:55.385710+0000","last_undegraded":"2024-04-17T15:37:55.385710+0000","last_fullsized":"2024-04-17T15:37:55.385710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382324+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:37:56.382324+0000","last_peered":"2024-04-17T15:37:56.382324+0000","last_clean":"2024-04-17T15:37:56.382324+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:37:56.382324+0000","last_undegraded":"2024-04-17T15:37:56.382324+0000","last_fullsized":"2024-04-17T15:37:56.382324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051236+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:37:56.051236+0000","last_peered":"2024-04-17T15:37:56.051236+0000","last_clean":"2024-04-17T15:37:56.051236+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:37:56.051236+0000","last_undegraded":"2024-04-17T15:37:56.051236+0000","last_fullsized":"2024-04-17T15:37:56.051236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053090+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:37:56.053090+0000","last_peered":"2024-04-17T15:37:56.053090+0000","last_clean":"2024-04-17T15:37:56.053090+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:37:56.053090+0000","last_undegraded":"2024-04-17T15:37:56.053090+0000","last_fullsized":"2024-04-17T15:37:56.053090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380356+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:37:55.380356+0000","last_peered":"2024-04-17T15:37:55.380356+0000","last_clean":"2024-04-17T15:37:55.380356+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:37:55.380356+0000","last_undegraded":"2024-04-17T15:37:55.380356+0000","last_fullsized":"2024-04-17T15:37:55.380356+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381399+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:37:55.381399+0000","last_peered":"2024-04-17T15:37:55.381399+0000","last_clean":"2024-04-17T15:37:55.381399+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:37:55.381399+0000","last_undegraded":"2024-04-17T15:37:55.381399+0000","last_fullsized":"2024-04-17T15:37:55.381399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381633+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:37:55.381633+0000","last_peered":"2024-04-17T15:37:55.381633+0000","last_clean":"2024-04-17T15:37:55.381633+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:37:55.381633+0000","last_undegraded":"2024-04-17T15:37:55.381633+0000","last_fullsized":"2024-04-17T15:37:55.381633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048387+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:37:56.048387+0000","last_peered":"2024-04-17T15:37:56.048387+0000","last_clean":"2024-04-17T15:37:56.048387+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:37:56.048387+0000","last_undegraded":"2024-04-17T15:37:56.048387+0000","last_fullsized":"2024-04-17T15:37:56.048387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052947+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:37:56.052947+0000","last_peered":"2024-04-17T15:37:56.052947+0000","last_clean":"2024-04-17T15:37:56.052947+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:37:56.052947+0000","last_undegraded":"2024-04-17T15:37:56.052947+0000","last_fullsized":"2024-04-17T15:37:56.052947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383317+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:37:56.383317+0000","last_peered":"2024-04-17T15:37:56.383317+0000","last_clean":"2024-04-17T15:37:56.383317+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:37:56.383317+0000","last_undegraded":"2024-04-17T15:37:56.383317+0000","last_fullsized":"2024-04-17T15:37:56.383317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051013+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:37:56.051013+0000","last_peered":"2024-04-17T15:37:56.051013+0000","last_clean":"2024-04-17T15:37:56.051013+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:37:56.051013+0000","last_undegraded":"2024-04-17T15:37:56.051013+0000","last_fullsized":"2024-04-17T15:37:56.051013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053502+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:37:56.053502+0000","last_peered":"2024-04-17T15:37:56.053502+0000","last_clean":"2024-04-17T15:37:56.053502+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:37:56.053502+0000","last_undegraded":"2024-04-17T15:37:56.053502+0000","last_fullsized":"2024-04-17T15:37:56.053502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051059+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:37:56.051059+0000","last_peered":"2024-04-17T15:37:56.051059+0000","last_clean":"2024-04-17T15:37:56.051059+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:37:56.051059+0000","last_undegraded":"2024-04-17T15:37:56.051059+0000","last_fullsized":"2024-04-17T15:37:56.051059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379763+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:37:55.379763+0000","last_peered":"2024-04-17T15:37:55.379763+0000","last_clean":"2024-04-17T15:37:55.379763+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:37:55.379763+0000","last_undegraded":"2024-04-17T15:37:55.379763+0000","last_fullsized":"2024-04-17T15:37:55.379763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051599+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:37:56.051599+0000","last_peered":"2024-04-17T15:37:56.051599+0000","last_clean":"2024-04-17T15:37:56.051599+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:37:56.051599+0000","last_undegraded":"2024-04-17T15:37:56.051599+0000","last_fullsized":"2024-04-17T15:37:56.051599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048139+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:37:56.048139+0000","last_peered":"2024-04-17T15:37:56.048139+0000","last_clean":"2024-04-17T15:37:56.048139+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:37:56.048139+0000","last_undegraded":"2024-04-17T15:37:56.048139+0000","last_fullsized":"2024-04-17T15:37:56.048139+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049552+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:37:56.049552+0000","last_peered":"2024-04-17T15:37:56.049552+0000","last_clean":"2024-04-17T15:37:56.049552+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:37:56.049552+0000","last_undegraded":"2024-04-17T15:37:56.049552+0000","last_fullsized":"2024-04-17T15:37:56.049552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053800+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:37:56.053800+0000","last_peered":"2024-04-17T15:37:56.053800+0000","last_clean":"2024-04-17T15:37:56.053800+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:37:56.053800+0000","last_undegraded":"2024-04-17T15:37:56.053800+0000","last_fullsized":"2024-04-17T15:37:56.053800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384562+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:37:55.384562+0000","last_peered":"2024-04-17T15:37:55.384562+0000","last_clean":"2024-04-17T15:37:55.384562+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:37:55.384562+0000","last_undegraded":"2024-04-17T15:37:55.384562+0000","last_fullsized":"2024-04-17T15:37:55.384562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049769+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:37:56.049769+0000","last_peered":"2024-04-17T15:37:56.049769+0000","last_clean":"2024-04-17T15:37:56.049769+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:37:56.049769+0000","last_undegraded":"2024-04-17T15:37:56.049769+0000","last_fullsized":"2024-04-17T15:37:56.049769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381186+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:37:55.381186+0000","last_peered":"2024-04-17T15:37:55.381186+0000","last_clean":"2024-04-17T15:37:55.381186+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:37:55.381186+0000","last_undegraded":"2024-04-17T15:37:55.381186+0000","last_fullsized":"2024-04-17T15:37:55.381186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385794+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:37:55.385794+0000","last_peered":"2024-04-17T15:37:55.385794+0000","last_clean":"2024-04-17T15:37:55.385794+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:37:55.385794+0000","last_undegraded":"2024-04-17T15:37:55.385794+0000","last_fullsized":"2024-04-17T15:37:55.385794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838910+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:37:55.838910+0000","last_peered":"2024-04-17T15:37:55.838910+0000","last_clean":"2024-04-17T15:37:55.838910+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:37:55.838910+0000","last_undegraded":"2024-04-17T15:37:55.838910+0000","last_fullsized":"2024-04-17T15:37:55.838910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381118+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:37:55.381118+0000","last_peered":"2024-04-17T15:37:55.381118+0000","last_clean":"2024-04-17T15:37:55.381118+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:37:55.381118+0000","last_undegraded":"2024-04-17T15:37:55.381118+0000","last_fullsized":"2024-04-17T15:37:55.381118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839389+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:37:55.839389+0000","last_peered":"2024-04-17T15:37:55.839389+0000","last_clean":"2024-04-17T15:37:55.839389+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:37:55.839389+0000","last_undegraded":"2024-04-17T15:37:55.839389+0000","last_fullsized":"2024-04-17T15:37:55.839389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050171+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:37:56.050171+0000","last_peered":"2024-04-17T15:37:56.050171+0000","last_clean":"2024-04-17T15:37:56.050171+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:37:56.050171+0000","last_undegraded":"2024-04-17T15:37:56.050171+0000","last_fullsized":"2024-04-17T15:37:56.050171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050397+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:37:56.050397+0000","last_peered":"2024-04-17T15:37:56.050397+0000","last_clean":"2024-04-17T15:37:56.050397+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:37:56.050397+0000","last_undegraded":"2024-04-17T15:37:56.050397+0000","last_fullsized":"2024-04-17T15:37:56.050397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384596+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:37:56.384596+0000","last_peered":"2024-04-17T15:37:56.384596+0000","last_clean":"2024-04-17T15:37:56.384596+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:37:56.384596+0000","last_undegraded":"2024-04-17T15:37:56.384596+0000","last_fullsized":"2024-04-17T15:37:56.384596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384775+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:37:55.384775+0000","last_peered":"2024-04-17T15:37:55.384775+0000","last_clean":"2024-04-17T15:37:55.384775+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:37:55.384775+0000","last_undegraded":"2024-04-17T15:37:55.384775+0000","last_fullsized":"2024-04-17T15:37:55.384775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052627+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:37:56.052627+0000","last_peered":"2024-04-17T15:37:56.052627+0000","last_clean":"2024-04-17T15:37:56.052627+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:37:56.052627+0000","last_undegraded":"2024-04-17T15:37:56.052627+0000","last_fullsized":"2024-04-17T15:37:56.052627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050193+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:37:56.050193+0000","last_peered":"2024-04-17T15:37:56.050193+0000","last_clean":"2024-04-17T15:37:56.050193+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:37:56.050193+0000","last_undegraded":"2024-04-17T15:37:56.050193+0000","last_fullsized":"2024-04-17T15:37:56.050193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050006+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:37:56.050006+0000","last_peered":"2024-04-17T15:37:56.050006+0000","last_clean":"2024-04-17T15:37:56.050006+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:37:56.050006+0000","last_undegraded":"2024-04-17T15:37:56.050006+0000","last_fullsized":"2024-04-17T15:37:56.050006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383059+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:37:56.383059+0000","last_peered":"2024-04-17T15:37:56.383059+0000","last_clean":"2024-04-17T15:37:56.383059+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:37:56.383059+0000","last_undegraded":"2024-04-17T15:37:56.383059+0000","last_fullsized":"2024-04-17T15:37:56.383059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381854+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:37:55.381854+0000","last_peered":"2024-04-17T15:37:55.381854+0000","last_clean":"2024-04-17T15:37:55.381854+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:37:55.381854+0000","last_undegraded":"2024-04-17T15:37:55.381854+0000","last_fullsized":"2024-04-17T15:37:55.381854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048283+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:37:56.048283+0000","last_peered":"2024-04-17T15:37:56.048283+0000","last_clean":"2024-04-17T15:37:56.048283+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:37:56.048283+0000","last_undegraded":"2024-04-17T15:37:56.048283+0000","last_fullsized":"2024-04-17T15:37:56.048283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381493+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:37:55.381493+0000","last_peered":"2024-04-17T15:37:55.381493+0000","last_clean":"2024-04-17T15:37:55.381493+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:37:55.381493+0000","last_undegraded":"2024-04-17T15:37:55.381493+0000","last_fullsized":"2024-04-17T15:37:55.381493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053691+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:37:56.053691+0000","last_peered":"2024-04-17T15:37:56.053691+0000","last_clean":"2024-04-17T15:37:56.053691+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:37:56.053691+0000","last_undegraded":"2024-04-17T15:37:56.053691+0000","last_fullsized":"2024-04-17T15:37:56.053691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384967+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:37:55.384967+0000","last_peered":"2024-04-17T15:37:55.384967+0000","last_clean":"2024-04-17T15:37:55.384967+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:37:55.384967+0000","last_undegraded":"2024-04-17T15:37:55.384967+0000","last_fullsized":"2024-04-17T15:37:55.384967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051051+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:37:56.051051+0000","last_peered":"2024-04-17T15:37:56.051051+0000","last_clean":"2024-04-17T15:37:56.051051+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:37:56.051051+0000","last_undegraded":"2024-04-17T15:37:56.051051+0000","last_fullsized":"2024-04-17T15:37:56.051051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049447+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:37:56.049447+0000","last_peered":"2024-04-17T15:37:56.049447+0000","last_clean":"2024-04-17T15:37:56.049447+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:37:56.049447+0000","last_undegraded":"2024-04-17T15:37:56.049447+0000","last_fullsized":"2024-04-17T15:37:56.049447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048217+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:37:56.048217+0000","last_peered":"2024-04-17T15:37:56.048217+0000","last_clean":"2024-04-17T15:37:56.048217+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:37:56.048217+0000","last_undegraded":"2024-04-17T15:37:56.048217+0000","last_fullsized":"2024-04-17T15:37:56.048217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050091+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:37:56.050091+0000","last_peered":"2024-04-17T15:37:56.050091+0000","last_clean":"2024-04-17T15:37:56.050091+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:37:56.050091+0000","last_undegraded":"2024-04-17T15:37:56.050091+0000","last_fullsized":"2024-04-17T15:37:56.050091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051550+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:37:56.051550+0000","last_peered":"2024-04-17T15:37:56.051550+0000","last_clean":"2024-04-17T15:37:56.051550+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:37:56.051550+0000","last_undegraded":"2024-04-17T15:37:56.051550+0000","last_fullsized":"2024-04-17T15:37:56.051550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384895+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:37:55.384895+0000","last_peered":"2024-04-17T15:37:55.384895+0000","last_clean":"2024-04-17T15:37:55.384895+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:37:55.384895+0000","last_undegraded":"2024-04-17T15:37:55.384895+0000","last_fullsized":"2024-04-17T15:37:55.384895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050941+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:37:56.050941+0000","last_peered":"2024-04-17T15:37:56.050941+0000","last_clean":"2024-04-17T15:37:56.050941+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:37:56.050941+0000","last_undegraded":"2024-04-17T15:37:56.050941+0000","last_fullsized":"2024-04-17T15:37:56.050941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380251+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:37:55.380251+0000","last_peered":"2024-04-17T15:37:55.380251+0000","last_clean":"2024-04-17T15:37:55.380251+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:37:55.380251+0000","last_undegraded":"2024-04-17T15:37:55.380251+0000","last_fullsized":"2024-04-17T15:37:55.380251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380998+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:37:55.380998+0000","last_peered":"2024-04-17T15:37:55.380998+0000","last_clean":"2024-04-17T15:37:55.380998+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:37:55.380998+0000","last_undegraded":"2024-04-17T15:37:55.380998+0000","last_fullsized":"2024-04-17T15:37:55.380998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048709+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:37:56.048709+0000","last_peered":"2024-04-17T15:37:56.048709+0000","last_clean":"2024-04-17T15:37:56.048709+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:37:56.048709+0000","last_undegraded":"2024-04-17T15:37:56.048709+0000","last_fullsized":"2024-04-17T15:37:56.048709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384440+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:37:56.384440+0000","last_peered":"2024-04-17T15:37:56.384440+0000","last_clean":"2024-04-17T15:37:56.384440+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:37:56.384440+0000","last_undegraded":"2024-04-17T15:37:56.384440+0000","last_fullsized":"2024-04-17T15:37:56.384440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381849+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:37:56.381849+0000","last_peered":"2024-04-17T15:37:56.381849+0000","last_clean":"2024-04-17T15:37:56.381849+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:37:56.381849+0000","last_undegraded":"2024-04-17T15:37:56.381849+0000","last_fullsized":"2024-04-17T15:37:56.381849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382581+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:37:56.382581+0000","last_peered":"2024-04-17T15:37:56.382581+0000","last_clean":"2024-04-17T15:37:56.382581+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:37:56.382581+0000","last_undegraded":"2024-04-17T15:37:56.382581+0000","last_fullsized":"2024-04-17T15:37:56.382581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385275+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:37:55.385275+0000","last_peered":"2024-04-17T15:37:55.385275+0000","last_clean":"2024-04-17T15:37:55.385275+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:37:55.385275+0000","last_undegraded":"2024-04-17T15:37:55.385275+0000","last_fullsized":"2024-04-17T15:37:55.385275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048512+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:37:56.048512+0000","last_peered":"2024-04-17T15:37:56.048512+0000","last_clean":"2024-04-17T15:37:56.048512+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:37:56.048512+0000","last_undegraded":"2024-04-17T15:37:56.048512+0000","last_fullsized":"2024-04-17T15:37:56.048512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048861+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:37:56.048861+0000","last_peered":"2024-04-17T15:37:56.048861+0000","last_clean":"2024-04-17T15:37:56.048861+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:37:56.048861+0000","last_undegraded":"2024-04-17T15:37:56.048861+0000","last_fullsized":"2024-04-17T15:37:56.048861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":76,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.386124+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:37:56.386124+0000","last_peered":"2024-04-17T15:37:56.386124+0000","last_clean":"2024-04-17T15:37:56.386124+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:37:56.386124+0000","last_undegraded":"2024-04-17T15:37:56.386124+0000","last_fullsized":"2024-04-17T15:37:56.386124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050693+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:37:56.050693+0000","last_peered":"2024-04-17T15:37:56.050693+0000","last_clean":"2024-04-17T15:37:56.050693+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:37:56.050693+0000","last_undegraded":"2024-04-17T15:37:56.050693+0000","last_fullsized":"2024-04-17T15:37:56.050693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048768+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:37:56.048768+0000","last_peered":"2024-04-17T15:37:56.048768+0000","last_clean":"2024-04-17T15:37:56.048768+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:37:56.048768+0000","last_undegraded":"2024-04-17T15:37:56.048768+0000","last_fullsized":"2024-04-17T15:37:56.048768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051808+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:37:56.051808+0000","last_peered":"2024-04-17T15:37:56.051808+0000","last_clean":"2024-04-17T15:37:56.051808+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:37:56.051808+0000","last_undegraded":"2024-04-17T15:37:56.051808+0000","last_fullsized":"2024-04-17T15:37:56.051808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.382287+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:37:55.382287+0000","last_peered":"2024-04-17T15:37:55.382287+0000","last_clean":"2024-04-17T15:37:55.382287+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:37:55.382287+0000","last_undegraded":"2024-04-17T15:37:55.382287+0000","last_fullsized":"2024-04-17T15:37:55.382287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":71,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381640+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:37:56.381640+0000","last_peered":"2024-04-17T15:37:56.381640+0000","last_clean":"2024-04-17T15:37:56.381640+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:37:56.381640+0000","last_undegraded":"2024-04-17T15:37:56.381640+0000","last_fullsized":"2024-04-17T15:37:56.381640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048604+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:37:56.048604+0000","last_peered":"2024-04-17T15:37:56.048604+0000","last_clean":"2024-04-17T15:37:56.048604+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:37:56.048604+0000","last_undegraded":"2024-04-17T15:37:56.048604+0000","last_fullsized":"2024-04-17T15:37:56.048604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382686+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:37:56.382686+0000","last_peered":"2024-04-17T15:37:56.382686+0000","last_clean":"2024-04-17T15:37:56.382686+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:37:56.382686+0000","last_undegraded":"2024-04-17T15:37:56.382686+0000","last_fullsized":"2024-04-17T15:37:56.382686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052977+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:37:56.052977+0000","last_peered":"2024-04-17T15:37:56.052977+0000","last_clean":"2024-04-17T15:37:56.052977+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:37:56.052977+0000","last_undegraded":"2024-04-17T15:37:56.052977+0000","last_fullsized":"2024-04-17T15:37:56.052977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050226+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:37:56.050226+0000","last_peered":"2024-04-17T15:37:56.050226+0000","last_clean":"2024-04-17T15:37:56.050226+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:37:56.050226+0000","last_undegraded":"2024-04-17T15:37:56.050226+0000","last_fullsized":"2024-04-17T15:37:56.050226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049834+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:37:56.049834+0000","last_peered":"2024-04-17T15:37:56.049834+0000","last_clean":"2024-04-17T15:37:56.049834+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:37:56.049834+0000","last_undegraded":"2024-04-17T15:37:56.049834+0000","last_fullsized":"2024-04-17T15:37:56.049834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049197+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:37:56.049197+0000","last_peered":"2024-04-17T15:37:56.049197+0000","last_clean":"2024-04-17T15:37:56.049197+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:37:56.049197+0000","last_undegraded":"2024-04-17T15:37:56.049197+0000","last_fullsized":"2024-04-17T15:37:56.049197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381458+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:37:55.381458+0000","last_peered":"2024-04-17T15:37:55.381458+0000","last_clean":"2024-04-17T15:37:55.381458+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:37:55.381458+0000","last_undegraded":"2024-04-17T15:37:55.381458+0000","last_fullsized":"2024-04-17T15:37:55.381458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381921+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:37:56.381921+0000","last_peered":"2024-04-17T15:37:56.381921+0000","last_clean":"2024-04-17T15:37:56.381921+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:37:56.381921+0000","last_undegraded":"2024-04-17T15:37:56.381921+0000","last_fullsized":"2024-04-17T15:37:56.381921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":63,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.381378+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:37:56.381378+0000","last_peered":"2024-04-17T15:37:56.381378+0000","last_clean":"2024-04-17T15:37:56.381378+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:37:56.381378+0000","last_undegraded":"2024-04-17T15:37:56.381378+0000","last_fullsized":"2024-04-17T15:37:56.381378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382306+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:37:56.382306+0000","last_peered":"2024-04-17T15:37:56.382306+0000","last_clean":"2024-04-17T15:37:56.382306+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:37:56.382306+0000","last_undegraded":"2024-04-17T15:37:56.382306+0000","last_fullsized":"2024-04-17T15:37:56.382306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051519+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:37:56.051519+0000","last_peered":"2024-04-17T15:37:56.051519+0000","last_clean":"2024-04-17T15:37:56.051519+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:37:56.051519+0000","last_undegraded":"2024-04-17T15:37:56.051519+0000","last_fullsized":"2024-04-17T15:37:56.051519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050482+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:37:56.050482+0000","last_peered":"2024-04-17T15:37:56.050482+0000","last_clean":"2024-04-17T15:37:56.050482+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:37:56.050482+0000","last_undegraded":"2024-04-17T15:37:56.050482+0000","last_fullsized":"2024-04-17T15:37:56.050482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":73,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384341+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:37:56.384341+0000","last_peered":"2024-04-17T15:37:56.384341+0000","last_clean":"2024-04-17T15:37:56.384341+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:37:56.384341+0000","last_undegraded":"2024-04-17T15:37:56.384341+0000","last_fullsized":"2024-04-17T15:37:56.384341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"42'5","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049273+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:37:56.049273+0000","last_peered":"2024-04-17T15:37:56.049273+0000","last_clean":"2024-04-17T15:37:56.049273+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:37:56.049273+0000","last_undegraded":"2024-04-17T15:37:56.049273+0000","last_fullsized":"2024-04-17T15:37:56.049273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051128+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:37:56.051128+0000","last_peered":"2024-04-17T15:37:56.051128+0000","last_clean":"2024-04-17T15:37:56.051128+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:37:56.051128+0000","last_undegraded":"2024-04-17T15:37:56.051128+0000","last_fullsized":"2024-04-17T15:37:56.051128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050935+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:37:56.050935+0000","last_peered":"2024-04-17T15:37:56.050935+0000","last_clean":"2024-04-17T15:37:56.050935+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:37:56.050935+0000","last_undegraded":"2024-04-17T15:37:56.050935+0000","last_fullsized":"2024-04-17T15:37:56.050935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382771+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:37:56.382771+0000","last_peered":"2024-04-17T15:37:56.382771+0000","last_clean":"2024-04-17T15:37:56.382771+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:37:56.382771+0000","last_undegraded":"2024-04-17T15:37:56.382771+0000","last_fullsized":"2024-04-17T15:37:56.382771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839276+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:37:55.839276+0000","last_peered":"2024-04-17T15:37:55.839276+0000","last_clean":"2024-04-17T15:37:55.839276+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:37:55.839276+0000","last_undegraded":"2024-04-17T15:37:55.839276+0000","last_fullsized":"2024-04-17T15:37:55.839276+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047673+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:37:56.047673+0000","last_peered":"2024-04-17T15:37:56.047673+0000","last_clean":"2024-04-17T15:37:56.047673+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:37:56.047673+0000","last_undegraded":"2024-04-17T15:37:56.047673+0000","last_fullsized":"2024-04-17T15:37:56.047673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383828+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:37:56.383828+0000","last_peered":"2024-04-17T15:37:56.383828+0000","last_clean":"2024-04-17T15:37:56.383828+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:37:56.383828+0000","last_undegraded":"2024-04-17T15:37:56.383828+0000","last_fullsized":"2024-04-17T15:37:56.383828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380206+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:37:55.380206+0000","last_peered":"2024-04-17T15:37:55.380206+0000","last_clean":"2024-04-17T15:37:55.380206+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:37:55.380206+0000","last_undegraded":"2024-04-17T15:37:55.380206+0000","last_fullsized":"2024-04-17T15:37:55.380206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052899+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:37:56.052899+0000","last_peered":"2024-04-17T15:37:56.052899+0000","last_clean":"2024-04-17T15:37:56.052899+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:37:56.052899+0000","last_undegraded":"2024-04-17T15:37:56.052899+0000","last_fullsized":"2024-04-17T15:37:56.052899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382027+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:37:56.382027+0000","last_peered":"2024-04-17T15:37:56.382027+0000","last_clean":"2024-04-17T15:37:56.382027+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:37:56.382027+0000","last_undegraded":"2024-04-17T15:37:56.382027+0000","last_fullsized":"2024-04-17T15:37:56.382027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051106+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:37:56.051106+0000","last_peered":"2024-04-17T15:37:56.051106+0000","last_clean":"2024-04-17T15:37:56.051106+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:37:56.051106+0000","last_undegraded":"2024-04-17T15:37:56.051106+0000","last_fullsized":"2024-04-17T15:37:56.051106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.380473+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:37:55.380473+0000","last_peered":"2024-04-17T15:37:55.380473+0000","last_clean":"2024-04-17T15:37:55.380473+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:37:55.380473+0000","last_undegraded":"2024-04-17T15:37:55.380473+0000","last_fullsized":"2024-04-17T15:37:55.380473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048693+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:37:56.048693+0000","last_peered":"2024-04-17T15:37:56.048693+0000","last_clean":"2024-04-17T15:37:56.048693+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:37:56.048693+0000","last_undegraded":"2024-04-17T15:37:56.048693+0000","last_fullsized":"2024-04-17T15:37:56.048693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049972+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:37:56.049972+0000","last_peered":"2024-04-17T15:37:56.049972+0000","last_clean":"2024-04-17T15:37:56.049972+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:37:56.049972+0000","last_undegraded":"2024-04-17T15:37:56.049972+0000","last_fullsized":"2024-04-17T15:37:56.049972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.382141+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:37:55.382141+0000","last_peered":"2024-04-17T15:37:55.382141+0000","last_clean":"2024-04-17T15:37:55.382141+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:37:55.382141+0000","last_undegraded":"2024-04-17T15:37:55.382141+0000","last_fullsized":"2024-04-17T15:37:55.382141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382574+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:37:56.382574+0000","last_peered":"2024-04-17T15:37:56.382574+0000","last_clean":"2024-04-17T15:37:56.382574+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:37:56.382574+0000","last_undegraded":"2024-04-17T15:37:56.382574+0000","last_fullsized":"2024-04-17T15:37:56.382574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051333+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:37:56.051333+0000","last_peered":"2024-04-17T15:37:56.051333+0000","last_clean":"2024-04-17T15:37:56.051333+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:37:56.051333+0000","last_undegraded":"2024-04-17T15:37:56.051333+0000","last_fullsized":"2024-04-17T15:37:56.051333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384771+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:37:55.384771+0000","last_peered":"2024-04-17T15:37:55.384771+0000","last_clean":"2024-04-17T15:37:55.384771+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:37:55.384771+0000","last_undegraded":"2024-04-17T15:37:55.384771+0000","last_fullsized":"2024-04-17T15:37:55.384771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053050+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:37:56.053050+0000","last_peered":"2024-04-17T15:37:56.053050+0000","last_clean":"2024-04-17T15:37:56.053050+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:37:56.053050+0000","last_undegraded":"2024-04-17T15:37:56.053050+0000","last_fullsized":"2024-04-17T15:37:56.053050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383115+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:37:56.383115+0000","last_peered":"2024-04-17T15:37:56.383115+0000","last_clean":"2024-04-17T15:37:56.383115+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:37:56.383115+0000","last_undegraded":"2024-04-17T15:37:56.383115+0000","last_fullsized":"2024-04-17T15:37:56.383115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051425+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:37:56.051425+0000","last_peered":"2024-04-17T15:37:56.051425+0000","last_clean":"2024-04-17T15:37:56.051425+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:37:56.051425+0000","last_undegraded":"2024-04-17T15:37:56.051425+0000","last_fullsized":"2024-04-17T15:37:56.051425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.383098+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:37:55.383098+0000","last_peered":"2024-04-17T15:37:55.383098+0000","last_clean":"2024-04-17T15:37:55.383098+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:37:55.383098+0000","last_undegraded":"2024-04-17T15:37:55.383098+0000","last_fullsized":"2024-04-17T15:37:55.383098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381850+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:37:55.381850+0000","last_peered":"2024-04-17T15:37:55.381850+0000","last_clean":"2024-04-17T15:37:55.381850+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:37:55.381850+0000","last_undegraded":"2024-04-17T15:37:55.381850+0000","last_fullsized":"2024-04-17T15:37:55.381850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049376+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:37:56.049376+0000","last_peered":"2024-04-17T15:37:56.049376+0000","last_clean":"2024-04-17T15:37:56.049376+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:37:56.049376+0000","last_undegraded":"2024-04-17T15:37:56.049376+0000","last_fullsized":"2024-04-17T15:37:56.049376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384882+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:37:55.384882+0000","last_peered":"2024-04-17T15:37:55.384882+0000","last_clean":"2024-04-17T15:37:55.384882+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:37:55.384882+0000","last_undegraded":"2024-04-17T15:37:55.384882+0000","last_fullsized":"2024-04-17T15:37:55.384882+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379909+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:37:55.379909+0000","last_peered":"2024-04-17T15:37:55.379909+0000","last_clean":"2024-04-17T15:37:55.379909+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:37:55.379909+0000","last_undegraded":"2024-04-17T15:37:55.379909+0000","last_fullsized":"2024-04-17T15:37:55.379909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382166+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:37:56.382166+0000","last_peered":"2024-04-17T15:37:56.382166+0000","last_clean":"2024-04-17T15:37:56.382166+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:37:56.382166+0000","last_undegraded":"2024-04-17T15:37:56.382166+0000","last_fullsized":"2024-04-17T15:37:56.382166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049237+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:37:56.049237+0000","last_peered":"2024-04-17T15:37:56.049237+0000","last_clean":"2024-04-17T15:37:56.049237+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:37:56.049237+0000","last_undegraded":"2024-04-17T15:37:56.049237+0000","last_fullsized":"2024-04-17T15:37:56.049237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050190+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:37:56.050190+0000","last_peered":"2024-04-17T15:37:56.050190+0000","last_clean":"2024-04-17T15:37:56.050190+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:37:56.050190+0000","last_undegraded":"2024-04-17T15:37:56.050190+0000","last_fullsized":"2024-04-17T15:37:56.050190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384655+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:37:56.384655+0000","last_peered":"2024-04-17T15:37:56.384655+0000","last_clean":"2024-04-17T15:37:56.384655+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:37:56.384655+0000","last_undegraded":"2024-04-17T15:37:56.384655+0000","last_fullsized":"2024-04-17T15:37:56.384655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384807+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:37:55.384807+0000","last_peered":"2024-04-17T15:37:55.384807+0000","last_clean":"2024-04-17T15:37:55.384807+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:37:55.384807+0000","last_undegraded":"2024-04-17T15:37:55.384807+0000","last_fullsized":"2024-04-17T15:37:55.384807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051408+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:37:56.051408+0000","last_peered":"2024-04-17T15:37:56.051408+0000","last_clean":"2024-04-17T15:37:56.051408+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:37:56.051408+0000","last_undegraded":"2024-04-17T15:37:56.051408+0000","last_fullsized":"2024-04-17T15:37:56.051408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839297+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:37:55.839297+0000","last_peered":"2024-04-17T15:37:55.839297+0000","last_clean":"2024-04-17T15:37:55.839297+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:37:55.839297+0000","last_undegraded":"2024-04-17T15:37:55.839297+0000","last_fullsized":"2024-04-17T15:37:55.839297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050116+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:37:56.050116+0000","last_peered":"2024-04-17T15:37:56.050116+0000","last_clean":"2024-04-17T15:37:56.050116+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:37:56.050116+0000","last_undegraded":"2024-04-17T15:37:56.050116+0000","last_fullsized":"2024-04-17T15:37:56.050116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385189+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:37:55.385189+0000","last_peered":"2024-04-17T15:37:55.385189+0000","last_clean":"2024-04-17T15:37:55.385189+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:37:55.385189+0000","last_undegraded":"2024-04-17T15:37:55.385189+0000","last_fullsized":"2024-04-17T15:37:55.385189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051132+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:37:56.051132+0000","last_peered":"2024-04-17T15:37:56.051132+0000","last_clean":"2024-04-17T15:37:56.051132+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:37:56.051132+0000","last_undegraded":"2024-04-17T15:37:56.051132+0000","last_fullsized":"2024-04-17T15:37:56.051132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"27'2","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381614+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:37:55.381614+0000","last_peered":"2024-04-17T15:37:55.381614+0000","last_clean":"2024-04-17T15:37:55.381614+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:37:55.381614+0000","last_undegraded":"2024-04-17T15:37:55.381614+0000","last_fullsized":"2024-04-17T15:37:55.381614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047513+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:37:56.047513+0000","last_peered":"2024-04-17T15:37:56.047513+0000","last_clean":"2024-04-17T15:37:56.047513+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:37:56.047513+0000","last_undegraded":"2024-04-17T15:37:56.047513+0000","last_fullsized":"2024-04-17T15:37:56.047513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049707+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:37:56.049707+0000","last_peered":"2024-04-17T15:37:56.049707+0000","last_clean":"2024-04-17T15:37:56.049707+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:37:56.049707+0000","last_undegraded":"2024-04-17T15:37:56.049707+0000","last_fullsized":"2024-04-17T15:37:56.049707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053177+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:37:56.053177+0000","last_peered":"2024-04-17T15:37:56.053177+0000","last_clean":"2024-04-17T15:37:56.053177+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:37:56.053177+0000","last_undegraded":"2024-04-17T15:37:56.053177+0000","last_fullsized":"2024-04-17T15:37:56.053177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048815+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:37:56.048815+0000","last_peered":"2024-04-17T15:37:56.048815+0000","last_clean":"2024-04-17T15:37:56.048815+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:37:56.048815+0000","last_undegraded":"2024-04-17T15:37:56.048815+0000","last_fullsized":"2024-04-17T15:37:56.048815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051551+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:37:56.051551+0000","last_peered":"2024-04-17T15:37:56.051551+0000","last_clean":"2024-04-17T15:37:56.051551+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:37:56.051551+0000","last_undegraded":"2024-04-17T15:37:56.051551+0000","last_fullsized":"2024-04-17T15:37:56.051551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048723+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:37:56.048723+0000","last_peered":"2024-04-17T15:37:56.048723+0000","last_clean":"2024-04-17T15:37:56.048723+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:37:56.048723+0000","last_undegraded":"2024-04-17T15:37:56.048723+0000","last_fullsized":"2024-04-17T15:37:56.048723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050579+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:37:56.050579+0000","last_peered":"2024-04-17T15:37:56.050579+0000","last_clean":"2024-04-17T15:37:56.050579+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:37:56.050579+0000","last_undegraded":"2024-04-17T15:37:56.050579+0000","last_fullsized":"2024-04-17T15:37:56.050579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048967+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:37:56.048967+0000","last_peered":"2024-04-17T15:37:56.048967+0000","last_clean":"2024-04-17T15:37:56.048967+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:37:56.048967+0000","last_undegraded":"2024-04-17T15:37:56.048967+0000","last_fullsized":"2024-04-17T15:37:56.048967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053569+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:37:56.053569+0000","last_peered":"2024-04-17T15:37:56.053569+0000","last_clean":"2024-04-17T15:37:56.053569+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:37:56.053569+0000","last_undegraded":"2024-04-17T15:37:56.053569+0000","last_fullsized":"2024-04-17T15:37:56.053569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052818+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:37:56.052818+0000","last_peered":"2024-04-17T15:37:56.052818+0000","last_clean":"2024-04-17T15:37:56.052818+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:37:56.052818+0000","last_undegraded":"2024-04-17T15:37:56.052818+0000","last_fullsized":"2024-04-17T15:37:56.052818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048725+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:37:56.048725+0000","last_peered":"2024-04-17T15:37:56.048725+0000","last_clean":"2024-04-17T15:37:56.048725+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:37:56.048725+0000","last_undegraded":"2024-04-17T15:37:56.048725+0000","last_fullsized":"2024-04-17T15:37:56.048725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379926+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:37:55.379926+0000","last_peered":"2024-04-17T15:37:55.379926+0000","last_clean":"2024-04-17T15:37:55.379926+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:37:55.379926+0000","last_undegraded":"2024-04-17T15:37:55.379926+0000","last_fullsized":"2024-04-17T15:37:55.379926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382603+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:37:56.382603+0000","last_peered":"2024-04-17T15:37:56.382603+0000","last_clean":"2024-04-17T15:37:56.382603+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:37:56.382603+0000","last_undegraded":"2024-04-17T15:37:56.382603+0000","last_fullsized":"2024-04-17T15:37:56.382603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383013+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:37:56.383013+0000","last_peered":"2024-04-17T15:37:56.383013+0000","last_clean":"2024-04-17T15:37:56.383013+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:37:56.383013+0000","last_undegraded":"2024-04-17T15:37:56.383013+0000","last_fullsized":"2024-04-17T15:37:56.383013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383670+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:37:56.383670+0000","last_peered":"2024-04-17T15:37:56.383670+0000","last_clean":"2024-04-17T15:37:56.383670+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:37:56.383670+0000","last_undegraded":"2024-04-17T15:37:56.383670+0000","last_fullsized":"2024-04-17T15:37:56.383670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":69,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047956+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:37:56.047956+0000","last_peered":"2024-04-17T15:37:56.047956+0000","last_clean":"2024-04-17T15:37:56.047956+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:37:56.047956+0000","last_undegraded":"2024-04-17T15:37:56.047956+0000","last_fullsized":"2024-04-17T15:37:56.047956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":77,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.385798+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:37:56.385798+0000","last_peered":"2024-04-17T15:37:56.385798+0000","last_clean":"2024-04-17T15:37:56.385798+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:37:56.385798+0000","last_undegraded":"2024-04-17T15:37:56.385798+0000","last_fullsized":"2024-04-17T15:37:56.385798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048313+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:37:56.048313+0000","last_peered":"2024-04-17T15:37:56.048313+0000","last_clean":"2024-04-17T15:37:56.048313+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:37:56.048313+0000","last_undegraded":"2024-04-17T15:37:56.048313+0000","last_fullsized":"2024-04-17T15:37:56.048313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050038+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:37:56.050038+0000","last_peered":"2024-04-17T15:37:56.050038+0000","last_clean":"2024-04-17T15:37:56.050038+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:37:56.050038+0000","last_undegraded":"2024-04-17T15:37:56.050038+0000","last_fullsized":"2024-04-17T15:37:56.050038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048193+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:37:56.048193+0000","last_peered":"2024-04-17T15:37:56.048193+0000","last_clean":"2024-04-17T15:37:56.048193+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:37:56.048193+0000","last_undegraded":"2024-04-17T15:37:56.048193+0000","last_fullsized":"2024-04-17T15:37:56.048193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050881+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:37:56.050881+0000","last_peered":"2024-04-17T15:37:56.050881+0000","last_clean":"2024-04-17T15:37:56.050881+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:37:56.050881+0000","last_undegraded":"2024-04-17T15:37:56.050881+0000","last_fullsized":"2024-04-17T15:37:56.050881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381105+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:37:55.381105+0000","last_peered":"2024-04-17T15:37:55.381105+0000","last_clean":"2024-04-17T15:37:55.381105+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:37:55.381105+0000","last_undegraded":"2024-04-17T15:37:55.381105+0000","last_fullsized":"2024-04-17T15:37:55.381105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048478+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:37:56.048478+0000","last_peered":"2024-04-17T15:37:56.048478+0000","last_clean":"2024-04-17T15:37:56.048478+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:37:56.048478+0000","last_undegraded":"2024-04-17T15:37:56.048478+0000","last_fullsized":"2024-04-17T15:37:56.048478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049425+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:37:56.049425+0000","last_peered":"2024-04-17T15:37:56.049425+0000","last_clean":"2024-04-17T15:37:56.049425+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:37:56.049425+0000","last_undegraded":"2024-04-17T15:37:56.049425+0000","last_fullsized":"2024-04-17T15:37:56.049425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050310+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:37:56.050310+0000","last_peered":"2024-04-17T15:37:56.050310+0000","last_clean":"2024-04-17T15:37:56.050310+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:37:56.050310+0000","last_undegraded":"2024-04-17T15:37:56.050310+0000","last_fullsized":"2024-04-17T15:37:56.050310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385607+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:37:55.385607+0000","last_peered":"2024-04-17T15:37:55.385607+0000","last_clean":"2024-04-17T15:37:55.385607+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:37:55.385607+0000","last_undegraded":"2024-04-17T15:37:55.385607+0000","last_fullsized":"2024-04-17T15:37:55.385607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379908+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:37:55.379908+0000","last_peered":"2024-04-17T15:37:55.379908+0000","last_clean":"2024-04-17T15:37:55.379908+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:37:55.379908+0000","last_undegraded":"2024-04-17T15:37:55.379908+0000","last_fullsized":"2024-04-17T15:37:55.379908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385063+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:37:55.385063+0000","last_peered":"2024-04-17T15:37:55.385063+0000","last_clean":"2024-04-17T15:37:55.385063+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:37:55.385063+0000","last_undegraded":"2024-04-17T15:37:55.385063+0000","last_fullsized":"2024-04-17T15:37:55.385063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838811+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:37:55.838811+0000","last_peered":"2024-04-17T15:37:55.838811+0000","last_clean":"2024-04-17T15:37:55.838811+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:37:55.838811+0000","last_undegraded":"2024-04-17T15:37:55.838811+0000","last_fullsized":"2024-04-17T15:37:55.838811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053245+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:37:56.053245+0000","last_peered":"2024-04-17T15:37:56.053245+0000","last_clean":"2024-04-17T15:37:56.053245+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:37:56.053245+0000","last_undegraded":"2024-04-17T15:37:56.053245+0000","last_fullsized":"2024-04-17T15:37:56.053245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052490+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:37:56.052490+0000","last_peered":"2024-04-17T15:37:56.052490+0000","last_clean":"2024-04-17T15:37:56.052490+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:37:56.052490+0000","last_undegraded":"2024-04-17T15:37:56.052490+0000","last_fullsized":"2024-04-17T15:37:56.052490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.384870+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:37:55.384870+0000","last_peered":"2024-04-17T15:37:55.384870+0000","last_clean":"2024-04-17T15:37:55.384870+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:37:55.384870+0000","last_undegraded":"2024-04-17T15:37:55.384870+0000","last_fullsized":"2024-04-17T15:37:55.384870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050725+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:37:56.050725+0000","last_peered":"2024-04-17T15:37:56.050725+0000","last_clean":"2024-04-17T15:37:56.050725+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:37:56.050725+0000","last_undegraded":"2024-04-17T15:37:56.050725+0000","last_fullsized":"2024-04-17T15:37:56.050725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.385006+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:37:56.385006+0000","last_peered":"2024-04-17T15:37:56.385006+0000","last_clean":"2024-04-17T15:37:56.385006+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:37:56.385006+0000","last_undegraded":"2024-04-17T15:37:56.385006+0000","last_fullsized":"2024-04-17T15:37:56.385006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839080+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:37:55.839080+0000","last_peered":"2024-04-17T15:37:55.839080+0000","last_clean":"2024-04-17T15:37:55.839080+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:37:55.839080+0000","last_undegraded":"2024-04-17T15:37:55.839080+0000","last_fullsized":"2024-04-17T15:37:55.839080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049131+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:37:56.049131+0000","last_peered":"2024-04-17T15:37:56.049131+0000","last_clean":"2024-04-17T15:37:56.049131+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:37:56.049131+0000","last_undegraded":"2024-04-17T15:37:56.049131+0000","last_fullsized":"2024-04-17T15:37:56.049131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.385422+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:37:55.385422+0000","last_peered":"2024-04-17T15:37:55.385422+0000","last_clean":"2024-04-17T15:37:55.385422+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:37:55.385422+0000","last_undegraded":"2024-04-17T15:37:55.385422+0000","last_fullsized":"2024-04-17T15:37:55.385422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.382630+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:37:56.382630+0000","last_peered":"2024-04-17T15:37:56.382630+0000","last_clean":"2024-04-17T15:37:56.382630+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:37:56.382630+0000","last_undegraded":"2024-04-17T15:37:56.382630+0000","last_fullsized":"2024-04-17T15:37:56.382630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.382080+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:37:55.382080+0000","last_peered":"2024-04-17T15:37:55.382080+0000","last_clean":"2024-04-17T15:37:55.382080+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:37:55.382080+0000","last_undegraded":"2024-04-17T15:37:55.382080+0000","last_fullsized":"2024-04-17T15:37:55.382080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.379770+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:37:55.379770+0000","last_peered":"2024-04-17T15:37:55.379770+0000","last_clean":"2024-04-17T15:37:55.379770+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:37:55.379770+0000","last_undegraded":"2024-04-17T15:37:55.379770+0000","last_fullsized":"2024-04-17T15:37:55.379770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.384319+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:37:56.384319+0000","last_peered":"2024-04-17T15:37:56.384319+0000","last_clean":"2024-04-17T15:37:56.384319+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:37:56.384319+0000","last_undegraded":"2024-04-17T15:37:56.384319+0000","last_fullsized":"2024-04-17T15:37:56.384319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050897+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:37:56.050897+0000","last_peered":"2024-04-17T15:37:56.050897+0000","last_clean":"2024-04-17T15:37:56.050897+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:37:56.050897+0000","last_undegraded":"2024-04-17T15:37:56.050897+0000","last_fullsized":"2024-04-17T15:37:56.050897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049164+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:37:56.049164+0000","last_peered":"2024-04-17T15:37:56.049164+0000","last_clean":"2024-04-17T15:37:56.049164+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:37:56.049164+0000","last_undegraded":"2024-04-17T15:37:56.049164+0000","last_fullsized":"2024-04-17T15:37:56.049164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051335+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:37:56.051335+0000","last_peered":"2024-04-17T15:37:56.051335+0000","last_clean":"2024-04-17T15:37:56.051335+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:37:56.051335+0000","last_undegraded":"2024-04-17T15:37:56.051335+0000","last_fullsized":"2024-04-17T15:37:56.051335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.383105+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:37:56.383105+0000","last_peered":"2024-04-17T15:37:56.383105+0000","last_clean":"2024-04-17T15:37:56.383105+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:37:56.383105+0000","last_undegraded":"2024-04-17T15:37:56.383105+0000","last_fullsized":"2024-04-17T15:37:56.383105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839199+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:37:55.839199+0000","last_peered":"2024-04-17T15:37:55.839199+0000","last_clean":"2024-04-17T15:37:55.839199+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:37:55.839199+0000","last_undegraded":"2024-04-17T15:37:55.839199+0000","last_fullsized":"2024-04-17T15:37:55.839199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.052356+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:37:56.052356+0000","last_peered":"2024-04-17T15:37:56.052356+0000","last_clean":"2024-04-17T15:37:56.052356+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:37:56.052356+0000","last_undegraded":"2024-04-17T15:37:56.052356+0000","last_fullsized":"2024-04-17T15:37:56.052356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049927+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:37:56.049927+0000","last_peered":"2024-04-17T15:37:56.049927+0000","last_clean":"2024-04-17T15:37:56.049927+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:37:56.049927+0000","last_undegraded":"2024-04-17T15:37:56.049927+0000","last_fullsized":"2024-04-17T15:37:56.049927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.051251+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:37:56.051251+0000","last_peered":"2024-04-17T15:37:56.051251+0000","last_clean":"2024-04-17T15:37:56.051251+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:37:56.051251+0000","last_undegraded":"2024-04-17T15:37:56.051251+0000","last_fullsized":"2024-04-17T15:37:56.051251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.048883+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:37:56.048883+0000","last_peered":"2024-04-17T15:37:56.048883+0000","last_clean":"2024-04-17T15:37:56.048883+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:37:56.048883+0000","last_undegraded":"2024-04-17T15:37:56.048883+0000","last_fullsized":"2024-04-17T15:37:56.048883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381351+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:37:55.381351+0000","last_peered":"2024-04-17T15:37:55.381351+0000","last_clean":"2024-04-17T15:37:55.381351+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:37:55.381351+0000","last_undegraded":"2024-04-17T15:37:55.381351+0000","last_fullsized":"2024-04-17T15:37:55.381351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049419+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:37:56.049419+0000","last_peered":"2024-04-17T15:37:56.049419+0000","last_clean":"2024-04-17T15:37:56.049419+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:37:56.049419+0000","last_undegraded":"2024-04-17T15:37:56.049419+0000","last_fullsized":"2024-04-17T15:37:56.049419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050820+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:37:56.050820+0000","last_peered":"2024-04-17T15:37:56.050820+0000","last_clean":"2024-04-17T15:37:56.050820+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:37:56.050820+0000","last_undegraded":"2024-04-17T15:37:56.050820+0000","last_fullsized":"2024-04-17T15:37:56.050820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.838734+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:37:55.838734+0000","last_peered":"2024-04-17T15:37:55.838734+0000","last_clean":"2024-04-17T15:37:55.838734+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:37:55.838734+0000","last_undegraded":"2024-04-17T15:37:55.838734+0000","last_fullsized":"2024-04-17T15:37:55.838734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839500+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:37:55.839500+0000","last_peered":"2024-04-17T15:37:55.839500+0000","last_clean":"2024-04-17T15:37:55.839500+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:37:55.839500+0000","last_undegraded":"2024-04-17T15:37:55.839500+0000","last_fullsized":"2024-04-17T15:37:55.839500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.047945+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:37:56.047945+0000","last_peered":"2024-04-17T15:37:56.047945+0000","last_clean":"2024-04-17T15:37:56.047945+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:37:56.047945+0000","last_undegraded":"2024-04-17T15:37:56.047945+0000","last_fullsized":"2024-04-17T15:37:56.047945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.839283+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:37:55.839283+0000","last_peered":"2024-04-17T15:37:55.839283+0000","last_clean":"2024-04-17T15:37:55.839283+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:37:55.839283+0000","last_undegraded":"2024-04-17T15:37:55.839283+0000","last_fullsized":"2024-04-17T15:37:55.839283+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.049038+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:37:56.049038+0000","last_peered":"2024-04-17T15:37:56.049038+0000","last_clean":"2024-04-17T15:37:56.049038+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:37:56.049038+0000","last_undegraded":"2024-04-17T15:37:56.049038+0000","last_fullsized":"2024-04-17T15:37:56.049038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.050684+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:37:56.050684+0000","last_peered":"2024-04-17T15:37:56.050684+0000","last_clean":"2024-04-17T15:37:56.050684+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:37:56.050684+0000","last_undegraded":"2024-04-17T15:37:56.050684+0000","last_fullsized":"2024-04-17T15:37:56.050684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:55.381586+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:37:55.381586+0000","last_peered":"2024-04-17T15:37:55.381586+0000","last_clean":"2024-04-17T15:37:55.381586+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:37:55.381586+0000","last_undegraded":"2024-04-17T15:37:55.381586+0000","last_fullsized":"2024-04-17T15:37:55.381586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-17T15:37:56.053565+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:37:56.053565+0000","last_peered":"2024-04-17T15:37:56.053565+0000","last_clean":"2024-04-17T15:37:56.053565+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:37:56.053565+0000","last_undegraded":"2024-04-17T15:37:56.053565+0000","last_fullsized":"2024-04-17T15:37:56.053565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1241088,"data_stored":907802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":316774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":318038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":324120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":655360,"data_stored":326011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":316336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":325308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1236992,"data_stored":916049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:38:01.209 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-17T15:38:01.209 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-17T15:38:01.231 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:01.230+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:01.315 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:01.315 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:01.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:01.329 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:01.329+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:01.429 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:01.429+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:01.430 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:38:01.495 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:01.495 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:01.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:01.555 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:01.554+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:01.631 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:01.629+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:01.635 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:01.635 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:01.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:01.732 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:01.733+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:01.823 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:01.823 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:01.834 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:01.833+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:01.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:01.934 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:01.930+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:01.978 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:01.979 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:01.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:02.036 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:02.034+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:02.116 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:02.116 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:02.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:02.177 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:02.177+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:02.237 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:02.237+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:02.263 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:02.263 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:02.278 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:02.339 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:02.334+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:02.439 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:02.437+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:02.462 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:02.462 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:02.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:02.565 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:02.565+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:02.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:02.642 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:02.642 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:02.642 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:02.641+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:02.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:02.748 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:02.749+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:02.796 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:02.796 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:02.814 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:02.814 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:02.827 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:02.827 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 64.558009777999999, 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030313720000000001, 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.828 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 38 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269543+0000", 2024-04-17T15:38:02.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269545+0000", 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2670000000000001e-06 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269558+0000", 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3053e-05 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269589+0000", 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1276999999999999e-05 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269605+0000", 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6076e-05 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269741+0000", 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135131 2024-04-17T15:38:02.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.269958+0000", 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021726100000000001 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.270212+0000", 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000253918 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.832 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.271337+0000", 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011256980000000001 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272406+0000", 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001068575 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272504+0000", 2024-04-17T15:38:02.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7790999999999999e-05 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.272574+0000", 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0325000000000002e-05 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.545324043000001, 2024-04-17T15:38:02.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:02.839 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.538706396999999, 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:02.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.538368757999997, 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.844 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:60 7.9 e27/26 7:93e5b521:::notify.7:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:02.848 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.52028627, 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003055341, 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307266+0000", 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307268+0000", 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.463e-06 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307278+0000", 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307326+0000", 2024-04-17T15:38:02.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8736999999999998e-05 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307347+0000", 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1053999999999999e-05 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307468+0000", 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120353 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307504+0000", 2024-04-17T15:38:02.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6426e-05 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310218+0000", 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027133840000000001 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310322+0000", 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010407 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.852 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.422303806999999, 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033104499999999999, 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 193 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405249+0000", 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405251+0000", 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405263+0000", 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1673e-05 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405294+0000", 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1537e-05 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405311+0000", 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6478999999999999e-05 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.855 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405428+0000", 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011737 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405628+0000", 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019951800000000001 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.405892+0000", 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026415500000000002 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.407420+0000", 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015283129999999999 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408374+0000", 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0009544 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408478+0000", 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010396200000000001 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.408559+0000", 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0820000000000002e-05 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.538953677999999, 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:38:02.858 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:38:02.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:38:02.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:38:02.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.522483264999998, 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033682500000000002, 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 212 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305069+0000", 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305072+0000", 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305083+0000", 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1517e-05 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305112+0000", 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8486000000000001e-05 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305126+0000", 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4487e-05 2024-04-17T15:38:02.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305251+0000", 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124599 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305451+0000", 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020034499999999999 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.305839+0000", 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038760800000000001 2024-04-17T15:38:02.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.307390+0000", 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015517459999999999 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308276+0000", 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088547699999999997 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308364+0000", 2024-04-17T15:38:02.868 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8619e-05 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.308438+0000", 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3133000000000006e-05 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.496257599000003, 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033421330000000002, 2024-04-17T15:38:02.869 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 219 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331295+0000", 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331298+0000", 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4589999999999998e-06 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331311+0000", 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2257e-05 2024-04-17T15:38:02.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331343+0000", 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2156000000000002e-05 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331358+0000", 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5252999999999999e-05 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331474+0000", 2024-04-17T15:38:02.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011544600000000001 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331700+0000", 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000226102 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.332161+0000", 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046111699999999998 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.333471+0000", 2024-04-17T15:38:02.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001310741 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334479+0000", 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010074629999999999 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334565+0000", 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6093000000000004e-05 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.334637+0000", 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2045999999999994e-05 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.477910881, 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032014919999999998, 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.875 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 224 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349642+0000", 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349644+0000", 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349655+0000", 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0764000000000001e-05 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349687+0000", 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2085999999999997e-05 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.877 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349702+0000", 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.349889+0000", 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698599999999999 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350092+0000", 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020369100000000001 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.878 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.350514+0000", 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042112699999999998 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.351874+0000", 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013607910000000001 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352690+0000", 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081600800000000001 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.879 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352776+0000", 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6119000000000007e-05 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.352843+0000", 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.669e-05 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:318 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.880 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.415635205000001, 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031343450000000002, 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 318 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411917+0000", 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411918+0000", 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0869999999999999e-06 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411938+0000", 2024-04-17T15:38:02.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9788000000000001e-05 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411952+0000", 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4066000000000001e-05 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.411963+0000", 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0920999999999999e-05 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.883 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412006+0000", 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2661999999999999e-05 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412087+0000", 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.072e-05 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.412286+0000", 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019964900000000001 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.884 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.413018+0000", 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000732199 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.414968+0000", 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00194908 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415019+0000", 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1039999999999999e-05 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.885 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.415052+0000", 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3133000000000003e-05 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:386 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.400399614000001, 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003049118, 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.886 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 386 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427153+0000", 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427154+0000", 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9800000000000002e-07 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427159+0000", 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3000000000000001e-06 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427171+0000", 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2079000000000001e-05 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427177+0000", 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8649999999999998e-06 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427229+0000", 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2132999999999997e-05 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427333+0000", 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010389499999999999 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.427500+0000", 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016634899999999999 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.428068+0000", 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000568115 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430137+0000", 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020691070000000002 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430172+0000", 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5556000000000003e-05 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.430202+0000", 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9720999999999999e-05 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.891 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.282438372000001, 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.892 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.897 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.263251347000001, 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.898 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:38:02.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:38:02.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:38:02.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:680 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.182351816999997, 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031880879999999999, 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 680 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645201+0000", 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645203+0000", 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.514e-06 2024-04-17T15:38:02.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645216+0000", 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3103e-05 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645252+0000", 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5549000000000001e-05 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645277+0000", 2024-04-17T15:38:02.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4827000000000001e-05 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645447+0000", 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170347 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.645826+0000", 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037859999999999999 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.646397+0000", 2024-04-17T15:38:02.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057096999999999996 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.647773+0000", 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013760490000000001 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648242+0000", 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046900300000000001 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648326+0000", 2024-04-17T15:38:02.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4320000000000006e-05 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.648389+0000", 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2805999999999995e-05 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.081146111000002, 2024-04-17T15:38:02.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032633940000000002, 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 733 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746406+0000", 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746409+0000", 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.96e-06 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746425+0000", 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5296000000000001e-05 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746458+0000", 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2913000000000001e-05 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746473+0000", 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5147000000000001e-05 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746625+0000", 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015230199999999999 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.746850+0000", 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022539899999999999 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.747194+0000", 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034325399999999998 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.748282+0000", 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010885789999999999 2024-04-17T15:38:02.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749525+0000", 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001242251 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749604+0000", 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9110000000000007e-05 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.749670+0000", 2024-04-17T15:38:02.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6183e-05 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.037505936999999, 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035370559999999998, 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.915 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 751 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790047+0000", 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790049+0000", 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1670000000000002e-06 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790060+0000", 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1446e-05 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790089+0000", 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8517000000000002e-05 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790103+0000", 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4103e-05 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790256+0000", 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152886 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.790624+0000", 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000367804 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.791205+0000", 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058173199999999995 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.792657+0000", 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014521429999999999 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793312+0000", 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00065417600000000002 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793469+0000", 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000157503 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.793584+0000", 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114579 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.920 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.032773405999997, 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032316369999999999, 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 753 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:38:02.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794779+0000", 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794781+0000", 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2359999999999999e-06 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794793+0000", 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.154e-05 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794825+0000", 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2236000000000001e-05 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794840+0000", 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5316999999999999e-05 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.794966+0000", 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012540899999999999 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795214+0000", 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024765900000000001 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.795682+0000", 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00046803600000000002 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.796961+0000", 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012796909999999999 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797850+0000", 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088859699999999998 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.797941+0000", 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0836999999999998e-05 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.798011+0000", 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0079000000000004e-05 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.926796050999997, 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029866200000000002, 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.926 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 796 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900757+0000", 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900759+0000", 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.193e-06 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900772+0000", 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3016999999999999e-05 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900803+0000", 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1279999999999999e-05 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900818+0000", 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4620000000000001e-05 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.900943+0000", 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012558900000000001 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901172+0000", 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022883199999999999 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.901518+0000", 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034601100000000002 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.902651+0000", 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011331620000000001 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903590+0000", 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000938487 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903677+0000", 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7035999999999998e-05 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.903743+0000", 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6392999999999999e-05 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.608734427000002, 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029942160000000001, 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 931 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:02.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218818+0000", 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218821+0000", 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.807e-06 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218835+0000", 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4523e-05 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218869+0000", 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3766000000000002e-05 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.218895+0000", 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5993999999999999e-05 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219037+0000", 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014219499999999999 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219265+0000", 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022758899999999999 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.219640+0000", 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037543100000000002 2024-04-17T15:38:02.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.220951+0000", 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013106509999999999 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221627+0000", 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00067609099999999997 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221713+0000", 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5470000000000007e-05 2024-04-17T15:38:02.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.221812+0000", 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9698999999999995e-05 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:02.937 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:02.938 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:02.938 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:02.939 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:02.940 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:02.940 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:02.940 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:02.941 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:02.941 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:02.941 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:02.941 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:02.942 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:02.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:02.942 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:02.942 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:02.937+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:03.039 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:03.038+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:03.134 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:03.135 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:03.135 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:03.135 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:03.140 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:03.138+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:03.149 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:03.241 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:03.238+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:03.272 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:03.272 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:03.273 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:03.273 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:03.273 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:03.287 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:03.342 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:03.341+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:03.407 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.127436430000003, 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030098299999999998, 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:38:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 42 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280322+0000", 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6360000000000001e-06 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280344+0000", 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1710000000000001e-05 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280367+0000", 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2646e-05 2024-04-17T15:38:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280380+0000", 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3574000000000001e-05 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280494+0000", 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114288 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280703+0000", 2024-04-17T15:38:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000208805 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280947+0000", 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024378799999999999 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.282418+0000", 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014711030000000001 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283224+0000", 2024-04-17T15:38:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00080576599999999997 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283286+0000", 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1921999999999994e-05 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283330+0000", 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4592000000000003e-05 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.113082284000001, 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003461703, 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 52 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294678+0000", 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.92e-06 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294691+0000", 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3244999999999999e-05 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294739+0000", 2024-04-17T15:38:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7778999999999998e-05 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294753+0000", 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4297999999999999e-05 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294857+0000", 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104107 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295108+0000", 2024-04-17T15:38:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025097299999999998 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295309+0000", 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020123600000000001 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297594+0000", 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002284379 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297987+0000", 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039364100000000002 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298068+0000", 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1001999999999995e-05 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298136+0000", 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8122999999999998e-05 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:57 7.3 e27/26 7:c609908c:::notify.5:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.103000430000002, 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003535472, 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304759+0000", 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304773+0000", 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.396e-05 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304796+0000", 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3961999999999999e-05 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304813+0000", 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6086000000000002e-05 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304947+0000", 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013435899999999999 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304991+0000", 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4221000000000002e-05 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308226+0000", 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032346190000000002 2024-04-17T15:38:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308292+0000", 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6282e-05 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:59 7.14 e27/26 7:2b04a3e9:::notify.6:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.100534674000002, 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033715469999999999, 2024-04-17T15:38:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307224+0000", 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6169999999999999e-06 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307235+0000", 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1408e-05 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307269+0000", 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3442999999999998e-05 2024-04-17T15:38:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307290+0000", 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1353999999999999e-05 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307413+0000", 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000122865 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307452+0000", 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9387000000000001e-05 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310518+0000", 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030657919999999999 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310594+0000", 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5680999999999996e-05 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.014739323999997, 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034483930000000001, 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 236 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393020+0000", 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7669999999999999e-06 2024-04-17T15:38:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393034+0000", 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3073e-05 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393065+0000", 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1860000000000003e-05 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393082+0000", 2024-04-17T15:38:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6855999999999999e-05 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393221+0000", 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013827300000000001 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393434+0000", 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021370199999999999 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393850+0000", 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041539700000000002 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.395194+0000", 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001344121 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396313+0000", 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011190180000000001 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396398+0000", 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5393e-05 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396466+0000", 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7933000000000002e-05 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.001700872000001, 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002805929, 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 280 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406057+0000", 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.203e-06 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406063+0000", 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9610000000000002e-06 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406075+0000", 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1714e-05 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406082+0000", 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5220000000000004e-06 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406136+0000", 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4211e-05 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406231+0000", 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4871999999999996e-05 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406377+0000", 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146448 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.407079+0000", 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000701639 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408771+0000", 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001692432 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408820+0000", 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9289999999999997e-05 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408862+0000", 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1637000000000001e-05 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:697 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.748278554999999, 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002810561, 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 697 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659480+0000", 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4759999999999999e-06 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659488+0000", 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1710000000000002e-06 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659509+0000", 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0718000000000001e-05 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659525+0000", 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5894999999999999e-05 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659651+0000", 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012638300000000001 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659781+0000", 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013031300000000001 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.660036+0000", 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025453599999999998 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.661296+0000", 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001260331 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662138+0000", 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084126399999999999 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662208+0000", 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0188e-05 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662289+0000", 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.639950462999998, 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029789930000000001, 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 742 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767809+0000", 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7329999999999999e-06 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767822+0000", 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2663999999999999e-05 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767854+0000", 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1875999999999998e-05 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767869+0000", 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768001+0000", 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013243900000000001 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768229+0000", 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022790500000000001 2024-04-17T15:38:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768575+0000", 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034550800000000001 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.769817+0000", 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012425019999999999 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770633+0000", 2024-04-17T15:38:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081610700000000005 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770720+0000", 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6682999999999997e-05 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770786+0000", 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5525999999999996e-05 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.594537506999998, 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029893189999999998, 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 760 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813222+0000", 2024-04-17T15:38:03.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-06 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813233+0000", 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1703e-05 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813266+0000", 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2772999999999999e-05 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813289+0000", 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2337e-05 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813434+0000", 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014584400000000001 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813598+0000", 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000163752 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813883+0000", 2024-04-17T15:38:03.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000285087 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.815043+0000", 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011595819999999999 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816059+0000", 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010158459999999999 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816148+0000", 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9553000000000001e-05 2024-04-17T15:38:03.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816209+0000", 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0585999999999999e-05 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.590580078000002, 2024-04-17T15:38:03.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030744029999999999, 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 762 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817179+0000", 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-06 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817190+0000", 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1090000000000001e-05 2024-04-17T15:38:03.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817225+0000", 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5129999999999997e-05 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817244+0000", 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9029999999999999e-05 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817379+0000", 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000134475 2024-04-17T15:38:03.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817606+0000", 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022773199999999999 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.818089+0000", 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048282400000000002 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.819375+0000", 2024-04-17T15:38:03.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012861680000000001 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820098+0000", 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000722841 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820184+0000", 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5500000000000005e-05 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820251+0000", 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7613000000000005e-05 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.458511305999998, 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029764269999999998, 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.463 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 817 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949248+0000", 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4099999999999998e-06 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949264+0000", 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6364000000000001e-05 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949296+0000", 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1513000000000001e-05 2024-04-17T15:38:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949317+0000", 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1403000000000002e-05 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949509+0000", 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019130500000000001 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949747+0000", 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000238039 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.950063+0000", 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031621399999999999 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.951228+0000", 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001165379 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952068+0000", 2024-04-17T15:38:03.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000839674 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952156+0000", 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8313000000000006e-05 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952222+0000", 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5813000000000002e-05 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.454574645999998, 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029501589999999999, 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 819 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.469 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953184+0000", 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.973e-06 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953198+0000", 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3657e-05 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953229+0000", 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1486000000000003e-05 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953248+0000", 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187000000000001e-05 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953356+0000", 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107909 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953484+0000", 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012820600000000001 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953773+0000", 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028948800000000002 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.954862+0000", 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001088365 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.955975+0000", 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001113326 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956061+0000", 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6470000000000004e-05 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956133+0000", 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1092000000000003e-05 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.403220494999999, 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029884, 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 841 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.475 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004539+0000", 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2630000000000002e-06 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004551+0000", 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2680000000000001e-05 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004582+0000", 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0700000000000001e-05 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004597+0000", 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.501e-05 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004732+0000", 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013490900000000001 2024-04-17T15:38:03.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004956+0000", 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022391800000000001 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.005298+0000", 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034173100000000001 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.006602+0000", 2024-04-17T15:38:03.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013043810000000001 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007387+0000", 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000784635 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007467+0000", 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0661999999999994e-05 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007525+0000", 2024-04-17T15:38:03.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7510999999999999e-05 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.388298352, 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031389679999999998, 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.480 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 847 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019461+0000", 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.277e-06 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019472+0000", 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1319e-05 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019503+0000", 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0626999999999997e-05 2024-04-17T15:38:03.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019517+0000", 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019652+0000", 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013442799999999999 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019977+0000", 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032536300000000001 2024-04-17T15:38:03.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.020521+0000", 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00054383700000000003 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.021843+0000", 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001321593 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022433+0000", 2024-04-17T15:38:03.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058991600000000001 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022517+0000", 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4845999999999994e-05 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022598+0000", 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0185999999999994e-05 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.339339311000003, 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034503820000000001, 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 868 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068420+0000", 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1330000000000002e-06 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068432+0000", 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2646000000000001e-05 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068463+0000", 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0170000000000001e-05 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068477+0000", 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4797000000000001e-05 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068645+0000", 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016787200000000001 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068999+0000", 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035414099999999998 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.069565+0000", 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056531599999999995 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.070818+0000", 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001252932 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071707+0000", 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088886 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071793+0000", 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6885999999999994e-05 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071868+0000", 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4629000000000007e-05 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:03.493 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.246692928999998, 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030204519999999999, 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 907 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161067+0000", 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4329999999999998e-06 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161077+0000", 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0910000000000001e-05 2024-04-17T15:38:03.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161109+0000", 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1288999999999998e-05 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161123+0000", 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4739999999999999e-05 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161242+0000", 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011889 2024-04-17T15:38:03.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161468+0000", 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022609099999999999 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161805+0000", 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612099999999999 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.162878+0000", 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001073606 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.163928+0000", 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00104958 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164017+0000", 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9284999999999996e-05 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164085+0000", 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7507000000000003e-05 2024-04-17T15:38:03.498 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.145916483999997, 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003409006, 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.499 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 949 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261844+0000", 2024-04-17T15:38:03.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.993e-06 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261857+0000", 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261902+0000", 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5286e-05 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261926+0000", 2024-04-17T15:38:03.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3757e-05 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262112+0000", 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018562900000000001 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262494+0000", 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038215999999999999 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262901+0000", 2024-04-17T15:38:03.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040692000000000001 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.264939+0000", 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020382400000000002 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265106+0000", 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016660500000000001 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265187+0000", 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265250+0000", 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2063000000000005e-05 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.141616990999999, 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032687240000000002, 2024-04-17T15:38:03.504 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 951 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266142+0000", 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6640000000000001e-06 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266151+0000", 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5829999999999996e-06 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266177+0000", 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.55e-05 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266189+0000", 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2139e-05 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266301+0000", 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011170700000000001 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266418+0000", 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117599 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266690+0000", 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027164099999999998 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.268256+0000", 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001565842 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269168+0000", 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00091194099999999999 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269297+0000", 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012897900000000001 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269409+0000", 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112129 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.509 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.130813316000001, 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030567260000000001, 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 955 2024-04-17T15:38:03.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276946+0000", 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6139999999999999e-06 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276959+0000", 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.279e-05 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276992+0000", 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2981999999999997e-05 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277008+0000", 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6127e-05 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277162+0000", 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015356199999999999 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277427+0000", 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026516799999999998 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277784+0000", 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035701500000000002 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279283+0000", 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499479 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279849+0000", 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056583000000000002 2024-04-17T15:38:03.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279935+0000", 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5649000000000006e-05 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280000+0000", 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5510000000000001e-05 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:03.515 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.126834713999997, 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028646269999999998, 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 957 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280924+0000", 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.894e-06 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280934+0000", 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6299999999999993e-06 2024-04-17T15:38:03.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280960+0000", 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280986+0000", 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5913000000000001e-05 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281095+0000", 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109212 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281215+0000", 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120469 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281472+0000", 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025682199999999997 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:03.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.282766+0000", 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001293521 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283642+0000", 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087648000000000001 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283727+0000", 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4874000000000001e-05 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283787+0000", 2024-04-17T15:38:03.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9892000000000002e-05 2024-04-17T15:38:03.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.521 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.521 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.521 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:03.522 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:38:03.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:03.524 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:03.521+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:03.623 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:03.622+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:03.707 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:03.707 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:03.707 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:03.708 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:03.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:03.725 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:03.722+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:03.826 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:03.826+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:03.841 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:03.841 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:03.841 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:03.856 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:03.927 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:03.925+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:03.992 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:03.992 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:03.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 63.737044990000001, 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063603720000000004, 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "reached pg", 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 44 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.993 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253462+0000", 2024-04-17T15:38:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253499+0000", 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7339999999999998e-05 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253536+0000", 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6746999999999999e-05 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253562+0000", 2024-04-17T15:38:03.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6095999999999999e-05 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253940+0000", 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037773800000000002 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for peered", 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253962+0000", 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2566e-05 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259497+0000", 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055350269999999997 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259819+0000", 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000321792 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040977412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:03.997 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.686716758999999, 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049681100000000004, 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 57 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:03.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303788+0000", 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.55e-06 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303797+0000", 2024-04-17T15:38:03.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8820000000000007e-06 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303842+0000", 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4231999999999999e-05 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303856+0000", 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4307e-05 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303983+0000", 2024-04-17T15:38:04.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127577 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304194+0000", 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000210299 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304573+0000", 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037939199999999999 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.305923+0000", 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013502500000000001 2024-04-17T15:38:04.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308569+0000", 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026456159999999999 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308655+0000", 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5539999999999998e-05 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308755+0000", 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010046499999999999 2024-04-17T15:38:04.002 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040977413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.68408934, 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047062060000000001, 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.003 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 59 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306416+0000", 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306424+0000", 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7519999999999996e-06 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306446+0000", 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2155e-05 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306456+0000", 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0523000000000001e-05 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306569+0000", 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112277 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306739+0000", 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170688 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307048+0000", 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030829700000000002 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310444+0000", 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033961629999999998 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310828+0000", 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038433500000000003 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310956+0000", 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127997 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.311121+0000", 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016447900000000001 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.008 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.708098307, 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059605389999999999, 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 207 2024-04-17T15:38:04.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282410+0000", 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3959999999999999e-06 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282431+0000", 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0996999999999999e-05 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282475+0000", 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4703000000000002e-05 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282501+0000", 2024-04-17T15:38:04.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5627e-05 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282659+0000", 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015803900000000001 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282916+0000", 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025698099999999998 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.283628+0000", 2024-04-17T15:38:04.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00071140199999999998 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.286242+0000", 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002614782 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288105+0000", 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862437 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288260+0000", 2024-04-17T15:38:04.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015568900000000001 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288366+0000", 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000105486 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.670093721000001, 2024-04-17T15:38:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033450900000000002, 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 216 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320413+0000", 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.65e-06 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320426+0000", 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2972999999999999e-05 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2326999999999997e-05 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320473+0000", 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4763000000000001e-05 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320604+0000", 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013095899999999999 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320836+0000", 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000232012 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.321267+0000", 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043098000000000002 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.322958+0000", 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016909189999999999 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323607+0000", 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00064901100000000001 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323691+0000", 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4383999999999997e-05 2024-04-17T15:38:04.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323755+0000", 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4111999999999999e-05 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.629861789000003, 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036511180000000001, 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.020 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 227 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:04.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360644+0000", 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360656+0000", 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.217e-05 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360689+0000", 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2778999999999999e-05 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360704+0000", 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5187e-05 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360849+0000", 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144315 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361057+0000", 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020802200000000001 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361490+0000", 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043335100000000001 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.363127+0000", 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001636832 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364063+0000", 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093582599999999995 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364177+0000", 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011425300000000001 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364293+0000", 2024-04-17T15:38:04.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115943 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.621926887999997, 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003177409, 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.026 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 229 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368579+0000", 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2740000000000002e-06 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368591+0000", 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1456e-05 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368623+0000", 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2474000000000001e-05 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368638+0000", 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.502e-05 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368758+0000", 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000119505 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368990+0000", 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023266199999999999 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:04.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.369391+0000", 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040097100000000002 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.370944+0000", 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015525389999999999 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371613+0000", 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00066936899999999995 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371693+0000", 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9886000000000001e-05 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371754+0000", 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1253000000000005e-05 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.614844063, 2024-04-17T15:38:04.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033033200000000002, 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 231 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375662+0000", 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375673+0000", 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1678999999999999e-05 2024-04-17T15:38:04.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375706+0000", 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2293999999999999e-05 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375721+0000", 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.522e-05 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375868+0000", 2024-04-17T15:38:04.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014661200000000001 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376071+0000", 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020339199999999999 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376467+0000", 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039612099999999998 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.377887+0000", 2024-04-17T15:38:04.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001419696 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378819+0000", 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093196000000000001 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378902+0000", 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2977000000000002e-05 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378963+0000", 2024-04-17T15:38:04.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1241999999999994e-05 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:345 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.573288593000001, 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003233755, 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.037 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 345 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417216+0000", 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417223+0000", 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3969999999999999e-06 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417240+0000", 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7711e-05 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417250+0000", 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3789999999999995e-06 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417308+0000", 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8663999999999999e-05 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417398+0000", 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9524000000000005e-05 2024-04-17T15:38:04.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417555+0000", 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015700299999999999 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.418480+0000", 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00092510400000000005 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420343+0000", 2024-04-17T15:38:04.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862596 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420402+0000", 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.944e-05 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420449+0000", 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6832000000000002e-05 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:398 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.556715498000003, 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041188789999999998, 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 398 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433789+0000", 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:38:04.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433794+0000", 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1490000000000002e-06 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433807+0000", 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2334000000000001e-05 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433813+0000", 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1240000000000002e-06 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433875+0000", 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2309000000000003e-05 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433976+0000", 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100577 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434109+0000", 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013374099999999999 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434711+0000", 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060139999999999998 2024-04-17T15:38:04.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437854+0000", 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031429069999999999 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437883+0000", 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9539999999999998e-05 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437907+0000", 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3947999999999998e-05 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:402 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.554815478999998, 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047817750000000003, 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.049 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 402 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435689+0000", 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.850000000000001e-07 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435693+0000", 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435705+0000", 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1484000000000001e-05 2024-04-17T15:38:04.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435713+0000", 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6699999999999994e-06 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435756+0000", 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3519999999999997e-05 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435812+0000", 2024-04-17T15:38:04.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5998000000000002e-05 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435942+0000", 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000129596 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.436441+0000", 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049949700000000001 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440415+0000", 2024-04-17T15:38:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039740690000000002 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440444+0000", 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9156999999999999e-05 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440470+0000", 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5499000000000001e-05 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:522 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.483663104000001, 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031631699999999999, 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 522 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506842+0000", 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1629999999999999e-06 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506847+0000", 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506861+0000", 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3811e-05 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506871+0000", 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5429999999999999e-06 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506925+0000", 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4740000000000001e-05 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507027+0000", 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101766 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507209+0000", 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018180900000000001 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509722+0000", 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025127539999999999 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509938+0000", 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021666099999999999 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509978+0000", 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9987000000000002e-05 2024-04-17T15:38:04.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.510004+0000", 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5316999999999998e-05 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:607 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.409881642999999, 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003551916, 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.060 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 607 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:04.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580623+0000", 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4020000000000001e-06 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580632+0000", 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1459999999999996e-06 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580654+0000", 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2446000000000002e-05 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580665+0000", 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1165000000000001e-05 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580780+0000", 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114973 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580917+0000", 2024-04-17T15:38:04.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013664300000000001 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581189+0000", 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027190100000000001 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582345+0000", 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00115599 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583899+0000", 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015540319999999999 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584059+0000", 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016074500000000001 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584174+0000", 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114473 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.065 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:611 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.403691694000003, 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033528170000000001, 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 611 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586814+0000", 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9860000000000001e-06 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586825+0000", 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0686000000000001e-05 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586853+0000", 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8365e-05 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586866+0000", 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587014+0000", 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014742600000000001 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587227+0000", 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021381800000000001 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587506+0000", 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027870100000000001 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.588524+0000", 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001018157 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.589970+0000", 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014462590000000001 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590061+0000", 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0138999999999999e-05 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590165+0000", 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104168 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.317877017000001, 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034329339999999999, 2024-04-17T15:38:04.071 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 703 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672629+0000", 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0080000000000001e-06 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672638+0000", 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1419999999999999e-06 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672664+0000", 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5905e-05 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672676+0000", 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2337000000000001e-05 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672840+0000", 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016395 2024-04-17T15:38:04.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673166+0000", 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000326275 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673711+0000", 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000545047 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675036+0000", 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013244940000000001 2024-04-17T15:38:04.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675808+0000", 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00077264900000000004 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675951+0000", 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014292499999999999 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.676060+0000", 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010820200000000001 2024-04-17T15:38:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.288703005000002, 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003556245, 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 715 2024-04-17T15:38:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701803+0000", 2024-04-17T15:38:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701818+0000", 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5223e-05 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701849+0000", 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1035999999999999e-05 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701866+0000", 2024-04-17T15:38:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6643999999999999e-05 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702012+0000", 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014634700000000001 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702345+0000", 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033299399999999998 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702866+0000", 2024-04-17T15:38:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052063999999999995 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.704096+0000", 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001229988 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705095+0000", 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00099944500000000006 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705240+0000", 2024-04-17T15:38:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144287 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705357+0000", 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117191 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.133976394000001, 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035344460000000001, 2024-04-17T15:38:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 778 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856530+0000", 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3199999999999998e-06 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856541+0000", 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.183e-05 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856573+0000", 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2060000000000001e-05 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856590+0000", 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6356000000000001e-05 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856741+0000", 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158899999999999 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857099+0000", 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035803499999999998 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857663+0000", 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056350599999999997 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859015+0000", 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013523299999999999 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859910+0000", 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00089519100000000004 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859996+0000", 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5673000000000005e-05 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.860062+0000", 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5555999999999994e-05 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.020168621000003, 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032371169999999999, 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 826 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970337+0000", 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970349+0000", 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1440000000000001e-05 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970381+0000", 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1896000000000001e-05 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970395+0000", 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4867e-05 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970554+0000", 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015837199999999999 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970926+0000", 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037184099999999998 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.971531+0000", 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060493600000000004 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.972848+0000", 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013169340000000001 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973421+0000", 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057373600000000004 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973506+0000", 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4285999999999999e-05 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973572+0000", 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6586000000000002e-05 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.929160498000002, 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003083728, 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 865 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061345+0000", 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061356+0000", 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0823e-05 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061387+0000", 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0766999999999999e-05 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061402+0000", 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5379999999999998e-05 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061519+0000", 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117265 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061739+0000", 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000219106 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.062054+0000", 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031500400000000002 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.063247+0000", 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011935979999999999 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064266+0000", 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001019023 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064359+0000", 2024-04-17T15:38:04.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3040000000000004e-05 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064427+0000", 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7665999999999999e-05 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 57.758119303999997, 2024-04-17T15:38:04.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031575179999999998, 2024-04-17T15:38:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 937 2024-04-17T15:38:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232386+0000", 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232398+0000", 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1864e-05 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232426+0000", 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232440+0000", 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.412e-05 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232621+0000", 2024-04-17T15:38:04.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018099899999999999 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232854+0000", 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023273400000000001 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.233176+0000", 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032190499999999999 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.234217+0000", 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001040673 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235396+0000", 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001179835 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235480+0000", 2024-04-17T15:38:04.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3473000000000005e-05 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235542+0000", 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2042e-05 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:04.106 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:04.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:04.111 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:04.106+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:04.212 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:04.209+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:04.245 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:04.245 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:04.245 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:04.245 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:04.260 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:04.313 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:04.313+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:04.382 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:04.383 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:04.383 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:04.383 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:04.383 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:04.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:04.443 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:04.442+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:04.473 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:38:04.515 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:04.514+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:04.523 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:46 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.247919265, 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006071562, 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273829+0000", 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.984e-06 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273845+0000", 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.541e-05 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273886+0000", 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1556e-05 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273920+0000", 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3668999999999999e-05 2024-04-17T15:38:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274134+0000", 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000213952 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274182+0000", 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7706e-05 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279811+0000", 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056294029999999998 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279899+0000", 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7881999999999996e-05 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:47 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.238646006000003, 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048203359999999997, 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283103+0000", 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283119+0000", 2024-04-17T15:38:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6509000000000001e-05 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283153+0000", 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4037e-05 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283175+0000", 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1212999999999998e-05 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283298+0000", 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123712 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283344+0000", 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6136e-05 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287839+0000", 2024-04-17T15:38:04.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004494634 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287921+0000", 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1932000000000001e-05 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:04.533 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.219295514999999, 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032981249999999998, 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 211 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302454+0000", 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302467+0000", 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2996999999999999e-05 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302501+0000", 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4075999999999997e-05 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302525+0000", 2024-04-17T15:38:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3737e-05 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302682+0000", 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157038 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302937+0000", 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025471400000000001 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.303366+0000", 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042908300000000003 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305046+0000", 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001680193 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305575+0000", 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052928199999999995 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305676+0000", 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100382 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305749+0000", 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3510000000000006e-05 2024-04-17T15:38:04.539 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.141520991, 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032452660000000001, 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.540 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 232 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380228+0000", 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380240+0000", 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-04-17T15:38:04.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380274+0000", 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3957e-05 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380297+0000", 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3319000000000002e-05 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380435+0000", 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137596 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380662+0000", 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022724099999999999 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.381091+0000", 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000429336 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.382850+0000", 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017586800000000001 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383310+0000", 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000460092 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383400+0000", 2024-04-17T15:38:04.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9575999999999998e-05 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383471+0000", 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1268999999999998e-05 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.546 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.115099899000001, 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036624269999999998, 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 278 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406649+0000", 2024-04-17T15:38:04.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6000000000000001e-06 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406663+0000", 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3845999999999999e-05 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406699+0000", 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5726000000000003e-05 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406722+0000", 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.304e-05 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406888+0000", 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166272 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407203+0000", 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031472299999999999 2024-04-17T15:38:04.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407899+0000", 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069595699999999998 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.409321+0000", 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014219759999999999 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410041+0000", 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00072015299999999996 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410183+0000", 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142003 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410309+0000", 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126131 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.552 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:353 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.102762714000001, 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047116850000000002, 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.553 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 353 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418987+0000", 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.853e-06 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419003+0000", 2024-04-17T15:38:04.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5973000000000001e-05 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419043+0000", 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9975999999999998e-05 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419064+0000", 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1607000000000002e-05 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419233+0000", 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168908 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419516+0000", 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028298800000000002 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419933+0000", 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000416329 2024-04-17T15:38:04.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421589+0000", 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016564139999999999 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423544+0000", 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019552250000000001 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423632+0000", 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7416000000000005e-05 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423696+0000", 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3996000000000002e-05 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.559 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:398 6.6 e30/24 6:66924383:reshard::reshard.0000000005:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.086495071999998, 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033955729999999998, 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435253+0000", 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.666e-06 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435266+0000", 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2564e-05 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435303+0000", 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7568999999999999e-05 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435322+0000", 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8743e-05 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435474+0000", 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015201900000000001 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435532+0000", 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7902000000000002e-05 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438561+0000", 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030286449999999999 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438647+0000", 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6465000000000006e-05 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.027638854999999, 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003409586, 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.565 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494109+0000", 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.595e-06 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494118+0000", 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1969999999999996e-06 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494140+0000", 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2617e-05 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494151+0000", 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1174e-05 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494293+0000", 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014123900000000001 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494691+0000", 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039822399999999997 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495275+0000", 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058460000000000001 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497150+0000", 2024-04-17T15:38:04.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018747550000000001 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497292+0000", 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141321 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497400+0000", 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010853099999999999 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497517+0000", 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117333 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:551 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.988280656999997, 2024-04-17T15:38:04.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003045336, 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 551 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533469+0000", 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.897e-06 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533486+0000", 2024-04-17T15:38:04.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816e-05 2024-04-17T15:38:04.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533523+0000", 2024-04-17T15:38:04.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6993999999999999e-05 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533540+0000", 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7186000000000001e-05 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533699+0000", 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015882799999999999 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534082+0000", 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038348700000000001 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534670+0000", 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058795799999999997 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.535977+0000", 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001306357 2024-04-17T15:38:04.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536289+0000", 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000312906 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536410+0000", 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120999 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536511+0000", 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100908 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:649 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.902784939999997, 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031209179999999999, 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.578 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 649 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618964+0000", 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6120000000000001e-06 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618977+0000", 2024-04-17T15:38:04.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2574e-05 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619012+0000", 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5051e-05 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619032+0000", 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0071000000000001e-05 2024-04-17T15:38:04.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619181+0000", 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148627 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619432+0000", 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251081 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619949+0000", 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051755200000000001 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621369+0000", 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00141994 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621936+0000", 2024-04-17T15:38:04.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056712400000000001 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622018+0000", 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1652999999999999e-05 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622083+0000", 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4633000000000003e-05 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.584 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.833359029, 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032122729999999999, 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 709 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:04.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688390+0000", 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3039999999999999e-06 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688402+0000", 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2082999999999999e-05 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688432+0000", 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0332999999999999e-05 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688447+0000", 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5046e-05 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688568+0000", 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121026 2024-04-17T15:38:04.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688772+0000", 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020336799999999999 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.689092+0000", 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032027999999999999 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.690444+0000", 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013523470000000001 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691292+0000", 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084744900000000001 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691459+0000", 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166692 2024-04-17T15:38:04.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691600+0000", 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141345 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:04.591 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.791328116999999, 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002981652, 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 726 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:04.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730421+0000", 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1399999999999998e-06 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730436+0000", 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5233e-05 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730468+0000", 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1574e-05 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730482+0000", 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4693e-05 2024-04-17T15:38:04.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730616+0000", 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013382800000000001 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730851+0000", 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000235455 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.731336+0000", 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048426600000000002 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.732933+0000", 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001597198 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733250+0000", 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031682299999999999 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733330+0000", 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9752999999999993e-05 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733400+0000", 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0689e-05 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.597 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.787991015000003, 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003233166, 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 727 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:04.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733758+0000", 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.114e-06 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733769+0000", 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1226000000000001e-05 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733792+0000", 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2580000000000001e-05 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733804+0000", 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2763e-05 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733944+0000", 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013943199999999999 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734191+0000", 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024684799999999998 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:04.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734584+0000", 2024-04-17T15:38:04.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039304900000000002 2024-04-17T15:38:04.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.735780+0000", 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011960320000000001 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736834+0000", 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010541400000000001 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736925+0000", 2024-04-17T15:38:04.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1101999999999996e-05 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736989+0000", 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3880000000000005e-05 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.605 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.423763266999998, 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033824100000000002, 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 880 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.606 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097987+0000", 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1159999999999999e-06 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098022+0000", 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-05 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098054+0000", 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1983000000000002e-05 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098069+0000", 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512999999999999e-05 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098228+0000", 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015874500000000001 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098633+0000", 2024-04-17T15:38:04.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040438300000000002 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.099238+0000", 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060534800000000002 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.100508+0000", 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00127024 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101208+0000", 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069981399999999999 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101295+0000", 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6722000000000001e-05 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101366+0000", 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1145999999999999e-05 2024-04-17T15:38:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.419269647999997, 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032254129999999999, 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.612 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 882 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:04.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102479+0000", 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102490+0000", 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0380000000000001e-05 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102521+0000", 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1529999999999998e-05 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102537+0000", 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.577e-05 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102681+0000", 2024-04-17T15:38:04.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102934+0000", 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025325100000000002 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.103425+0000", 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049086500000000005 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.104689+0000", 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012646879999999999 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105549+0000", 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085963200000000004 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105637+0000", 2024-04-17T15:38:04.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8438999999999998e-05 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105702+0000", 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5005999999999994e-05 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:04.618 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.415783763999997, 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030913970000000001, 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105965+0000", 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:38:04.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105975+0000", 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9729999999999992e-06 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106001+0000", 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6253000000000001e-05 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106015+0000", 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3353000000000001e-05 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106141+0000", 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012648600000000001 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106412+0000", 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027110699999999998 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106757+0000", 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000344657 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108260+0000", 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015027949999999999 2024-04-17T15:38:04.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108842+0000", 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058205799999999999 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108934+0000", 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1792999999999993e-05 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.109054+0000", 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120665 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.345669721999997, 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030928700000000002, 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.625 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 913 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176080+0000", 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8030000000000001e-06 2024-04-17T15:38:04.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176092+0000", 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2306999999999999e-05 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176122+0000", 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9569000000000001e-05 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176143+0000", 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.156e-05 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176345+0000", 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020190099999999999 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176576+0000", 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231091 2024-04-17T15:38:04.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176903+0000", 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000326874 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.178180+0000", 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001276868 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179011+0000", 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083103199999999999 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179102+0000", 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0919000000000001e-05 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179170+0000", 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:38:04.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.317024115999999, 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031669530000000001, 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 925 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:04.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204725+0000", 2024-04-17T15:38:04.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:04.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204737+0000", 2024-04-17T15:38:04.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2116000000000001e-05 2024-04-17T15:38:04.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204768+0000", 2024-04-17T15:38:04.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0676999999999998e-05 2024-04-17T15:38:04.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204789+0000", 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1739999999999999e-05 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204946+0000", 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015635099999999999 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205169+0000", 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223062 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205492+0000", 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032312699999999998 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.206626+0000", 2024-04-17T15:38:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011343589999999999 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207735+0000", 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011090659999999999 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207824+0000", 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8603000000000005e-05 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207890+0000", 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5642000000000006e-05 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.309624550000002, 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030226580000000001, 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 928 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212124+0000", 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1840000000000002e-06 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212136+0000", 2024-04-17T15:38:04.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2106000000000001e-05 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212176+0000", 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9643e-05 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212196+0000", 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212325+0000", 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012877200000000001 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212601+0000", 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000275588 2024-04-17T15:38:04.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212945+0000", 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034397600000000001 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214619+0000", 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016741779999999999 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214908+0000", 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028898299999999998 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215028+0000", 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120456 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215145+0000", 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116369 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.647 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.648 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:04.648 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:04.648 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.305459566000003, 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032898250000000001, 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 930 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216288+0000", 2024-04-17T15:38:04.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3260000000000001e-06 2024-04-17T15:38:04.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:04.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216297+0000", 2024-04-17T15:38:04.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0770000000000008e-06 2024-04-17T15:38:04.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216318+0000", 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1869999999999999e-05 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216329+0000", 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.079e-05 2024-04-17T15:38:04.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216469+0000", 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013962499999999999 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216725+0000", 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025639100000000002 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:04.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.217223+0000", 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049742899999999997 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.218588+0000", 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00136539 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219283+0000", 2024-04-17T15:38:04.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069527 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219452+0000", 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168708 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219577+0000", 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012494900000000001 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:04.658 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:04.658 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:04.660 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:04.660 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:04.658+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:04.761 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:04.758+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:04.839 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:04.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:04.839 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:04.839 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:04.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:04.896 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:04.894+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:04.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:05.004 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:05.005+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:05.021 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:05.021 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:05.021 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:05.021 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:05.021 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:05.035 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:05.080 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:05.078+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:05.118 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:05.118 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:05.135 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:05.136 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:05.151 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:05.152 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:05.163 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:05.161+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:05.164 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:05.164 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 66.896267086999998, 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:05.165 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:38:05.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:38:05.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 66.885502501000005, 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.171 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:05.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:38:05.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:38:05.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:38:05.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:38:05.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:38:05.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:38:05.177 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.177 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.881332993999997, 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.178 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:38:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.184 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.874205568999997, 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:38:05.190 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.888166142999999, 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.191 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:38:05.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.827260711000001, 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.197 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:38:05.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:38:05.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:38:05.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.203 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.809127934000003, 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:38:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.805453802000002, 2024-04-17T15:38:05.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:38:05.210 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.210 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.210 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.210 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.210 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.210 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.210 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:38:05.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.776338520000003, 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:38:05.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:38:05.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.742305731999998, 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:38:05.221 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:38:05.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:38:05.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:38:05.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.706309625000003, 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:38:05.227 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:38:05.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:38:05.232 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.618893241000002, 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:05.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.616355171000002, 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.237 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:38:05.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:38:05.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:38:05.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.363996475999997, 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.244 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:38:05.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:38:05.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.341694386, 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.250 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:05.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:38:05.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:38:05.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.256 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.269921511, 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:38:05.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:38:05.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.075691311, 2024-04-17T15:38:05.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:05.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:38:05.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.036415988000002, 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.270 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:38:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.915730283000002, 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.277 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:05.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.283 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 58.911077337000002, 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.284 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:05.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:38:05.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:05.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:05.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:38:05.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:38:05.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.290 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:05.290 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:05.290 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:05.291 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:05.292 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:05.293 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:05.293 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:05.293 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:05.294 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:05.295 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:05.296 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:05.296 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:05.289+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:05.393 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:05.393+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:05.469 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:05.469 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:05.484 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:05.494 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:05.493+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:05.595 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:05.594+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:05.603 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:05.603 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:05.618 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:05.703 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:05.702+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:05.787 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:05.787 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:05.797 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:05.794+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:05.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:05.901 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:05.894+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:05.976 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:05.976 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:05.991 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:06.036 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:06.034+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:06.100 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:06.101+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:06.179 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:06.223 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:06.222+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:06.303 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:06.301+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:06.308 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:06.309 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:06.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:06.404 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:06.402+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:06.460 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:06.461 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:06.479 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:06.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:38:06.525 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:06.525+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:06.599 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:06.599 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:06.606 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:06.602+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:06.615 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:06.707 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:06.706+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:06.735 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:06.735 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:06.751 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:06.808 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:06.809+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:06.873 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:06.874 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:06.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:06.933 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:06.933+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:07.010 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:07.006+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:07.059 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:07.059 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:07.074 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:07.120 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:07.121+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:07.207 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:07.207 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:07.213 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:07.214+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:07.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:07.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:07.314 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:07.310+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:07.396 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:07.396 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:07.412 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:07.414 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:07.413+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:07.460 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:07.461 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:07.478 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:07.479 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:07.481 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:38:07.498 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:07.498 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:07.515 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:07.514+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:07.516 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:07.517 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:07.542 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:07.543 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:07.555 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:07.556 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:07.563 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:07.563 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:07.570 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:07.584 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:07.585 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:07.606 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:07.607 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:07.616 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:07.613+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:07.708 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:07.708 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:07.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 69.426808023000007, 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030098299999999998, 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:07.709 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 42 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280322+0000", 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6360000000000001e-06 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280344+0000", 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1710000000000001e-05 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280367+0000", 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2646e-05 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280380+0000", 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3574000000000001e-05 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280494+0000", 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114288 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280703+0000", 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000208805 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280947+0000", 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024378799999999999 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.282418+0000", 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014711030000000001 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283224+0000", 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00080576599999999997 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283286+0000", 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1921999999999994e-05 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283330+0000", 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4592000000000003e-05 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:07.714 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.412453877000004, 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003461703, 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 52 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:07.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294678+0000", 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.92e-06 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294691+0000", 2024-04-17T15:38:07.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3244999999999999e-05 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294739+0000", 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7778999999999998e-05 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294753+0000", 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4297999999999999e-05 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294857+0000", 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104107 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295108+0000", 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025097299999999998 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295309+0000", 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020123600000000001 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297594+0000", 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002284379 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297987+0000", 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039364100000000002 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298068+0000", 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1001999999999995e-05 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298136+0000", 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8122999999999998e-05 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:57 7.3 e27/26 7:c609908c:::notify.5:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.402372022999998, 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003535472, 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.720 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304759+0000", 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304773+0000", 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.396e-05 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304796+0000", 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3961999999999999e-05 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304813+0000", 2024-04-17T15:38:07.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6086000000000002e-05 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304947+0000", 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013435899999999999 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304991+0000", 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4221000000000002e-05 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308226+0000", 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032346190000000002 2024-04-17T15:38:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308292+0000", 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6282e-05 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:59 7.14 e27/26 7:2b04a3e9:::notify.6:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.399906267000006, 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033715469999999999, 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.724 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307224+0000", 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6169999999999999e-06 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307235+0000", 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1408e-05 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307269+0000", 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3442999999999998e-05 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307290+0000", 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1353999999999999e-05 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307413+0000", 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000122865 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307452+0000", 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9387000000000001e-05 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310518+0000", 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030657919999999999 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310594+0000", 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5680999999999996e-05 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:07.728 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.314110917000001, 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034483930000000001, 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 236 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393020+0000", 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7669999999999999e-06 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393034+0000", 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3073e-05 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393065+0000", 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1860000000000003e-05 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393082+0000", 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6855999999999999e-05 2024-04-17T15:38:07.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393221+0000", 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013827300000000001 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393434+0000", 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021370199999999999 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393850+0000", 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041539700000000002 2024-04-17T15:38:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.395194+0000", 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001344121 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396313+0000", 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011190180000000001 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396398+0000", 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5393e-05 2024-04-17T15:38:07.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396466+0000", 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7933000000000002e-05 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.301072464999997, 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002805929, 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.734 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 280 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406057+0000", 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.203e-06 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406063+0000", 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9610000000000002e-06 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406075+0000", 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1714e-05 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406082+0000", 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5220000000000004e-06 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406136+0000", 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4211e-05 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406231+0000", 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4871999999999996e-05 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406377+0000", 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146448 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.407079+0000", 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000701639 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408771+0000", 2024-04-17T15:38:07.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001692432 2024-04-17T15:38:07.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408820+0000", 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9289999999999997e-05 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408862+0000", 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1637000000000001e-05 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.740 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:697 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.047650148000002, 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002810561, 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 697 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659480+0000", 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4759999999999999e-06 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659488+0000", 2024-04-17T15:38:07.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1710000000000002e-06 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659509+0000", 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0718000000000001e-05 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659525+0000", 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5894999999999999e-05 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659651+0000", 2024-04-17T15:38:07.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012638300000000001 2024-04-17T15:38:07.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659781+0000", 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013031300000000001 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.660036+0000", 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025453599999999998 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.661296+0000", 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001260331 2024-04-17T15:38:07.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662138+0000", 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084126399999999999 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662208+0000", 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0188e-05 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662289+0000", 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.939322056000002, 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029789930000000001, 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.748 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 742 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767809+0000", 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7329999999999999e-06 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767822+0000", 2024-04-17T15:38:07.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2663999999999999e-05 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767854+0000", 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1875999999999998e-05 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767869+0000", 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768001+0000", 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013243900000000001 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768229+0000", 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022790500000000001 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768575+0000", 2024-04-17T15:38:07.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034550800000000001 2024-04-17T15:38:07.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.769817+0000", 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012425019999999999 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770633+0000", 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081610700000000005 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770720+0000", 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6682999999999997e-05 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770786+0000", 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5525999999999996e-05 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.755 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.893909100000002, 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029893189999999998, 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.756 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 760 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813222+0000", 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-06 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813233+0000", 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1703e-05 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813266+0000", 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2772999999999999e-05 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813289+0000", 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2337e-05 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813434+0000", 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014584400000000001 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813598+0000", 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000163752 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813883+0000", 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000285087 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.815043+0000", 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011595819999999999 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816059+0000", 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010158459999999999 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816148+0000", 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9553000000000001e-05 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816209+0000", 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0585999999999999e-05 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.761 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.889951670999999, 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030744029999999999, 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 762 2024-04-17T15:38:07.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817179+0000", 2024-04-17T15:38:07.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-06 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817190+0000", 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1090000000000001e-05 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817225+0000", 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5129999999999997e-05 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817244+0000", 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9029999999999999e-05 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817379+0000", 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000134475 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817606+0000", 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022773199999999999 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.818089+0000", 2024-04-17T15:38:07.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048282400000000002 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.819375+0000", 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012861680000000001 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820098+0000", 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000722841 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820184+0000", 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5500000000000005e-05 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820251+0000", 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7613000000000005e-05 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.757882899000002, 2024-04-17T15:38:07.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029764269999999998, 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 817 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949248+0000", 2024-04-17T15:38:07.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4099999999999998e-06 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949264+0000", 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6364000000000001e-05 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949296+0000", 2024-04-17T15:38:07.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1513000000000001e-05 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949317+0000", 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1403000000000002e-05 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949509+0000", 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019130500000000001 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949747+0000", 2024-04-17T15:38:07.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000238039 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.950063+0000", 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031621399999999999 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.951228+0000", 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001165379 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952068+0000", 2024-04-17T15:38:07.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000839674 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952156+0000", 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8313000000000006e-05 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952222+0000", 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5813000000000002e-05 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.773 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.753946239000001, 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029501589999999999, 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 819 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953184+0000", 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.973e-06 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953198+0000", 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3657e-05 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953229+0000", 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1486000000000003e-05 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953248+0000", 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187000000000001e-05 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953356+0000", 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107909 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953484+0000", 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012820600000000001 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953773+0000", 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028948800000000002 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.954862+0000", 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001088365 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.955975+0000", 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001113326 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956061+0000", 2024-04-17T15:38:07.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6470000000000004e-05 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956133+0000", 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1092000000000003e-05 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.702592088000003, 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029884, 2024-04-17T15:38:07.779 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 841 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004539+0000", 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2630000000000002e-06 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004551+0000", 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2680000000000001e-05 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004582+0000", 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0700000000000001e-05 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004597+0000", 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.501e-05 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004732+0000", 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013490900000000001 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004956+0000", 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022391800000000001 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.005298+0000", 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034173100000000001 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.006602+0000", 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013043810000000001 2024-04-17T15:38:07.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007387+0000", 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000784635 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007467+0000", 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0661999999999994e-05 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007525+0000", 2024-04-17T15:38:07.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7510999999999999e-05 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.687669945000003, 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031389679999999998, 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.786 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 847 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019461+0000", 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.277e-06 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019472+0000", 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1319e-05 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019503+0000", 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0626999999999997e-05 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019517+0000", 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019652+0000", 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013442799999999999 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019977+0000", 2024-04-17T15:38:07.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032536300000000001 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.020521+0000", 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00054383700000000003 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.021843+0000", 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001321593 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022433+0000", 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058991600000000001 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022517+0000", 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4845999999999994e-05 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022598+0000", 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0185999999999994e-05 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.791 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.638710904, 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034503820000000001, 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 868 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.792 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068420+0000", 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1330000000000002e-06 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068432+0000", 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2646000000000001e-05 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068463+0000", 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0170000000000001e-05 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068477+0000", 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4797000000000001e-05 2024-04-17T15:38:07.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068645+0000", 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016787200000000001 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068999+0000", 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035414099999999998 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.069565+0000", 2024-04-17T15:38:07.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056531599999999995 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.070818+0000", 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001252932 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071707+0000", 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088886 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071793+0000", 2024-04-17T15:38:07.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6885999999999994e-05 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071868+0000", 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4629000000000007e-05 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.546064522000002, 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030204519999999999, 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.797 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 907 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161067+0000", 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4329999999999998e-06 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161077+0000", 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0910000000000001e-05 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161109+0000", 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1288999999999998e-05 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161123+0000", 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4739999999999999e-05 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161242+0000", 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011889 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161468+0000", 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022609099999999999 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161805+0000", 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612099999999999 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.162878+0000", 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001073606 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.163928+0000", 2024-04-17T15:38:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00104958 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164017+0000", 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9284999999999996e-05 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164085+0000", 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7507000000000003e-05 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.445288077000001, 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003409006, 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 949 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261844+0000", 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.993e-06 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261857+0000", 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261902+0000", 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5286e-05 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261926+0000", 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3757e-05 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262112+0000", 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018562900000000001 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262494+0000", 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038215999999999999 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262901+0000", 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040692000000000001 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.264939+0000", 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020382400000000002 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265106+0000", 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016660500000000001 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265187+0000", 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265250+0000", 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2063000000000005e-05 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.440988584000003, 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032687240000000002, 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.808 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 951 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266142+0000", 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6640000000000001e-06 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266151+0000", 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5829999999999996e-06 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266177+0000", 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.55e-05 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266189+0000", 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2139e-05 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266301+0000", 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011170700000000001 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266418+0000", 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117599 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266690+0000", 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027164099999999998 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.268256+0000", 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001565842 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269168+0000", 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00091194099999999999 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269297+0000", 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012897900000000001 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269409+0000", 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112129 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:07.813 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.430184908999998, 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030567260000000001, 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 955 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276946+0000", 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6139999999999999e-06 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276959+0000", 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.279e-05 2024-04-17T15:38:07.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276992+0000", 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2981999999999997e-05 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277008+0000", 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6127e-05 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277162+0000", 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015356199999999999 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277427+0000", 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026516799999999998 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277784+0000", 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035701500000000002 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279283+0000", 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499479 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279849+0000", 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056583000000000002 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279935+0000", 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5649000000000006e-05 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280000+0000", 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5510000000000001e-05 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.426206307000001, 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028646269999999998, 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:07.819 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 957 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280924+0000", 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.894e-06 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280934+0000", 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6299999999999993e-06 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280960+0000", 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280986+0000", 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5913000000000001e-05 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281095+0000", 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109212 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281215+0000", 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120469 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281472+0000", 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025682199999999997 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.282766+0000", 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001293521 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283642+0000", 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087648000000000001 2024-04-17T15:38:07.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283727+0000", 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4874000000000001e-05 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283787+0000", 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9892000000000002e-05 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:07.825 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:07.826 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:07.827 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:07.825+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:07.927 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:07.925+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:08.005 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:08.005 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:08.005 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:08.005 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:08.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:08.065 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:08.065+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:08.131 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:08.129+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:08.197 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:08.197 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:08.197 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:08.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:08.197 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:08.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:08.257 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:08.257+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:08.333 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:08.333+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:08.391 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:08.391 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:08.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:08.391 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 68.137566770999996, 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063603720000000004, 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "reached pg", 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 44 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.392 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253462+0000", 2024-04-17T15:38:08.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253499+0000", 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7339999999999998e-05 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253536+0000", 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6746999999999999e-05 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253562+0000", 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6095999999999999e-05 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253940+0000", 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037773800000000002 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for peered", 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253962+0000", 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2566e-05 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259497+0000", 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055350269999999997 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259819+0000", 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000321792 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040977412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:08.396 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.087238540000001, 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049681100000000004, 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 57 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:08.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303788+0000", 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.55e-06 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303797+0000", 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8820000000000007e-06 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303842+0000", 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4231999999999999e-05 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303856+0000", 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4307e-05 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303983+0000", 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127577 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304194+0000", 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000210299 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304573+0000", 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037939199999999999 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.305923+0000", 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013502500000000001 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308569+0000", 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026456159999999999 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308655+0000", 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5539999999999998e-05 2024-04-17T15:38:08.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308755+0000", 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010046499999999999 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040977413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.084611120999995, 2024-04-17T15:38:08.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047062060000000001, 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 59 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:08.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306416+0000", 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306424+0000", 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7519999999999996e-06 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306446+0000", 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2155e-05 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306456+0000", 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0523000000000001e-05 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306569+0000", 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112277 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306739+0000", 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170688 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307048+0000", 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030829700000000002 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310444+0000", 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033961629999999998 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310828+0000", 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038433500000000003 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310956+0000", 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127997 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.311121+0000", 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016447900000000001 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 63.108620088000002, 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059605389999999999, 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 207 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282410+0000", 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3959999999999999e-06 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282431+0000", 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0996999999999999e-05 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282475+0000", 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4703000000000002e-05 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282501+0000", 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5627e-05 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282659+0000", 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015803900000000001 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282916+0000", 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025698099999999998 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.283628+0000", 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00071140199999999998 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.286242+0000", 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002614782 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288105+0000", 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862437 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288260+0000", 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015568900000000001 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288366+0000", 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000105486 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.413 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 63.070615502000003, 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033450900000000002, 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.414 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.417 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 216 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320413+0000", 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.65e-06 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320426+0000", 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2972999999999999e-05 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2326999999999997e-05 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320473+0000", 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4763000000000001e-05 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320604+0000", 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013095899999999999 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320836+0000", 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000232012 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.321267+0000", 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043098000000000002 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.322958+0000", 2024-04-17T15:38:08.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016909189999999999 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323607+0000", 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00064901100000000001 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323691+0000", 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4383999999999997e-05 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323755+0000", 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4111999999999999e-05 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 63.030383569999998, 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036511180000000001, 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.423 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 227 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:08.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360644+0000", 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360656+0000", 2024-04-17T15:38:08.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.217e-05 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360689+0000", 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2778999999999999e-05 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360704+0000", 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5187e-05 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360849+0000", 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144315 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361057+0000", 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020802200000000001 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361490+0000", 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043335100000000001 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.363127+0000", 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001636832 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364063+0000", 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093582599999999995 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364177+0000", 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011425300000000001 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364293+0000", 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115943 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 63.022448668999999, 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003177409, 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.429 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 229 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368579+0000", 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2740000000000002e-06 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368591+0000", 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1456e-05 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368623+0000", 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2474000000000001e-05 2024-04-17T15:38:08.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368638+0000", 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.502e-05 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368758+0000", 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000119505 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368990+0000", 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023266199999999999 2024-04-17T15:38:08.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.369391+0000", 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040097100000000002 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.370944+0000", 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015525389999999999 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371613+0000", 2024-04-17T15:38:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00066936899999999995 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371693+0000", 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9886000000000001e-05 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371754+0000", 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1253000000000005e-05 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 63.015365844000002, 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033033200000000002, 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 231 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375662+0000", 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:08.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375673+0000", 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1678999999999999e-05 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375706+0000", 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2293999999999999e-05 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375721+0000", 2024-04-17T15:38:08.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.522e-05 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375868+0000", 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014661200000000001 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376071+0000", 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020339199999999999 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:08.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376467+0000", 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039612099999999998 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.377887+0000", 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001419696 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378819+0000", 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093196000000000001 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378902+0000", 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2977000000000002e-05 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378963+0000", 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1241999999999994e-05 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:345 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.973810374000003, 2024-04-17T15:38:08.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003233755, 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 345 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417216+0000", 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417223+0000", 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3969999999999999e-06 2024-04-17T15:38:08.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417240+0000", 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7711e-05 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417250+0000", 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3789999999999995e-06 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417308+0000", 2024-04-17T15:38:08.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8663999999999999e-05 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417398+0000", 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9524000000000005e-05 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417555+0000", 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015700299999999999 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.418480+0000", 2024-04-17T15:38:08.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00092510400000000005 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420343+0000", 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862596 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420402+0000", 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.944e-05 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420449+0000", 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6832000000000002e-05 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:398 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.957237278999997, 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041188789999999998, 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.446 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 398 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433789+0000", 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433794+0000", 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1490000000000002e-06 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433807+0000", 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2334000000000001e-05 2024-04-17T15:38:08.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433813+0000", 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1240000000000002e-06 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433875+0000", 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2309000000000003e-05 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433976+0000", 2024-04-17T15:38:08.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100577 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434109+0000", 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013374099999999999 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434711+0000", 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060139999999999998 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437854+0000", 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031429069999999999 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437883+0000", 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9539999999999998e-05 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437907+0000", 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3947999999999998e-05 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:402 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.95533726, 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047817750000000003, 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 402 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435689+0000", 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.850000000000001e-07 2024-04-17T15:38:08.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435693+0000", 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435705+0000", 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1484000000000001e-05 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435713+0000", 2024-04-17T15:38:08.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6699999999999994e-06 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435756+0000", 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3519999999999997e-05 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435812+0000", 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5998000000000002e-05 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435942+0000", 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000129596 2024-04-17T15:38:08.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.436441+0000", 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049949700000000001 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440415+0000", 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039740690000000002 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440444+0000", 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9156999999999999e-05 2024-04-17T15:38:08.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440470+0000", 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5499000000000001e-05 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:522 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.884184885000003, 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031631699999999999, 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.457 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 522 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506842+0000", 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1629999999999999e-06 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506847+0000", 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506861+0000", 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3811e-05 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506871+0000", 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5429999999999999e-06 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506925+0000", 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4740000000000001e-05 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507027+0000", 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101766 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507209+0000", 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018180900000000001 2024-04-17T15:38:08.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509722+0000", 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025127539999999999 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509938+0000", 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021666099999999999 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509978+0000", 2024-04-17T15:38:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9987000000000002e-05 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.510004+0000", 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5316999999999998e-05 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:607 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.810403424, 2024-04-17T15:38:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003551916, 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 607 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580623+0000", 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4020000000000001e-06 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580632+0000", 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1459999999999996e-06 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580654+0000", 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2446000000000002e-05 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580665+0000", 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1165000000000001e-05 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580780+0000", 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114973 2024-04-17T15:38:08.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580917+0000", 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013664300000000001 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581189+0000", 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027190100000000001 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582345+0000", 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00115599 2024-04-17T15:38:08.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583899+0000", 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015540319999999999 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584059+0000", 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016074500000000001 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584174+0000", 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114473 2024-04-17T15:38:08.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:611 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.804213474999997, 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033528170000000001, 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 611 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586814+0000", 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9860000000000001e-06 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586825+0000", 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0686000000000001e-05 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586853+0000", 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8365e-05 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586866+0000", 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587014+0000", 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014742600000000001 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587227+0000", 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021381800000000001 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587506+0000", 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027870100000000001 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.588524+0000", 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001018157 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.589970+0000", 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014462590000000001 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590061+0000", 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0138999999999999e-05 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590165+0000", 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104168 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.474 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.718398798000003, 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034329339999999999, 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.475 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 703 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672629+0000", 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0080000000000001e-06 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672638+0000", 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1419999999999999e-06 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672664+0000", 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5905e-05 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672676+0000", 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2337000000000001e-05 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672840+0000", 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016395 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673166+0000", 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000326275 2024-04-17T15:38:08.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673711+0000", 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000545047 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675036+0000", 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013244940000000001 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675808+0000", 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00077264900000000004 2024-04-17T15:38:08.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675951+0000", 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014292499999999999 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.676060+0000", 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010820200000000001 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.480 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.689224785999997, 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003556245, 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 715 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701803+0000", 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701818+0000", 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5223e-05 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701849+0000", 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1035999999999999e-05 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701866+0000", 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6643999999999999e-05 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702012+0000", 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014634700000000001 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702345+0000", 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033299399999999998 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702866+0000", 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052063999999999995 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.704096+0000", 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001229988 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705095+0000", 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00099944500000000006 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705240+0000", 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144287 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705357+0000", 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117191 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.534498175000003, 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035344460000000001, 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 778 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856530+0000", 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3199999999999998e-06 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856541+0000", 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.183e-05 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856573+0000", 2024-04-17T15:38:08.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2060000000000001e-05 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856590+0000", 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6356000000000001e-05 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856741+0000", 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158899999999999 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857099+0000", 2024-04-17T15:38:08.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035803499999999998 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857663+0000", 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056350599999999997 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859015+0000", 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013523299999999999 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859910+0000", 2024-04-17T15:38:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00089519100000000004 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859996+0000", 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5673000000000005e-05 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.860062+0000", 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5555999999999994e-05 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.420690401999998, 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032371169999999999, 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 826 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970337+0000", 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970349+0000", 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1440000000000001e-05 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970381+0000", 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1896000000000001e-05 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970395+0000", 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4867e-05 2024-04-17T15:38:08.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970554+0000", 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015837199999999999 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970926+0000", 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037184099999999998 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.971531+0000", 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060493600000000004 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.972848+0000", 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013169340000000001 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973421+0000", 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057373600000000004 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973506+0000", 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4285999999999999e-05 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973572+0000", 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6586000000000002e-05 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.329682278999996, 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003083728, 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.497 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 865 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061345+0000", 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061356+0000", 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0823e-05 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061387+0000", 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0766999999999999e-05 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061402+0000", 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5379999999999998e-05 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061519+0000", 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117265 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061739+0000", 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000219106 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.062054+0000", 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031500400000000002 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.063247+0000", 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011935979999999999 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064266+0000", 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001019023 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064359+0000", 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3040000000000004e-05 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064427+0000", 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7665999999999999e-05 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.502 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 62.158641084999999, 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031575179999999998, 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 937 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.503 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232386+0000", 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232398+0000", 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1864e-05 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232426+0000", 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232440+0000", 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.412e-05 2024-04-17T15:38:08.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232621+0000", 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018099899999999999 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232854+0000", 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023273400000000001 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.233176+0000", 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032190499999999999 2024-04-17T15:38:08.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.234217+0000", 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001040673 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235396+0000", 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001179835 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235480+0000", 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3473000000000005e-05 2024-04-17T15:38:08.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235542+0000", 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2042e-05 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:08.508 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:08.510 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:08.510 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:08.509+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:08.611 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:08.609+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:08.644 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:08.644 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:08.644 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:08.645 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:08.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:08.712 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:08.710+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:08.784 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:08.784 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:08.799 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:08.812 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:08.813+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:08.913 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:08.910+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:46 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 66.689635026999994, 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006071562, 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:08.965 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:08.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273829+0000", 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.984e-06 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273845+0000", 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.541e-05 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273886+0000", 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1556e-05 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273920+0000", 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3668999999999999e-05 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274134+0000", 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000213952 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274182+0000", 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7706e-05 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279811+0000", 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056294029999999998 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279899+0000", 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7881999999999996e-05 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:47 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 66.680361767999997, 2024-04-17T15:38:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048203359999999997, 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283103+0000", 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283119+0000", 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6509000000000001e-05 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283153+0000", 2024-04-17T15:38:08.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4037e-05 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283175+0000", 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1212999999999998e-05 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283298+0000", 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123712 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283344+0000", 2024-04-17T15:38:08.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6136e-05 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287839+0000", 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004494634 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287921+0000", 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1932000000000001e-05 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.661011277, 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032981249999999998, 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 211 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:08.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302454+0000", 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302467+0000", 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2996999999999999e-05 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302501+0000", 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4075999999999997e-05 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302525+0000", 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3737e-05 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302682+0000", 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157038 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302937+0000", 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025471400000000001 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.303366+0000", 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042908300000000003 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305046+0000", 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001680193 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305575+0000", 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052928199999999995 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305676+0000", 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100382 2024-04-17T15:38:08.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305749+0000", 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3510000000000006e-05 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.583236753000001, 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032452660000000001, 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:08.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 232 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:08.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380228+0000", 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380240+0000", 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380274+0000", 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3957e-05 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380297+0000", 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3319000000000002e-05 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380435+0000", 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137596 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380662+0000", 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022724099999999999 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.381091+0000", 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000429336 2024-04-17T15:38:08.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.382850+0000", 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017586800000000001 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383310+0000", 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000460092 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383400+0000", 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9575999999999998e-05 2024-04-17T15:38:08.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383471+0000", 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1268999999999998e-05 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.556815661000002, 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036624269999999998, 2024-04-17T15:38:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 278 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:08.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406649+0000", 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6000000000000001e-06 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:08.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406663+0000", 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3845999999999999e-05 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406699+0000", 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5726000000000003e-05 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406722+0000", 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.304e-05 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406888+0000", 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166272 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407203+0000", 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031472299999999999 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407899+0000", 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069595699999999998 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.409321+0000", 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014219759999999999 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410041+0000", 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00072015299999999996 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410183+0000", 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142003 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410309+0000", 2024-04-17T15:38:08.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126131 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:353 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.544478476000002, 2024-04-17T15:38:08.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047116850000000002, 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 353 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:08.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418987+0000", 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.853e-06 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419003+0000", 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5973000000000001e-05 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419043+0000", 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9975999999999998e-05 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419064+0000", 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1607000000000002e-05 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419233+0000", 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168908 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419516+0000", 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028298800000000002 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419933+0000", 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000416329 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421589+0000", 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016564139999999999 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423544+0000", 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019552250000000001 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423632+0000", 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7416000000000005e-05 2024-04-17T15:38:08.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423696+0000", 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3996000000000002e-05 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:398 6.6 e30/24 6:66924383:reshard::reshard.0000000005:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.528210833999999, 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033955729999999998, 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:08.998 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:08.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435253+0000", 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.666e-06 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435266+0000", 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2564e-05 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435303+0000", 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7568999999999999e-05 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435322+0000", 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8743e-05 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435474+0000", 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015201900000000001 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435532+0000", 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7902000000000002e-05 2024-04-17T15:38:09.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438561+0000", 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030286449999999999 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438647+0000", 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6465000000000006e-05 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.469354617, 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003409586, 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494109+0000", 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.595e-06 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494118+0000", 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1969999999999996e-06 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494140+0000", 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2617e-05 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494151+0000", 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1174e-05 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494293+0000", 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014123900000000001 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494691+0000", 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039822399999999997 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495275+0000", 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058460000000000001 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497150+0000", 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018747550000000001 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497292+0000", 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141321 2024-04-17T15:38:09.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497400+0000", 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010853099999999999 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497517+0000", 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117333 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.008 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:551 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.429996418999998, 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003045336, 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 551 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533469+0000", 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.897e-06 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533486+0000", 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816e-05 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533523+0000", 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6993999999999999e-05 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533540+0000", 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7186000000000001e-05 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533699+0000", 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015882799999999999 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534082+0000", 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038348700000000001 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534670+0000", 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058795799999999997 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.535977+0000", 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001306357 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536289+0000", 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000312906 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536410+0000", 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120999 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536511+0000", 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100908 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:649 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.344500701999998, 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031209179999999999, 2024-04-17T15:38:09.014 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 649 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618964+0000", 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6120000000000001e-06 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618977+0000", 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2574e-05 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619012+0000", 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5051e-05 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619032+0000", 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0071000000000001e-05 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619181+0000", 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148627 2024-04-17T15:38:09.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619432+0000", 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251081 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619949+0000", 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051755200000000001 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621369+0000", 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00141994 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621936+0000", 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056712400000000001 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622018+0000", 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1652999999999999e-05 2024-04-17T15:38:09.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622083+0000", 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4633000000000003e-05 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.275074791000002, 2024-04-17T15:38:09.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032122729999999999, 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 709 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688390+0000", 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3039999999999999e-06 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688402+0000", 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2082999999999999e-05 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688432+0000", 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0332999999999999e-05 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688447+0000", 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5046e-05 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688568+0000", 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121026 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688772+0000", 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020336799999999999 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.689092+0000", 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032027999999999999 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.690444+0000", 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013523470000000001 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691292+0000", 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084744900000000001 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691459+0000", 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166692 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691600+0000", 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141345 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.026 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.233043879, 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002981652, 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 726 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730421+0000", 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1399999999999998e-06 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730436+0000", 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5233e-05 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730468+0000", 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1574e-05 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730482+0000", 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4693e-05 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730616+0000", 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013382800000000001 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730851+0000", 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000235455 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.731336+0000", 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048426600000000002 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.732933+0000", 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001597198 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733250+0000", 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031682299999999999 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733330+0000", 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9752999999999993e-05 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733400+0000", 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0689e-05 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.229706776999997, 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003233166, 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.032 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 727 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733758+0000", 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.114e-06 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733769+0000", 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1226000000000001e-05 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733792+0000", 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2580000000000001e-05 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733804+0000", 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2763e-05 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733944+0000", 2024-04-17T15:38:09.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013943199999999999 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734191+0000", 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024684799999999998 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734584+0000", 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039304900000000002 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.735780+0000", 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011960320000000001 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736834+0000", 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010541400000000001 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736925+0000", 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1101999999999996e-05 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736989+0000", 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3880000000000005e-05 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.865479028999999, 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033824100000000002, 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.038 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 880 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:09.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097987+0000", 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1159999999999999e-06 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098022+0000", 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-05 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098054+0000", 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1983000000000002e-05 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098069+0000", 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512999999999999e-05 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098228+0000", 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015874500000000001 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098633+0000", 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040438300000000002 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.099238+0000", 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060534800000000002 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.100508+0000", 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00127024 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101208+0000", 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069981399999999999 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101295+0000", 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6722000000000001e-05 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101366+0000", 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1145999999999999e-05 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.043 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.860985409999998, 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032254129999999999, 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.044 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 882 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102479+0000", 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102490+0000", 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0380000000000001e-05 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102521+0000", 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1529999999999998e-05 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102537+0000", 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.577e-05 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102681+0000", 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102934+0000", 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025325100000000002 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.103425+0000", 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049086500000000005 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.104689+0000", 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012646879999999999 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105549+0000", 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085963200000000004 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105637+0000", 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8438999999999998e-05 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105702+0000", 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5005999999999994e-05 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:09.049 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.857499525999998, 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030913970000000001, 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:09.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105965+0000", 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105975+0000", 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9729999999999992e-06 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106001+0000", 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6253000000000001e-05 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106015+0000", 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3353000000000001e-05 2024-04-17T15:38:09.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106141+0000", 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012648600000000001 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106412+0000", 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027110699999999998 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106757+0000", 2024-04-17T15:38:09.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000344657 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108260+0000", 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015027949999999999 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108842+0000", 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058205799999999999 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108934+0000", 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1792999999999993e-05 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.109054+0000", 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120665 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.055 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.787385483999998, 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030928700000000002, 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 913 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.056 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176080+0000", 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8030000000000001e-06 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176092+0000", 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2306999999999999e-05 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176122+0000", 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9569000000000001e-05 2024-04-17T15:38:09.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176143+0000", 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.156e-05 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176345+0000", 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020190099999999999 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176576+0000", 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231091 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176903+0000", 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000326874 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.178180+0000", 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001276868 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179011+0000", 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083103199999999999 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179102+0000", 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0919000000000001e-05 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179170+0000", 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.061 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.758739878, 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031669530000000001, 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.062 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 925 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:09.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204725+0000", 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204737+0000", 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2116000000000001e-05 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204768+0000", 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0676999999999998e-05 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204789+0000", 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1739999999999999e-05 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204946+0000", 2024-04-17T15:38:09.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015635099999999999 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205169+0000", 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223062 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205492+0000", 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032312699999999998 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.206626+0000", 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011343589999999999 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207735+0000", 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011090659999999999 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207824+0000", 2024-04-17T15:38:09.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8603000000000005e-05 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207890+0000", 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5642000000000006e-05 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.751340311999996, 2024-04-17T15:38:09.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030226580000000001, 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 928 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212124+0000", 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1840000000000002e-06 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212136+0000", 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2106000000000001e-05 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212176+0000", 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9643e-05 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212196+0000", 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212325+0000", 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012877200000000001 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212601+0000", 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000275588 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212945+0000", 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034397600000000001 2024-04-17T15:38:09.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214619+0000", 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016741779999999999 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214908+0000", 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028898299999999998 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215028+0000", 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120456 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215145+0000", 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116369 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.074 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 62.747175327999997, 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032898250000000001, 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 930 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.075 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216288+0000", 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3260000000000001e-06 2024-04-17T15:38:09.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216297+0000", 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0770000000000008e-06 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216318+0000", 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1869999999999999e-05 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216329+0000", 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.079e-05 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216469+0000", 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013962499999999999 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216725+0000", 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025639100000000002 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.217223+0000", 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049742899999999997 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.218588+0000", 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00136539 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219283+0000", 2024-04-17T15:38:09.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069527 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219452+0000", 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168708 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219577+0000", 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012494900000000001 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.080 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.081 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.081 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:09.082 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:09.083 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:09.078+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:09.183 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:09.181+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:09.257 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:09.258 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:09.258 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:09.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:09.315 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:09.314+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:09.385 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:09.385+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:09.390 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:09.390 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:09.405 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:09.486 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:09.485+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:09.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:38:09.581 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:09.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 71.312862615, 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:38:09.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:38:09.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:38:09.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 71.302098029000007, 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.587 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.297928522000007, 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.593 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:38:09.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:38:09.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:38:09.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.290801096999999, 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:38:09.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.304761670999994, 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:09.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.243856238999996, 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.610 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:38:09.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:38:09.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:38:09.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:38:09.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.225723462000005, 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:38:09.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.222049330000004, 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.621 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:09.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:38:09.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:38:09.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:38:09.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.192934047999998, 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:38:09.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:38:09.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:38:09.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.158901259999993, 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.632 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:09.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:38:09.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:38:09.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.637 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.122905153000005, 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.035488768999997, 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:38:09.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.032950698999997, 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.647 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.780592003999999, 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:09.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:38:09.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:38:09.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:38:09.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.758289914000002, 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:38:09.657 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:38:09.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:38:09.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:38:09.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.686517039000002, 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.663 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:09.668 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.492286839000002, 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:09.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:38:09.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:38:09.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.453011515999997, 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:09.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.332325810999997, 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.680 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:38:09.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:38:09.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:38:09.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.327672864999997, 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:09.685 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:09.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:38:09.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:38:09.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:38:09.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:09.691 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:09.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:09.692 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:09.689+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:09.693 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:09.793 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:09.793+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:09.823 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:09.824 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:09.824 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:09.837 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:09.837 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:09.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:09.853 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:09.854 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:09.870 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:09.870 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:09.888 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:09.888 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:09.894 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:09.890+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:09.897 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:38:09.910 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:09.910 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:09.929 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:09.929 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:09.950 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:09.950 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:09.960 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:09.960 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:09.970 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:09.970 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:09.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:10.019 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:10.018+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:10.096 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:10.094+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:10.140 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:10.141 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:10.155 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:10.199 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:10.198+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:10.297 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:10.297+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:10.334 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:10.334 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:10.349 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:10.399 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:10.397+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:10.475 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:10.476 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:10.490 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:10.499 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:10.497+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:10.600 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:10.598+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:10.611 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:10.611 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:10.626 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:10.701 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:10.698+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:10.801 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:10.801 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:10.802 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:10.798+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:10.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:10.903 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:10.902+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:10.988 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:10.989 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:11.004 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:11.002+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:11.006 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:11.106 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:11.102+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:11.175 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:11.176 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:11.192 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:11.236 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:11.237+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:11.308 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:11.306+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:11.363 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:11.363 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:11.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:11.429 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:11.429+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:11.510 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:11.509+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:11.597 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:11.598 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:11.611 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:11.609+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:11.615 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:11.712 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:11.709+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:11.813 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:11.813+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:11.826 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:11.826 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:11.844 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:11.914 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:11.914+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:11.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:38:11.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:12.032 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:12.033+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:12.060 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:12.060 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:12.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:12.118 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:12.114+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:12.213 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:12.213 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:12.219 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:12.214+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:12.245 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:12.280 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:12.281 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:12.303 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:12.303 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:12.311 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:12.312 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:12.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:12.323 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:12.318+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:12.347 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:12.348 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:12.381 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:12.381 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:12.415 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:12.415 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:12.423 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:12.422+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:12.448 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:12.449 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.219858814000006, 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030098299999999998, 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.501 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 42 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280322+0000", 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6360000000000001e-06 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280344+0000", 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1710000000000001e-05 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280367+0000", 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2646e-05 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280380+0000", 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3574000000000001e-05 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280494+0000", 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114288 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280703+0000", 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000208805 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280947+0000", 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024378799999999999 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.282418+0000", 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014711030000000001 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283224+0000", 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00080576599999999997 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283286+0000", 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1921999999999994e-05 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283330+0000", 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4592000000000003e-05 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.205504668000003, 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003461703, 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.507 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 52 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294678+0000", 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.92e-06 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294691+0000", 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3244999999999999e-05 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294739+0000", 2024-04-17T15:38:12.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7778999999999998e-05 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294753+0000", 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4297999999999999e-05 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294857+0000", 2024-04-17T15:38:12.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104107 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295108+0000", 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025097299999999998 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295309+0000", 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020123600000000001 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297594+0000", 2024-04-17T15:38:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002284379 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297987+0000", 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039364100000000002 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298068+0000", 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1001999999999995e-05 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298136+0000", 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8122999999999998e-05 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:57 7.3 e27/26 7:c609908c:::notify.5:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.195422813999997, 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003535472, 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304759+0000", 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:12.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304773+0000", 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.396e-05 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304796+0000", 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3961999999999999e-05 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304813+0000", 2024-04-17T15:38:12.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6086000000000002e-05 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304947+0000", 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013435899999999999 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304991+0000", 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4221000000000002e-05 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308226+0000", 2024-04-17T15:38:12.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032346190000000002 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308292+0000", 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6282e-05 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:59 7.14 e27/26 7:2b04a3e9:::notify.6:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.192957058000005, 2024-04-17T15:38:12.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033715469999999999, 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307224+0000", 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6169999999999999e-06 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307235+0000", 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1408e-05 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307269+0000", 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3442999999999998e-05 2024-04-17T15:38:12.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307290+0000", 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1353999999999999e-05 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307413+0000", 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000122865 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307452+0000", 2024-04-17T15:38:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9387000000000001e-05 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310518+0000", 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030657919999999999 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310594+0000", 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5680999999999996e-05 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.522 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.522 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:12.522 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.107161708000007, 2024-04-17T15:38:12.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034483930000000001, 2024-04-17T15:38:12.522 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.522 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.522 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.525 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.525 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.526 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 236 2024-04-17T15:38:12.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.526 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:12.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393020+0000", 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7669999999999999e-06 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393034+0000", 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3073e-05 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393065+0000", 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1860000000000003e-05 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393082+0000", 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6855999999999999e-05 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393221+0000", 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013827300000000001 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393434+0000", 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021370199999999999 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393850+0000", 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041539700000000002 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.395194+0000", 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001344121 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396313+0000", 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011190180000000001 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396398+0000", 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5393e-05 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396466+0000", 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7933000000000002e-05 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.094123256000003, 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002805929, 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 280 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406057+0000", 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.203e-06 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406063+0000", 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9610000000000002e-06 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406075+0000", 2024-04-17T15:38:12.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1714e-05 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406082+0000", 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5220000000000004e-06 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406136+0000", 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4211e-05 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406231+0000", 2024-04-17T15:38:12.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4871999999999996e-05 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406377+0000", 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146448 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.407079+0000", 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000701639 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408771+0000", 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001692432 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408820+0000", 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9289999999999997e-05 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408862+0000", 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1637000000000001e-05 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:697 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.840700939000001, 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002810561, 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 697 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659480+0000", 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4759999999999999e-06 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659488+0000", 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1710000000000002e-06 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659509+0000", 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0718000000000001e-05 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659525+0000", 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5894999999999999e-05 2024-04-17T15:38:12.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659651+0000", 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012638300000000001 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659781+0000", 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013031300000000001 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.660036+0000", 2024-04-17T15:38:12.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025453599999999998 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.661296+0000", 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001260331 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662138+0000", 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084126399999999999 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662208+0000", 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0188e-05 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662289+0000", 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.542 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.732372846999993, 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029789930000000001, 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 742 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:12.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767809+0000", 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7329999999999999e-06 2024-04-17T15:38:12.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767822+0000", 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2663999999999999e-05 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767854+0000", 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1875999999999998e-05 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767869+0000", 2024-04-17T15:38:12.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768001+0000", 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013243900000000001 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768229+0000", 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022790500000000001 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768575+0000", 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034550800000000001 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.769817+0000", 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012425019999999999 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770633+0000", 2024-04-17T15:38:12.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081610700000000005 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770720+0000", 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6682999999999997e-05 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770786+0000", 2024-04-17T15:38:12.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5525999999999996e-05 2024-04-17T15:38:12.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.549 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.549 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.686959891000001, 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029893189999999998, 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 760 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813222+0000", 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-06 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813233+0000", 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1703e-05 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813266+0000", 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2772999999999999e-05 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813289+0000", 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2337e-05 2024-04-17T15:38:12.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813434+0000", 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014584400000000001 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813598+0000", 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000163752 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813883+0000", 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000285087 2024-04-17T15:38:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.815043+0000", 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011595819999999999 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816059+0000", 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010158459999999999 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816148+0000", 2024-04-17T15:38:12.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9553000000000001e-05 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816209+0000", 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0585999999999999e-05 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.683002462000005, 2024-04-17T15:38:12.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030744029999999999, 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 762 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.556 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817179+0000", 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-06 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817190+0000", 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1090000000000001e-05 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817225+0000", 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5129999999999997e-05 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817244+0000", 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9029999999999999e-05 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817379+0000", 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000134475 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817606+0000", 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022773199999999999 2024-04-17T15:38:12.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.818089+0000", 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048282400000000002 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.819375+0000", 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012861680000000001 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820098+0000", 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000722841 2024-04-17T15:38:12.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820184+0000", 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5500000000000005e-05 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820251+0000", 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7613000000000005e-05 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.550933689999994, 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029764269999999998, 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 817 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949248+0000", 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4099999999999998e-06 2024-04-17T15:38:12.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949264+0000", 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6364000000000001e-05 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949296+0000", 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1513000000000001e-05 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949317+0000", 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1403000000000002e-05 2024-04-17T15:38:12.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949509+0000", 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019130500000000001 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949747+0000", 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000238039 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.950063+0000", 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031621399999999999 2024-04-17T15:38:12.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.951228+0000", 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001165379 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952068+0000", 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000839674 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952156+0000", 2024-04-17T15:38:12.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8313000000000006e-05 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952222+0000", 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5813000000000002e-05 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.54699703, 2024-04-17T15:38:12.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029501589999999999, 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 819 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953184+0000", 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.973e-06 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953198+0000", 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3657e-05 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953229+0000", 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1486000000000003e-05 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953248+0000", 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187000000000001e-05 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953356+0000", 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107909 2024-04-17T15:38:12.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953484+0000", 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012820600000000001 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953773+0000", 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028948800000000002 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.954862+0000", 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001088365 2024-04-17T15:38:12.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.955975+0000", 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001113326 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956061+0000", 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6470000000000004e-05 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956133+0000", 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1092000000000003e-05 2024-04-17T15:38:12.572 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.495642879000002, 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029884, 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.573 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 841 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004539+0000", 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2630000000000002e-06 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004551+0000", 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2680000000000001e-05 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004582+0000", 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0700000000000001e-05 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004597+0000", 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.501e-05 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004732+0000", 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013490900000000001 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004956+0000", 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022391800000000001 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.005298+0000", 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034173100000000001 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.006602+0000", 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013043810000000001 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007387+0000", 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000784635 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007467+0000", 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0661999999999994e-05 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007525+0000", 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7510999999999999e-05 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.578 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.480720735999995, 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031389679999999998, 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 847 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019461+0000", 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.277e-06 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019472+0000", 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1319e-05 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019503+0000", 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0626999999999997e-05 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019517+0000", 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019652+0000", 2024-04-17T15:38:12.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013442799999999999 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019977+0000", 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032536300000000001 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.020521+0000", 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00054383700000000003 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.021843+0000", 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001321593 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022433+0000", 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058991600000000001 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022517+0000", 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4845999999999994e-05 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022598+0000", 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0185999999999994e-05 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.431761695000006, 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034503820000000001, 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 868 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068420+0000", 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1330000000000002e-06 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068432+0000", 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2646000000000001e-05 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068463+0000", 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0170000000000001e-05 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068477+0000", 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4797000000000001e-05 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068645+0000", 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016787200000000001 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068999+0000", 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035414099999999998 2024-04-17T15:38:12.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.069565+0000", 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056531599999999995 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.070818+0000", 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001252932 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071707+0000", 2024-04-17T15:38:12.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088886 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071793+0000", 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6885999999999994e-05 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071868+0000", 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4629000000000007e-05 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.339115312999994, 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030204519999999999, 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 907 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161067+0000", 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4329999999999998e-06 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161077+0000", 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0910000000000001e-05 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161109+0000", 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1288999999999998e-05 2024-04-17T15:38:12.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161123+0000", 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4739999999999999e-05 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161242+0000", 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011889 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161468+0000", 2024-04-17T15:38:12.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022609099999999999 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161805+0000", 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612099999999999 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.162878+0000", 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001073606 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.163928+0000", 2024-04-17T15:38:12.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00104958 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164017+0000", 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9284999999999996e-05 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164085+0000", 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7507000000000003e-05 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.238338868, 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003409006, 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 949 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261844+0000", 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.993e-06 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261857+0000", 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261902+0000", 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5286e-05 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261926+0000", 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3757e-05 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262112+0000", 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018562900000000001 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262494+0000", 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038215999999999999 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262901+0000", 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040692000000000001 2024-04-17T15:38:12.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.264939+0000", 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020382400000000002 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265106+0000", 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016660500000000001 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265187+0000", 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:38:12.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265250+0000", 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2063000000000005e-05 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.234039374999995, 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032687240000000002, 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.601 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 951 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266142+0000", 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6640000000000001e-06 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266151+0000", 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5829999999999996e-06 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266177+0000", 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.55e-05 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266189+0000", 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2139e-05 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266301+0000", 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011170700000000001 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266418+0000", 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117599 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266690+0000", 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027164099999999998 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.268256+0000", 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001565842 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269168+0000", 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00091194099999999999 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269297+0000", 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012897900000000001 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269409+0000", 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112129 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.606 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.223235700000004, 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030567260000000001, 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.607 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 955 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276946+0000", 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6139999999999999e-06 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276959+0000", 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.279e-05 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276992+0000", 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2981999999999997e-05 2024-04-17T15:38:12.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277008+0000", 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6127e-05 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277162+0000", 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015356199999999999 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277427+0000", 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026516799999999998 2024-04-17T15:38:12.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277784+0000", 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035701500000000002 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279283+0000", 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499479 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279849+0000", 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056583000000000002 2024-04-17T15:38:12.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279935+0000", 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5649000000000006e-05 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280000+0000", 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5510000000000001e-05 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.612 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.219257098, 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028646269999999998, 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 957 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280924+0000", 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.894e-06 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280934+0000", 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6299999999999993e-06 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280960+0000", 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280986+0000", 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5913000000000001e-05 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281095+0000", 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109212 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281215+0000", 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120469 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281472+0000", 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025682199999999997 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.282766+0000", 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001293521 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283642+0000", 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087648000000000001 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283727+0000", 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4874000000000001e-05 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:12.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283787+0000", 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9892000000000002e-05 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:12.618 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:12.620 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:12.620 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:12.618+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:12.720 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:12.721+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:12.821 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:12.821+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:12.830 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:12.830 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:12.831 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:12.831 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:12.849 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:12.922 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:12.922+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:13.023 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:13.022+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:13.066 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:13.066 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:13.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:13.128 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:13.129+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:13.225 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:13.225+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:38:13.263 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.263 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 73.009019550000005, 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063603720000000004, 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "reached pg", 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 44 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253462+0000", 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253499+0000", 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7339999999999998e-05 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253536+0000", 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6746999999999999e-05 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253562+0000", 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6095999999999999e-05 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253940+0000", 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037773800000000002 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for peered", 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253962+0000", 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2566e-05 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259497+0000", 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055350269999999997 2024-04-17T15:38:13.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259819+0000", 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000321792 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040977412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.958691318999996, 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049681100000000004, 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.268 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 57 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:13.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303788+0000", 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.55e-06 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303797+0000", 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8820000000000007e-06 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303842+0000", 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4231999999999999e-05 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303856+0000", 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4307e-05 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303983+0000", 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127577 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304194+0000", 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000210299 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304573+0000", 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037939199999999999 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.305923+0000", 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013502500000000001 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308569+0000", 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026456159999999999 2024-04-17T15:38:13.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308655+0000", 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5539999999999998e-05 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308755+0000", 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010046499999999999 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040977413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.956063900000004, 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047062060000000001, 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 59 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306416+0000", 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306424+0000", 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7519999999999996e-06 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306446+0000", 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2155e-05 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306456+0000", 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0523000000000001e-05 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306569+0000", 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112277 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306739+0000", 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170688 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307048+0000", 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030829700000000002 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310444+0000", 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033961629999999998 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310828+0000", 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038433500000000003 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310956+0000", 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127997 2024-04-17T15:38:13.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.311121+0000", 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016447900000000001 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.980072867000004, 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059605389999999999, 2024-04-17T15:38:13.279 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 207 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282410+0000", 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3959999999999999e-06 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282431+0000", 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0996999999999999e-05 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282475+0000", 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4703000000000002e-05 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282501+0000", 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5627e-05 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282659+0000", 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015803900000000001 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282916+0000", 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025698099999999998 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.283628+0000", 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00071140199999999998 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.286242+0000", 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002614782 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288105+0000", 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862437 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288260+0000", 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015568900000000001 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288366+0000", 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000105486 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.942068281000005, 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033450900000000002, 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.285 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 216 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:13.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320413+0000", 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.65e-06 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320426+0000", 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2972999999999999e-05 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:13.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2326999999999997e-05 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320473+0000", 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4763000000000001e-05 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320604+0000", 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013095899999999999 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320836+0000", 2024-04-17T15:38:13.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000232012 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.321267+0000", 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043098000000000002 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.322958+0000", 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016909189999999999 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323607+0000", 2024-04-17T15:38:13.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00064901100000000001 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323691+0000", 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4383999999999997e-05 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323755+0000", 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4111999999999999e-05 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.901836349000007, 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036511180000000001, 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 227 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360644+0000", 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:38:13.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360656+0000", 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.217e-05 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360689+0000", 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2778999999999999e-05 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360704+0000", 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5187e-05 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360849+0000", 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144315 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361057+0000", 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020802200000000001 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361490+0000", 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043335100000000001 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.363127+0000", 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001636832 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364063+0000", 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093582599999999995 2024-04-17T15:38:13.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364177+0000", 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011425300000000001 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364293+0000", 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115943 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.296 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.893901447999994, 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003177409, 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 229 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368579+0000", 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2740000000000002e-06 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368591+0000", 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1456e-05 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368623+0000", 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2474000000000001e-05 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368638+0000", 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.502e-05 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368758+0000", 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000119505 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368990+0000", 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023266199999999999 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.369391+0000", 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040097100000000002 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.370944+0000", 2024-04-17T15:38:13.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015525389999999999 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371613+0000", 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00066936899999999995 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371693+0000", 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9886000000000001e-05 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371754+0000", 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1253000000000005e-05 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.886818622999996, 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033033200000000002, 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.302 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 231 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375662+0000", 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375673+0000", 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1678999999999999e-05 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375706+0000", 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2293999999999999e-05 2024-04-17T15:38:13.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375721+0000", 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.522e-05 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375868+0000", 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014661200000000001 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376071+0000", 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020339199999999999 2024-04-17T15:38:13.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376467+0000", 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039612099999999998 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.377887+0000", 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001419696 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378819+0000", 2024-04-17T15:38:13.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093196000000000001 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378902+0000", 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2977000000000002e-05 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378963+0000", 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1241999999999994e-05 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:345 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.845263153000005, 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003233755, 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 345 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417216+0000", 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417223+0000", 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3969999999999999e-06 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417240+0000", 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7711e-05 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417250+0000", 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3789999999999995e-06 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417308+0000", 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8663999999999999e-05 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417398+0000", 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9524000000000005e-05 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417555+0000", 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015700299999999999 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.418480+0000", 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00092510400000000005 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420343+0000", 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862596 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420402+0000", 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.944e-05 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420449+0000", 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6832000000000002e-05 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:398 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.828690058000007, 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041188789999999998, 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 398 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433789+0000", 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433794+0000", 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1490000000000002e-06 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433807+0000", 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2334000000000001e-05 2024-04-17T15:38:13.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433813+0000", 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1240000000000002e-06 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433875+0000", 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2309000000000003e-05 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433976+0000", 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100577 2024-04-17T15:38:13.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434109+0000", 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013374099999999999 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434711+0000", 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060139999999999998 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437854+0000", 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031429069999999999 2024-04-17T15:38:13.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437883+0000", 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9539999999999998e-05 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437907+0000", 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3947999999999998e-05 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.318 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:402 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.826790039000002, 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047817750000000003, 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 402 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435689+0000", 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.850000000000001e-07 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435693+0000", 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435705+0000", 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1484000000000001e-05 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435713+0000", 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6699999999999994e-06 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435756+0000", 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3519999999999997e-05 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435812+0000", 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5998000000000002e-05 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435942+0000", 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000129596 2024-04-17T15:38:13.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.436441+0000", 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049949700000000001 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440415+0000", 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039740690000000002 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440444+0000", 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9156999999999999e-05 2024-04-17T15:38:13.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440470+0000", 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5499000000000001e-05 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:522 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.755637664000005, 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031631699999999999, 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.324 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 522 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:13.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506842+0000", 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1629999999999999e-06 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506847+0000", 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506861+0000", 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3811e-05 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506871+0000", 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5429999999999999e-06 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506925+0000", 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4740000000000001e-05 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507027+0000", 2024-04-17T15:38:13.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101766 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507209+0000", 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018180900000000001 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509722+0000", 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025127539999999999 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509938+0000", 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021666099999999999 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509978+0000", 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9987000000000002e-05 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.510004+0000", 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5316999999999998e-05 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:607 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.681856202999995, 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003551916, 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 607 2024-04-17T15:38:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580623+0000", 2024-04-17T15:38:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4020000000000001e-06 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580632+0000", 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1459999999999996e-06 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580654+0000", 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2446000000000002e-05 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580665+0000", 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1165000000000001e-05 2024-04-17T15:38:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580780+0000", 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114973 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580917+0000", 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013664300000000001 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581189+0000", 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027190100000000001 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582345+0000", 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00115599 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583899+0000", 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015540319999999999 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584059+0000", 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016074500000000001 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584174+0000", 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114473 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:611 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.675666254000006, 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033528170000000001, 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 611 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586814+0000", 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9860000000000001e-06 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586825+0000", 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0686000000000001e-05 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586853+0000", 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8365e-05 2024-04-17T15:38:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586866+0000", 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587014+0000", 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014742600000000001 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587227+0000", 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021381800000000001 2024-04-17T15:38:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587506+0000", 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027870100000000001 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.588524+0000", 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001018157 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.589970+0000", 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014462590000000001 2024-04-17T15:38:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590061+0000", 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0138999999999999e-05 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590165+0000", 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104168 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.589851577000005, 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034329339999999999, 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 703 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672629+0000", 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0080000000000001e-06 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672638+0000", 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1419999999999999e-06 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672664+0000", 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5905e-05 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672676+0000", 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2337000000000001e-05 2024-04-17T15:38:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672840+0000", 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016395 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673166+0000", 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000326275 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673711+0000", 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000545047 2024-04-17T15:38:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675036+0000", 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013244940000000001 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675808+0000", 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00077264900000000004 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675951+0000", 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014292499999999999 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.676060+0000", 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010820200000000001 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.346 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.560677565000006, 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003556245, 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 715 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701803+0000", 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701818+0000", 2024-04-17T15:38:13.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5223e-05 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701849+0000", 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1035999999999999e-05 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701866+0000", 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6643999999999999e-05 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702012+0000", 2024-04-17T15:38:13.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014634700000000001 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702345+0000", 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033299399999999998 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702866+0000", 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052063999999999995 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.704096+0000", 2024-04-17T15:38:13.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001229988 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705095+0000", 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00099944500000000006 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705240+0000", 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144287 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705357+0000", 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117191 2024-04-17T15:38:13.351 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.405950954000005, 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035344460000000001, 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.352 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 778 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856530+0000", 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3199999999999998e-06 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856541+0000", 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.183e-05 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856573+0000", 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2060000000000001e-05 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856590+0000", 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6356000000000001e-05 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856741+0000", 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158899999999999 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857099+0000", 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035803499999999998 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857663+0000", 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056350599999999997 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859015+0000", 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013523299999999999 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859910+0000", 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00089519100000000004 2024-04-17T15:38:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859996+0000", 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5673000000000005e-05 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.860062+0000", 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5555999999999994e-05 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.292143181, 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032371169999999999, 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 826 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970337+0000", 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970349+0000", 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1440000000000001e-05 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970381+0000", 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1896000000000001e-05 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970395+0000", 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4867e-05 2024-04-17T15:38:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970554+0000", 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015837199999999999 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970926+0000", 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037184099999999998 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.971531+0000", 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060493600000000004 2024-04-17T15:38:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.972848+0000", 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013169340000000001 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973421+0000", 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057373600000000004 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973506+0000", 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4285999999999999e-05 2024-04-17T15:38:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973572+0000", 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6586000000000002e-05 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.201135058000006, 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003083728, 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 865 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061345+0000", 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061356+0000", 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0823e-05 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061387+0000", 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0766999999999999e-05 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061402+0000", 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5379999999999998e-05 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061519+0000", 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117265 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061739+0000", 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000219106 2024-04-17T15:38:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.062054+0000", 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031500400000000002 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.063247+0000", 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011935979999999999 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064266+0000", 2024-04-17T15:38:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001019023 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064359+0000", 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3040000000000004e-05 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064427+0000", 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7665999999999999e-05 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.030093863999994, 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031575179999999998, 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 937 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232386+0000", 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232398+0000", 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1864e-05 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232426+0000", 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232440+0000", 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.412e-05 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232621+0000", 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018099899999999999 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232854+0000", 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023273400000000001 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.233176+0000", 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032190499999999999 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.234217+0000", 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001040673 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235396+0000", 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001179835 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235480+0000", 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3473000000000005e-05 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235542+0000", 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2042e-05 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:13.374 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:13.376 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:13.377 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:13.373+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:13.477 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:13.474+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:13.513 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:13.513 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:13.513 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:13.513 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:13.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:13.615 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:13.614+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:13.678 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:13.677+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:13.696 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:13.696 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:13.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:13.800 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:13.798+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:13.880 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:13.878+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:13.887 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:46 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 71.612484999000003, 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006071562, 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273829+0000", 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.984e-06 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273845+0000", 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.541e-05 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273886+0000", 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1556e-05 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273920+0000", 2024-04-17T15:38:13.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3668999999999999e-05 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274134+0000", 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000213952 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274182+0000", 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7706e-05 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279811+0000", 2024-04-17T15:38:13.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056294029999999998 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279899+0000", 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7881999999999996e-05 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:47 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 71.603211740000006, 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048203359999999997, 2024-04-17T15:38:13.892 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283103+0000", 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283119+0000", 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6509000000000001e-05 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283153+0000", 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4037e-05 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283175+0000", 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1212999999999998e-05 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283298+0000", 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123712 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283344+0000", 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6136e-05 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287839+0000", 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004494634 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287921+0000", 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1932000000000001e-05 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:13.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.583861248999995, 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032981249999999998, 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 211 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302454+0000", 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302467+0000", 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2996999999999999e-05 2024-04-17T15:38:13.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302501+0000", 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4075999999999997e-05 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302525+0000", 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3737e-05 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302682+0000", 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157038 2024-04-17T15:38:13.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302937+0000", 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025471400000000001 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.303366+0000", 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042908300000000003 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305046+0000", 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001680193 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305575+0000", 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052928199999999995 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305676+0000", 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100382 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305749+0000", 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3510000000000006e-05 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.506086725000003, 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032452660000000001, 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.902 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 232 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380228+0000", 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380240+0000", 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380274+0000", 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3957e-05 2024-04-17T15:38:13.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380297+0000", 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3319000000000002e-05 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380435+0000", 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137596 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380662+0000", 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022724099999999999 2024-04-17T15:38:13.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.381091+0000", 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000429336 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.382850+0000", 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017586800000000001 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383310+0000", 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000460092 2024-04-17T15:38:13.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383400+0000", 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9575999999999998e-05 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383471+0000", 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1268999999999998e-05 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.907 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.479665632999996, 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036624269999999998, 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 278 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406649+0000", 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6000000000000001e-06 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406663+0000", 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3845999999999999e-05 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406699+0000", 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5726000000000003e-05 2024-04-17T15:38:13.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406722+0000", 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.304e-05 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406888+0000", 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166272 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407203+0000", 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031472299999999999 2024-04-17T15:38:13.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407899+0000", 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069595699999999998 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.409321+0000", 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014219759999999999 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410041+0000", 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00072015299999999996 2024-04-17T15:38:13.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410183+0000", 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142003 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410309+0000", 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126131 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.913 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:353 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.467328448000004, 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047116850000000002, 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 353 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418987+0000", 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.853e-06 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419003+0000", 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5973000000000001e-05 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419043+0000", 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9975999999999998e-05 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419064+0000", 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1607000000000002e-05 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419233+0000", 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168908 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419516+0000", 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028298800000000002 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419933+0000", 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000416329 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421589+0000", 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016564139999999999 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423544+0000", 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019552250000000001 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423632+0000", 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7416000000000005e-05 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423696+0000", 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3996000000000002e-05 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:398 6.6 e30/24 6:66924383:reshard::reshard.0000000005:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.451060806000001, 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033955729999999998, 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435253+0000", 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.666e-06 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435266+0000", 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2564e-05 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435303+0000", 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7568999999999999e-05 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435322+0000", 2024-04-17T15:38:13.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8743e-05 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435474+0000", 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015201900000000001 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435532+0000", 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7902000000000002e-05 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438561+0000", 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030286449999999999 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438647+0000", 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6465000000000006e-05 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.392204589000002, 2024-04-17T15:38:13.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003409586, 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494109+0000", 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.595e-06 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494118+0000", 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1969999999999996e-06 2024-04-17T15:38:13.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494140+0000", 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2617e-05 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494151+0000", 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1174e-05 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494293+0000", 2024-04-17T15:38:13.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014123900000000001 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494691+0000", 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039822399999999997 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495275+0000", 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058460000000000001 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497150+0000", 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018747550000000001 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497292+0000", 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141321 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497400+0000", 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010853099999999999 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497517+0000", 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117333 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:551 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.352846391, 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003045336, 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.929 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 551 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533469+0000", 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.897e-06 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533486+0000", 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816e-05 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533523+0000", 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6993999999999999e-05 2024-04-17T15:38:13.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533540+0000", 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7186000000000001e-05 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533699+0000", 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015882799999999999 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534082+0000", 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038348700000000001 2024-04-17T15:38:13.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534670+0000", 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058795799999999997 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.535977+0000", 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001306357 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536289+0000", 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000312906 2024-04-17T15:38:13.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536410+0000", 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120999 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536511+0000", 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100908 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:649 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.267350673999999, 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031209179999999999, 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 649 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618964+0000", 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6120000000000001e-06 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618977+0000", 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2574e-05 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619012+0000", 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5051e-05 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619032+0000", 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0071000000000001e-05 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619181+0000", 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148627 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619432+0000", 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251081 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619949+0000", 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051755200000000001 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621369+0000", 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00141994 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621936+0000", 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056712400000000001 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622018+0000", 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1652999999999999e-05 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622083+0000", 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4633000000000003e-05 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.197924763000003, 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032122729999999999, 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.940 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 709 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:13.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688390+0000", 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3039999999999999e-06 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688402+0000", 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2082999999999999e-05 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688432+0000", 2024-04-17T15:38:13.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0332999999999999e-05 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688447+0000", 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5046e-05 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688568+0000", 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121026 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688772+0000", 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020336799999999999 2024-04-17T15:38:13.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.689092+0000", 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032027999999999999 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.690444+0000", 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013523470000000001 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691292+0000", 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084744900000000001 2024-04-17T15:38:13.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691459+0000", 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166692 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691600+0000", 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141345 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.945 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.155893851000002, 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002981652, 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 726 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730421+0000", 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1399999999999998e-06 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730436+0000", 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5233e-05 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730468+0000", 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1574e-05 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730482+0000", 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4693e-05 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730616+0000", 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013382800000000001 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730851+0000", 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000235455 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.731336+0000", 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048426600000000002 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.732933+0000", 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001597198 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733250+0000", 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031682299999999999 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733330+0000", 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9752999999999993e-05 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733400+0000", 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0689e-05 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.152556748999999, 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003233166, 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.951 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 727 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733758+0000", 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.114e-06 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733769+0000", 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1226000000000001e-05 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733792+0000", 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2580000000000001e-05 2024-04-17T15:38:13.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733804+0000", 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2763e-05 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733944+0000", 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013943199999999999 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734191+0000", 2024-04-17T15:38:13.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024684799999999998 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734584+0000", 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039304900000000002 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.735780+0000", 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011960320000000001 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736834+0000", 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010541400000000001 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736925+0000", 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1101999999999996e-05 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736989+0000", 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3880000000000005e-05 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.788329000999994, 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033824100000000002, 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 880 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097987+0000", 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1159999999999999e-06 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098022+0000", 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-05 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098054+0000", 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1983000000000002e-05 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098069+0000", 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512999999999999e-05 2024-04-17T15:38:13.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098228+0000", 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015874500000000001 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098633+0000", 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040438300000000002 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.099238+0000", 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060534800000000002 2024-04-17T15:38:13.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.100508+0000", 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00127024 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101208+0000", 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069981399999999999 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101295+0000", 2024-04-17T15:38:13.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6722000000000001e-05 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101366+0000", 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1145999999999999e-05 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.783835382000007, 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032254129999999999, 2024-04-17T15:38:13.965 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 882 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102479+0000", 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102490+0000", 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0380000000000001e-05 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102521+0000", 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1529999999999998e-05 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102537+0000", 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.577e-05 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102681+0000", 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102934+0000", 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025325100000000002 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.103425+0000", 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049086500000000005 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.104689+0000", 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012646879999999999 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105549+0000", 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085963200000000004 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105637+0000", 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8438999999999998e-05 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105702+0000", 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5005999999999994e-05 2024-04-17T15:38:13.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.780349498000007, 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030913970000000001, 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.971 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105965+0000", 2024-04-17T15:38:13.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105975+0000", 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9729999999999992e-06 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106001+0000", 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6253000000000001e-05 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106015+0000", 2024-04-17T15:38:13.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3353000000000001e-05 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106141+0000", 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012648600000000001 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106412+0000", 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027110699999999998 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:13.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106757+0000", 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000344657 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108260+0000", 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015027949999999999 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108842+0000", 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058205799999999999 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108934+0000", 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1792999999999993e-05 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.109054+0000", 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120665 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.710235456000007, 2024-04-17T15:38:13.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030928700000000002, 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 913 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176080+0000", 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8030000000000001e-06 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176092+0000", 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2306999999999999e-05 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176122+0000", 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9569000000000001e-05 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176143+0000", 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.156e-05 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176345+0000", 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020190099999999999 2024-04-17T15:38:13.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176576+0000", 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231091 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176903+0000", 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000326874 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.178180+0000", 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001276868 2024-04-17T15:38:13.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179011+0000", 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083103199999999999 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179102+0000", 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0919000000000001e-05 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179170+0000", 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:38:13.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.681589849999995, 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031669530000000001, 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.982 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 925 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204725+0000", 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204737+0000", 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2116000000000001e-05 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204768+0000", 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0676999999999998e-05 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204789+0000", 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1739999999999999e-05 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204946+0000", 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015635099999999999 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205169+0000", 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223062 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205492+0000", 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032312699999999998 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.206626+0000", 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011343589999999999 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207735+0000", 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011090659999999999 2024-04-17T15:38:13.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207824+0000", 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8603000000000005e-05 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207890+0000", 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5642000000000006e-05 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.674190284000005, 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030226580000000001, 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 928 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212124+0000", 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1840000000000002e-06 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212136+0000", 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2106000000000001e-05 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212176+0000", 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9643e-05 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212196+0000", 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212325+0000", 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012877200000000001 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212601+0000", 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000275588 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212945+0000", 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034397600000000001 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214619+0000", 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016741779999999999 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214908+0000", 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028898299999999998 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215028+0000", 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120456 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215145+0000", 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116369 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.670025300000006, 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032898250000000001, 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:13.993 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 930 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:13.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216288+0000", 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3260000000000001e-06 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216297+0000", 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0770000000000008e-06 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216318+0000", 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1869999999999999e-05 2024-04-17T15:38:13.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216329+0000", 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.079e-05 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216469+0000", 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013962499999999999 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216725+0000", 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025639100000000002 2024-04-17T15:38:13.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.217223+0000", 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049742899999999997 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.218588+0000", 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00136539 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219283+0000", 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069527 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219452+0000", 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168708 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219577+0000", 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012494900000000001 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:13.998 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:14.000 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:14.000 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:13.997+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:14.101 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:14.098+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:14.175 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:14.175 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:14.175 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:14.175 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:14.191 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:14.201 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:14.201+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:14.303 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:14.298+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:14.367 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:14.367 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:14.367 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:14.367 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:14.367 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:14.382 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:14.424 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:14.422+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:14.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:14.520 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:14.521+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:14.556 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:14.556 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:14.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:14.556 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:14.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.556 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:14.556 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:14.556 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.287988743, 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:38:14.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:14.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:38:14.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.562 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.277224157000006, 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:38:14.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:38:14.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:38:14.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:38:14.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:14.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:38:14.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.273054650000006, 2024-04-17T15:38:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:38:14.572 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:38:14.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:38:14.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:14.578 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.265927224999999, 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:14.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:38:14.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:38:14.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:38:14.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:38:14.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.279887798999994, 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.584 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:38:14.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:38:14.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.589 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.218982366999995, 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.200849590000004, 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:38:14.595 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:38:14.600 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.197175458000004, 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.601 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.168060175999997, 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.134027388000007, 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:38:14.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:38:14.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:38:14.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.617 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.098031281000004, 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:38:14.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:38:14.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:38:14.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:38:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:38:14.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.010614896999996, 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:38:14.623 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:38:14.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.627 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.008076826999996, 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.631 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.755718131999998, 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.632 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:38:14.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:38:14.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:38:14.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:38:14.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.733416042000002, 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.661643166999994, 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.643 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:38:14.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:38:14.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:38:14.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:38:14.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.467412967000001, 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:38:14.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:38:14.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.428137644000003, 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.654 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.659 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.307451939000003, 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:14.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.302798992999996, 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:14.665 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:14.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:38:14.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:38:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:38:14.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:14.670 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:14.672 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:14.672 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:14.670+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:14.673 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:14.673 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:14.704 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:14.734 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:14.735 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:14.765 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:14.765 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:14.772 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:14.770+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:14.797 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:14.797 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:14.829 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:14.829 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:14.847 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:14.848 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:14.862 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:14.863 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:14.892 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:14.904 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:14.902+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:14.974 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:14.973+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:15.024 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:15.024 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:15.039 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:15.083 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:15.082+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:15.160 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:15.160 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:15.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:15.216 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:15.214+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:15.276 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:15.277+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:15.344 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:15.344 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:15.360 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:15.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:38:15.407 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:15.406+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:15.479 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:15.477+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:15.527 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:15.527 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:15.528 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:15.580 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:15.581+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:15.681 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:15.681+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:15.701 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:15.701 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:15.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:15.782 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:15.781+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:15.883 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:15.882+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:15.886 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:15.886 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:15.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:15.984 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:15.986+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:16.085 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:16.085+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:16.116 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:16.117 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:16.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:16.224 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:16.225+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:38:16.287 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:16.282+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:16.353 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:16.353 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:16.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:16.388 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:16.390+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:16.489 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:16.486+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:16.541 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:16.541 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:16.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:16.604 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:16.605+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:16.690 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:16.689+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:16.728 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:16.728 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:16.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:16.793 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:16.793+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:16.892 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:16.893+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:16.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:16.962 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:16.962 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:16.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:16.993 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:16.994+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:17.094 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:17.093+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:17.119 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:17.150 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:17.150 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:17.154 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:17.154 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:17.172 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:17.180 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:17.181 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:17.195 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:17.190+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:17.211 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:17.211 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:17.246 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:17.247 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:17.279 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:17.295 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:17.293+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:17.312 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:17.345 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:17.350 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:17.351 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:17.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:17.412 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:17.413+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:17.498 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:17.494+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:17.582 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:17.582 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 79.301699748999994, 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030098299999999998, 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4440", 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 42 2024-04-17T15:38:17.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280321+0000", 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280322+0000", 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6360000000000001e-06 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280344+0000", 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1710000000000001e-05 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280367+0000", 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2646e-05 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280380+0000", 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3574000000000001e-05 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280494+0000", 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114288 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280703+0000", 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000208805 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:17.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.280947+0000", 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024378799999999999 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.282418+0000", 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014711030000000001 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283224+0000", 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00080576599999999997 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283286+0000", 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1921999999999994e-05 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:58.283330+0000", 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4592000000000003e-05 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 75.287345603000006, 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003461703, 2024-04-17T15:38:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 52 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294675+0000", 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294678+0000", 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.92e-06 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294691+0000", 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3244999999999999e-05 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294739+0000", 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7778999999999998e-05 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294753+0000", 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4297999999999999e-05 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.294857+0000", 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104107 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295108+0000", 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025097299999999998 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.295309+0000", 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020123600000000001 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297594+0000", 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002284379 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.297987+0000", 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039364100000000002 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298068+0000", 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1001999999999995e-05 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.298136+0000", 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8122999999999998e-05 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:57 7.3 e27/26 7:c609908c:::notify.5:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 75.277263748999999, 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003535472, 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304757+0000", 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304759+0000", 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304773+0000", 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.396e-05 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304796+0000", 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3961999999999999e-05 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304813+0000", 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6086000000000002e-05 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304947+0000", 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013435899999999999 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304991+0000", 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4221000000000002e-05 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308226+0000", 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032346190000000002 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308292+0000", 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6282e-05 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:59 7.14 e27/26 7:2b04a3e9:::notify.6:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 75.274797993000007, 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033715469999999999, 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.598 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307222+0000", 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307224+0000", 2024-04-17T15:38:17.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6169999999999999e-06 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307235+0000", 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1408e-05 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307269+0000", 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3442999999999998e-05 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307290+0000", 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1353999999999999e-05 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307413+0000", 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000122865 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307452+0000", 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9387000000000001e-05 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310518+0000", 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030657919999999999 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310594+0000", 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5680999999999996e-05 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:17.602 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.189002642999995, 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034483930000000001, 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 236 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:17.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393018+0000", 2024-04-17T15:38:17.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393020+0000", 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7669999999999999e-06 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393034+0000", 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3073e-05 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393065+0000", 2024-04-17T15:38:17.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1860000000000003e-05 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393082+0000", 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6855999999999999e-05 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393221+0000", 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013827300000000001 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393434+0000", 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021370199999999999 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.393850+0000", 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041539700000000002 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.395194+0000", 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001344121 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396313+0000", 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011190180000000001 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396398+0000", 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5393e-05 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.396466+0000", 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7933000000000002e-05 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:280 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.175964191000006, 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002805929, 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 280 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.609 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406056+0000", 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406057+0000", 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.203e-06 2024-04-17T15:38:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406063+0000", 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9610000000000002e-06 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406075+0000", 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1714e-05 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406082+0000", 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5220000000000004e-06 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406136+0000", 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4211e-05 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406231+0000", 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4871999999999996e-05 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.406377+0000", 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146448 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.407079+0000", 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000701639 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408771+0000", 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001692432 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408820+0000", 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9289999999999997e-05 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.408862+0000", 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1637000000000001e-05 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:697 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.614 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.922541874000004, 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002810561, 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 697 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659478+0000", 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659480+0000", 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4759999999999999e-06 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659488+0000", 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1710000000000002e-06 2024-04-17T15:38:17.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659509+0000", 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0718000000000001e-05 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659525+0000", 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5894999999999999e-05 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659651+0000", 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012638300000000001 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.659781+0000", 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013031300000000001 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.660036+0000", 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025453599999999998 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.661296+0000", 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001260331 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662138+0000", 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084126399999999999 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662208+0000", 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0188e-05 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.662289+0000", 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.619 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.814213781999996, 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029789930000000001, 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 742 2024-04-17T15:38:17.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767807+0000", 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767809+0000", 2024-04-17T15:38:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7329999999999999e-06 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767822+0000", 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2663999999999999e-05 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767854+0000", 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1875999999999998e-05 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.767869+0000", 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.505e-05 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768001+0000", 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013243900000000001 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768229+0000", 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022790500000000001 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.768575+0000", 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034550800000000001 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.769817+0000", 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012425019999999999 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770633+0000", 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00081610700000000005 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770720+0000", 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6682999999999997e-05 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.770786+0000", 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5525999999999996e-05 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.625 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.768800826000003, 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029893189999999998, 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 760 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813220+0000", 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813222+0000", 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-06 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813233+0000", 2024-04-17T15:38:17.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1703e-05 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813266+0000", 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2772999999999999e-05 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813289+0000", 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2337e-05 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813434+0000", 2024-04-17T15:38:17.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014584400000000001 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813598+0000", 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000163752 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.813883+0000", 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000285087 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.815043+0000", 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011595819999999999 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816059+0000", 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010158459999999999 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816148+0000", 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9553000000000001e-05 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.816209+0000", 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0585999999999999e-05 2024-04-17T15:38:17.630 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.764843397000007, 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030744029999999999, 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 762 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817177+0000", 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817179+0000", 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-06 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817190+0000", 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1090000000000001e-05 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817225+0000", 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5129999999999997e-05 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817244+0000", 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9029999999999999e-05 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817379+0000", 2024-04-17T15:38:17.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000134475 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.817606+0000", 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022773199999999999 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.818089+0000", 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048282400000000002 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.819375+0000", 2024-04-17T15:38:17.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0012861680000000001 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820098+0000", 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000722841 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820184+0000", 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5500000000000005e-05 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.820251+0000", 2024-04-17T15:38:17.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7613000000000005e-05 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.632774624999996, 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029764269999999998, 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.636 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 817 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949246+0000", 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949248+0000", 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4099999999999998e-06 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949264+0000", 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6364000000000001e-05 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949296+0000", 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1513000000000001e-05 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949317+0000", 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1403000000000002e-05 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949509+0000", 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019130500000000001 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.949747+0000", 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000238039 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.950063+0000", 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031621399999999999 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.951228+0000", 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001165379 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952068+0000", 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000839674 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952156+0000", 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8313000000000006e-05 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.952222+0000", 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5813000000000002e-05 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.628837965000002, 2024-04-17T15:38:17.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029501589999999999, 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 819 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953182+0000", 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953184+0000", 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.973e-06 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953198+0000", 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3657e-05 2024-04-17T15:38:17.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953229+0000", 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1486000000000003e-05 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953248+0000", 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187000000000001e-05 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953356+0000", 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107909 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953484+0000", 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012820600000000001 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.953773+0000", 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028948800000000002 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.954862+0000", 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001088365 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.955975+0000", 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001113326 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956061+0000", 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6470000000000004e-05 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.956133+0000", 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1092000000000003e-05 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.577483814000004, 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029884, 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 841 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.647 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004537+0000", 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004539+0000", 2024-04-17T15:38:17.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2630000000000002e-06 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004551+0000", 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2680000000000001e-05 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004582+0000", 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0700000000000001e-05 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004597+0000", 2024-04-17T15:38:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.501e-05 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004732+0000", 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013490900000000001 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.004956+0000", 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022391800000000001 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.005298+0000", 2024-04-17T15:38:17.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034173100000000001 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.006602+0000", 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013043810000000001 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007387+0000", 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000784635 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007467+0000", 2024-04-17T15:38:17.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0661999999999994e-05 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.007525+0000", 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7510999999999999e-05 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.562561670999997, 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031389679999999998, 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.652 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 847 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019459+0000", 2024-04-17T15:38:17.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019461+0000", 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.277e-06 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019472+0000", 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1319e-05 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019503+0000", 2024-04-17T15:38:17.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0626999999999997e-05 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019517+0000", 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019652+0000", 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013442799999999999 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.019977+0000", 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032536300000000001 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.020521+0000", 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00054383700000000003 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.021843+0000", 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001321593 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022433+0000", 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00058991600000000001 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022517+0000", 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4845999999999994e-05 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.022598+0000", 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0185999999999994e-05 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.657 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.513602629999994, 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034503820000000001, 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.658 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 868 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068418+0000", 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068420+0000", 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1330000000000002e-06 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068432+0000", 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2646000000000001e-05 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068463+0000", 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0170000000000001e-05 2024-04-17T15:38:17.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068477+0000", 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4797000000000001e-05 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068645+0000", 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016787200000000001 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.068999+0000", 2024-04-17T15:38:17.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035414099999999998 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.069565+0000", 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056531599999999995 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.070818+0000", 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001252932 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071707+0000", 2024-04-17T15:38:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088886 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071793+0000", 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6885999999999994e-05 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.071868+0000", 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4629000000000007e-05 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.420956247999996, 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030204519999999999, 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 907 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161064+0000", 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161067+0000", 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4329999999999998e-06 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161077+0000", 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0910000000000001e-05 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161109+0000", 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1288999999999998e-05 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161123+0000", 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4739999999999999e-05 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161242+0000", 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011889 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161468+0000", 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022609099999999999 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.161805+0000", 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612099999999999 2024-04-17T15:38:17.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.162878+0000", 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001073606 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.163928+0000", 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00104958 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164017+0000", 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9284999999999996e-05 2024-04-17T15:38:17.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.164085+0000", 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7507000000000003e-05 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.320179803000002, 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003409006, 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.673 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 949 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261841+0000", 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261844+0000", 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.993e-06 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261857+0000", 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261902+0000", 2024-04-17T15:38:17.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5286e-05 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.261926+0000", 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3757e-05 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262112+0000", 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018562900000000001 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262494+0000", 2024-04-17T15:38:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038215999999999999 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.262901+0000", 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040692000000000001 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.264939+0000", 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020382400000000002 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265106+0000", 2024-04-17T15:38:17.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016660500000000001 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265187+0000", 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.265250+0000", 2024-04-17T15:38:17.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2063000000000005e-05 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.315880309999997, 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032687240000000002, 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.679 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 951 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266140+0000", 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266142+0000", 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6640000000000001e-06 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266151+0000", 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5829999999999996e-06 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266177+0000", 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.55e-05 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266189+0000", 2024-04-17T15:38:17.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2139e-05 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266301+0000", 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011170700000000001 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266418+0000", 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117599 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.266690+0000", 2024-04-17T15:38:17.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027164099999999998 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.268256+0000", 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001565842 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269168+0000", 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00091194099999999999 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269297+0000", 2024-04-17T15:38:17.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012897900000000001 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.269409+0000", 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112129 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.305076635000006, 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0030567260000000001, 2024-04-17T15:38:17.684 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 955 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276944+0000", 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276946+0000", 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6139999999999999e-06 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276959+0000", 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.279e-05 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.276992+0000", 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2981999999999997e-05 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277008+0000", 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6127e-05 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277162+0000", 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015356199999999999 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277427+0000", 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026516799999999998 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.277784+0000", 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035701500000000002 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279283+0000", 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499479 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279849+0000", 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056583000000000002 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.279935+0000", 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5649000000000006e-05 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280000+0000", 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5510000000000001e-05 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.301098033000002, 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028646269999999998, 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 957 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:17.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280922+0000", 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280924+0000", 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.894e-06 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280934+0000", 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6299999999999993e-06 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280960+0000", 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.280986+0000", 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5913000000000001e-05 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281095+0000", 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109212 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281215+0000", 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120469 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.281472+0000", 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025682199999999997 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:17.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.282766+0000", 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001293521 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283642+0000", 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087648000000000001 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283727+0000", 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4874000000000001e-05 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.283787+0000", 2024-04-17T15:38:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9892000000000002e-05 2024-04-17T15:38:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:17.695 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:17.695 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:17.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:17.697 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:17.697+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:17.797 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:17.798+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:17.848 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:17.849 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:17.849 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:17.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:17.898 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:17.894+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:17.971 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:17.971 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:17.972 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:17.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:18.028 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:18.029+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:18.097 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:18.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.844451508000006, 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063603720000000004, 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "reached pg", 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.098 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 44 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253462+0000", 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253499+0000", 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7339999999999998e-05 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253536+0000", 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6746999999999999e-05 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253562+0000", 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6095999999999999e-05 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253940+0000", 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037773800000000002 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for peered", 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253962+0000", 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2566e-05 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259497+0000", 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055350269999999997 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259819+0000", 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000321792 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040977412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:18.102 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 75.794123276999997, 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049681100000000004, 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 57 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303788+0000", 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.55e-06 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303797+0000", 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8820000000000007e-06 2024-04-17T15:38:18.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303842+0000", 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4231999999999999e-05 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303856+0000", 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4307e-05 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303983+0000", 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127577 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304194+0000", 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000210299 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304573+0000", 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037939199999999999 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.305923+0000", 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013502500000000001 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308569+0000", 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026456159999999999 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308655+0000", 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5539999999999998e-05 2024-04-17T15:38:18.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308755+0000", 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010046499999999999 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040977413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 75.791495858000005, 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047062060000000001, 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.108 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 59 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306416+0000", 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306424+0000", 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7519999999999996e-06 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306446+0000", 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2155e-05 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306456+0000", 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0523000000000001e-05 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306569+0000", 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112277 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306739+0000", 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170688 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307048+0000", 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030829700000000002 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310444+0000", 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033961629999999998 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310828+0000", 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038433500000000003 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310956+0000", 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127997 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.311121+0000", 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016447900000000001 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.815504825000005, 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059605389999999999, 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.114 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 207 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282410+0000", 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3959999999999999e-06 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282431+0000", 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0996999999999999e-05 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282475+0000", 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4703000000000002e-05 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282501+0000", 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5627e-05 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282659+0000", 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015803900000000001 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282916+0000", 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025698099999999998 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.283628+0000", 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00071140199999999998 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.286242+0000", 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002614782 2024-04-17T15:38:18.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288105+0000", 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862437 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288260+0000", 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015568900000000001 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288366+0000", 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000105486 2024-04-17T15:38:18.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.777500239000005, 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033450900000000002, 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.120 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 216 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320413+0000", 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.65e-06 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320426+0000", 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2972999999999999e-05 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2326999999999997e-05 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320473+0000", 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4763000000000001e-05 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320604+0000", 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013095899999999999 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320836+0000", 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000232012 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.321267+0000", 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043098000000000002 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.322958+0000", 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016909189999999999 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323607+0000", 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00064901100000000001 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323691+0000", 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4383999999999997e-05 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323755+0000", 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4111999999999999e-05 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.125 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.737268306999994, 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036511180000000001, 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 227 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360644+0000", 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360656+0000", 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.217e-05 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360689+0000", 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2778999999999999e-05 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360704+0000", 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5187e-05 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360849+0000", 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144315 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361057+0000", 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020802200000000001 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361490+0000", 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043335100000000001 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.363127+0000", 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001636832 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364063+0000", 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093582599999999995 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364177+0000", 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011425300000000001 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364293+0000", 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115943 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.729333405999995, 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003177409, 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.131 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 229 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368579+0000", 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2740000000000002e-06 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368591+0000", 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1456e-05 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368623+0000", 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2474000000000001e-05 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368638+0000", 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.502e-05 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368758+0000", 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000119505 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368990+0000", 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023266199999999999 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.369391+0000", 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040097100000000002 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.370944+0000", 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015525389999999999 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371613+0000", 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00066936899999999995 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371693+0000", 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9886000000000001e-05 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371754+0000", 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1253000000000005e-05 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.722250580999997, 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033033200000000002, 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 231 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375662+0000", 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:18.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375673+0000", 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1678999999999999e-05 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375706+0000", 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2293999999999999e-05 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375721+0000", 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.522e-05 2024-04-17T15:38:18.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375868+0000", 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014661200000000001 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376071+0000", 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020339199999999999 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376467+0000", 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039612099999999998 2024-04-17T15:38:18.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.377887+0000", 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001419696 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378819+0000", 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093196000000000001 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378902+0000", 2024-04-17T15:38:18.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2977000000000002e-05 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378963+0000", 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1241999999999994e-05 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:345 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.680695111000006, 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003233755, 2024-04-17T15:38:18.142 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 345 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417216+0000", 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417223+0000", 2024-04-17T15:38:18.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3969999999999999e-06 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417240+0000", 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7711e-05 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417250+0000", 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3789999999999995e-06 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417308+0000", 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8663999999999999e-05 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417398+0000", 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9524000000000005e-05 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417555+0000", 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015700299999999999 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.418480+0000", 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00092510400000000005 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420343+0000", 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862596 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420402+0000", 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.944e-05 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420449+0000", 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6832000000000002e-05 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:398 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.664122015999993, 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041188789999999998, 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.148 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 398 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433789+0000", 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433794+0000", 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1490000000000002e-06 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433807+0000", 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2334000000000001e-05 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433813+0000", 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1240000000000002e-06 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433875+0000", 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2309000000000003e-05 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433976+0000", 2024-04-17T15:38:18.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100577 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434109+0000", 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013374099999999999 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434711+0000", 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060139999999999998 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437854+0000", 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031429069999999999 2024-04-17T15:38:18.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437883+0000", 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9539999999999998e-05 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437907+0000", 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3947999999999998e-05 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:402 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.662221997000003, 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047817750000000003, 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 402 2024-04-17T15:38:18.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435689+0000", 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.850000000000001e-07 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435693+0000", 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435705+0000", 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1484000000000001e-05 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435713+0000", 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6699999999999994e-06 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435756+0000", 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3519999999999997e-05 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435812+0000", 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5998000000000002e-05 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435942+0000", 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000129596 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.436441+0000", 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049949700000000001 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440415+0000", 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039740690000000002 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440444+0000", 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9156999999999999e-05 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440470+0000", 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5499000000000001e-05 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:522 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.159 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.591069622000006, 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031631699999999999, 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 522 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506842+0000", 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1629999999999999e-06 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506847+0000", 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506861+0000", 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3811e-05 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506871+0000", 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5429999999999999e-06 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506925+0000", 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4740000000000001e-05 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507027+0000", 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101766 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507209+0000", 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018180900000000001 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509722+0000", 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025127539999999999 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509938+0000", 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021666099999999999 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509978+0000", 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9987000000000002e-05 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.510004+0000", 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5316999999999998e-05 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:607 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.517288160999996, 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003551916, 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.165 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 607 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:18.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580623+0000", 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4020000000000001e-06 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580632+0000", 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1459999999999996e-06 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580654+0000", 2024-04-17T15:38:18.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2446000000000002e-05 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580665+0000", 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1165000000000001e-05 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580780+0000", 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114973 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580917+0000", 2024-04-17T15:38:18.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013664300000000001 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581189+0000", 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027190100000000001 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582345+0000", 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00115599 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583899+0000", 2024-04-17T15:38:18.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015540319999999999 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584059+0000", 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016074500000000001 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584174+0000", 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114473 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:611 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.511098211999993, 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033528170000000001, 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 611 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.171 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586814+0000", 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9860000000000001e-06 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586825+0000", 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0686000000000001e-05 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586853+0000", 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8365e-05 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586866+0000", 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587014+0000", 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014742600000000001 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587227+0000", 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021381800000000001 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587506+0000", 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027870100000000001 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.588524+0000", 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001018157 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.589970+0000", 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014462590000000001 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.175 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590061+0000", 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0138999999999999e-05 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590165+0000", 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104168 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:18.176 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.425283535000005, 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034329339999999999, 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 703 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672629+0000", 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0080000000000001e-06 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.178 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672638+0000", 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1419999999999999e-06 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672664+0000", 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5905e-05 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672676+0000", 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2337000000000001e-05 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672840+0000", 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016395 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673166+0000", 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000326275 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673711+0000", 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000545047 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675036+0000", 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013244940000000001 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675808+0000", 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00077264900000000004 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675951+0000", 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014292499999999999 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.676060+0000", 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010820200000000001 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.396109523000007, 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003556245, 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.182 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 715 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701803+0000", 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701818+0000", 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5223e-05 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701849+0000", 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1035999999999999e-05 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701866+0000", 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6643999999999999e-05 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702012+0000", 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014634700000000001 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702345+0000", 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033299399999999998 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702866+0000", 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052063999999999995 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.704096+0000", 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001229988 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705095+0000", 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00099944500000000006 2024-04-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705240+0000", 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144287 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705357+0000", 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117191 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.187 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.241382912000006, 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035344460000000001, 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 778 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856530+0000", 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3199999999999998e-06 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856541+0000", 2024-04-17T15:38:18.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.183e-05 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856573+0000", 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2060000000000001e-05 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856590+0000", 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6356000000000001e-05 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856741+0000", 2024-04-17T15:38:18.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158899999999999 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857099+0000", 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035803499999999998 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857663+0000", 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056350599999999997 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859015+0000", 2024-04-17T15:38:18.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013523299999999999 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859910+0000", 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00089519100000000004 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859996+0000", 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5673000000000005e-05 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.860062+0000", 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5555999999999994e-05 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.127575139000001, 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032371169999999999, 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.193 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 826 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970337+0000", 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970349+0000", 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1440000000000001e-05 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970381+0000", 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1896000000000001e-05 2024-04-17T15:38:18.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970395+0000", 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4867e-05 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970554+0000", 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015837199999999999 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970926+0000", 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037184099999999998 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.971531+0000", 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060493600000000004 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.972848+0000", 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013169340000000001 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973421+0000", 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057373600000000004 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973506+0000", 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4285999999999999e-05 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973572+0000", 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6586000000000002e-05 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 72.036567016000006, 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003083728, 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 865 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:18.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061345+0000", 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061356+0000", 2024-04-17T15:38:18.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0823e-05 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061387+0000", 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0766999999999999e-05 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061402+0000", 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5379999999999998e-05 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061519+0000", 2024-04-17T15:38:18.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117265 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061739+0000", 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000219106 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.062054+0000", 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031500400000000002 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.063247+0000", 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011935979999999999 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064266+0000", 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001019023 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064359+0000", 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3040000000000004e-05 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064427+0000", 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7665999999999999e-05 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.865525821999995, 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031575179999999998, 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:18.204 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 937 2024-04-17T15:38:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:18.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232386+0000", 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:18.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232398+0000", 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1864e-05 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232426+0000", 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232440+0000", 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.412e-05 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232621+0000", 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018099899999999999 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232854+0000", 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023273400000000001 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.233176+0000", 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032190499999999999 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:18.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.234217+0000", 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001040673 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235396+0000", 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001179835 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235480+0000", 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3473000000000005e-05 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:18.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235542+0000", 2024-04-17T15:38:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2042e-05 2024-04-17T15:38:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:18.210 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:18.210 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:18.212 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:18.212 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:18.209+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:18.292 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:38:18.340 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:18.341+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:18.348 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:18.348 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:18.348 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:18.349 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:18.363 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:18.414 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:18.413+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:18.484 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:18.484 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:18.484 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:18.484 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:18.484 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:18.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:18.514 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:18.513+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:18.615 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:18.614+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:18.629 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:18.629 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:46 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.354115629000006, 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006071562, 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273829+0000", 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.984e-06 2024-04-17T15:38:18.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273845+0000", 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.541e-05 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273886+0000", 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1556e-05 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273920+0000", 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3668999999999999e-05 2024-04-17T15:38:18.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274134+0000", 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000213952 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274182+0000", 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7706e-05 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279811+0000", 2024-04-17T15:38:18.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056294029999999998 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279899+0000", 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7881999999999996e-05 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:47 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.344842369999995, 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048203359999999997, 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283103+0000", 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283119+0000", 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6509000000000001e-05 2024-04-17T15:38:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283153+0000", 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4037e-05 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283175+0000", 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1212999999999998e-05 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283298+0000", 2024-04-17T15:38:18.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123712 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283344+0000", 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6136e-05 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287839+0000", 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004494634 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287921+0000", 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1932000000000001e-05 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.325491878999998, 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032981249999999998, 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.639 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 211 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302454+0000", 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302467+0000", 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2996999999999999e-05 2024-04-17T15:38:18.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302501+0000", 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4075999999999997e-05 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302525+0000", 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3737e-05 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302682+0000", 2024-04-17T15:38:18.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157038 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302937+0000", 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025471400000000001 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.303366+0000", 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042908300000000003 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305046+0000", 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001680193 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305575+0000", 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052928199999999995 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305676+0000", 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100382 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305749+0000", 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3510000000000006e-05 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.247717355000006, 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032452660000000001, 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 232 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380228+0000", 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380240+0000", 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380274+0000", 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3957e-05 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380297+0000", 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3319000000000002e-05 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380435+0000", 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137596 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380662+0000", 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022724099999999999 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.381091+0000", 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000429336 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.382850+0000", 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017586800000000001 2024-04-17T15:38:18.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383310+0000", 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000460092 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383400+0000", 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9575999999999998e-05 2024-04-17T15:38:18.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383471+0000", 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1268999999999998e-05 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.221296262999999, 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036624269999999998, 2024-04-17T15:38:18.651 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 278 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406649+0000", 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6000000000000001e-06 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406663+0000", 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3845999999999999e-05 2024-04-17T15:38:18.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406699+0000", 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5726000000000003e-05 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406722+0000", 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.304e-05 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406888+0000", 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166272 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407203+0000", 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031472299999999999 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407899+0000", 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069595699999999998 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.409321+0000", 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014219759999999999 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410041+0000", 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00072015299999999996 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410183+0000", 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142003 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410309+0000", 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126131 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:353 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.208959078000007, 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047116850000000002, 2024-04-17T15:38:18.657 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 353 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418987+0000", 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.853e-06 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419003+0000", 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5973000000000001e-05 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419043+0000", 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9975999999999998e-05 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419064+0000", 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1607000000000002e-05 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419233+0000", 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168908 2024-04-17T15:38:18.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419516+0000", 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028298800000000002 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419933+0000", 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000416329 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421589+0000", 2024-04-17T15:38:18.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016564139999999999 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423544+0000", 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019552250000000001 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423632+0000", 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7416000000000005e-05 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423696+0000", 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3996000000000002e-05 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:398 6.6 e30/24 6:66924383:reshard::reshard.0000000005:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.192691436000004, 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033955729999999998, 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.663 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435253+0000", 2024-04-17T15:38:18.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.666e-06 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435266+0000", 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2564e-05 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435303+0000", 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7568999999999999e-05 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435322+0000", 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8743e-05 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435474+0000", 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015201900000000001 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435532+0000", 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7902000000000002e-05 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438561+0000", 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030286449999999999 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438647+0000", 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6465000000000006e-05 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.133835219000005, 2024-04-17T15:38:18.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003409586, 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494109+0000", 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.595e-06 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494118+0000", 2024-04-17T15:38:18.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1969999999999996e-06 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494140+0000", 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2617e-05 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494151+0000", 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1174e-05 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494293+0000", 2024-04-17T15:38:18.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014123900000000001 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494691+0000", 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039822399999999997 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495275+0000", 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058460000000000001 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497150+0000", 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018747550000000001 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497292+0000", 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141321 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497400+0000", 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010853099999999999 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497517+0000", 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117333 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:551 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.094477021000003, 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003045336, 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 551 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:18.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533469+0000", 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.897e-06 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533486+0000", 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816e-05 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533523+0000", 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6993999999999999e-05 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533540+0000", 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7186000000000001e-05 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533699+0000", 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015882799999999999 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534082+0000", 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038348700000000001 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534670+0000", 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058795799999999997 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.535977+0000", 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001306357 2024-04-17T15:38:18.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536289+0000", 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000312906 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536410+0000", 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120999 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536511+0000", 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100908 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:649 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.008981304000002, 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031209179999999999, 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.679 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 649 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618964+0000", 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6120000000000001e-06 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618977+0000", 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2574e-05 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619012+0000", 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5051e-05 2024-04-17T15:38:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619032+0000", 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0071000000000001e-05 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619181+0000", 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148627 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619432+0000", 2024-04-17T15:38:18.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251081 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619949+0000", 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051755200000000001 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621369+0000", 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00141994 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621936+0000", 2024-04-17T15:38:18.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056712400000000001 2024-04-17T15:38:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622018+0000", 2024-04-17T15:38:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1652999999999999e-05 2024-04-17T15:38:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622083+0000", 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4633000000000003e-05 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:18.686 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.939555393000006, 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032122729999999999, 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 709 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688390+0000", 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3039999999999999e-06 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688402+0000", 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2082999999999999e-05 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688432+0000", 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0332999999999999e-05 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688447+0000", 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5046e-05 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688568+0000", 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121026 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688772+0000", 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020336799999999999 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.689092+0000", 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032027999999999999 2024-04-17T15:38:18.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.690444+0000", 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013523470000000001 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691292+0000", 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084744900000000001 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691459+0000", 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166692 2024-04-17T15:38:18.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691600+0000", 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141345 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.897524481000005, 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002981652, 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.692 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 726 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730421+0000", 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1399999999999998e-06 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730436+0000", 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5233e-05 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730468+0000", 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1574e-05 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730482+0000", 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4693e-05 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730616+0000", 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013382800000000001 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730851+0000", 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000235455 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.731336+0000", 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048426600000000002 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.732933+0000", 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001597198 2024-04-17T15:38:18.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733250+0000", 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031682299999999999 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733330+0000", 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9752999999999993e-05 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733400+0000", 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0689e-05 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.697 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.894187379000002, 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003233166, 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 727 2024-04-17T15:38:18.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733758+0000", 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.114e-06 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733769+0000", 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1226000000000001e-05 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733792+0000", 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2580000000000001e-05 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733804+0000", 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2763e-05 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733944+0000", 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013943199999999999 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734191+0000", 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024684799999999998 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:18.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734584+0000", 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039304900000000002 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.735780+0000", 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011960320000000001 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736834+0000", 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010541400000000001 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736925+0000", 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1101999999999996e-05 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736989+0000", 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3880000000000005e-05 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.703 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.529959630999997, 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033824100000000002, 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 880 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:18.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097987+0000", 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1159999999999999e-06 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098022+0000", 2024-04-17T15:38:18.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-05 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098054+0000", 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1983000000000002e-05 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098069+0000", 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512999999999999e-05 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098228+0000", 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015874500000000001 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098633+0000", 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040438300000000002 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.099238+0000", 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060534800000000002 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.100508+0000", 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00127024 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101208+0000", 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069981399999999999 2024-04-17T15:38:18.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101295+0000", 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6722000000000001e-05 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101366+0000", 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1145999999999999e-05 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.525466011999995, 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032254129999999999, 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 882 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.710 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102479+0000", 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:18.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102490+0000", 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0380000000000001e-05 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102521+0000", 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1529999999999998e-05 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102537+0000", 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.577e-05 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102681+0000", 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102934+0000", 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025325100000000002 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.103425+0000", 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049086500000000005 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.104689+0000", 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012646879999999999 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105549+0000", 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085963200000000004 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105637+0000", 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8438999999999998e-05 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105702+0000", 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5005999999999994e-05 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.715 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.521980127999996, 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030913970000000001, 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-04-17T15:38:18.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105965+0000", 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105975+0000", 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9729999999999992e-06 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106001+0000", 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6253000000000001e-05 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106015+0000", 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3353000000000001e-05 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106141+0000", 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012648600000000001 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106412+0000", 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027110699999999998 2024-04-17T15:38:18.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106757+0000", 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000344657 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108260+0000", 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015027949999999999 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108842+0000", 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058205799999999999 2024-04-17T15:38:18.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108934+0000", 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1792999999999993e-05 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.109054+0000", 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120665 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.451866085999995, 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030928700000000002, 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 913 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176080+0000", 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8030000000000001e-06 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176092+0000", 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2306999999999999e-05 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176122+0000", 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9569000000000001e-05 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176143+0000", 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.156e-05 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176345+0000", 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020190099999999999 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176576+0000", 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231091 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176903+0000", 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000326874 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.178180+0000", 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001276868 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179011+0000", 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083103199999999999 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179102+0000", 2024-04-17T15:38:18.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0919000000000001e-05 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179170+0000", 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.423220479999998, 2024-04-17T15:38:18.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031669530000000001, 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 925 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204725+0000", 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204737+0000", 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2116000000000001e-05 2024-04-17T15:38:18.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204768+0000", 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0676999999999998e-05 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204789+0000", 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1739999999999999e-05 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204946+0000", 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015635099999999999 2024-04-17T15:38:18.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205169+0000", 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223062 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205492+0000", 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032312699999999998 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.206626+0000", 2024-04-17T15:38:18.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011343589999999999 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207735+0000", 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011090659999999999 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207824+0000", 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8603000000000005e-05 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207890+0000", 2024-04-17T15:38:18.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5642000000000006e-05 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.415820913999994, 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030226580000000001, 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 928 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212124+0000", 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1840000000000002e-06 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212136+0000", 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2106000000000001e-05 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212176+0000", 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9643e-05 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212196+0000", 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212325+0000", 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012877200000000001 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212601+0000", 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000275588 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212945+0000", 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034397600000000001 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214619+0000", 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016741779999999999 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214908+0000", 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028898299999999998 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215028+0000", 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120456 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215145+0000", 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116369 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.411655929999995, 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032898250000000001, 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 930 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:18.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216288+0000", 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3260000000000001e-06 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:18.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216297+0000", 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0770000000000008e-06 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216318+0000", 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1869999999999999e-05 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216329+0000", 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.079e-05 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216469+0000", 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013962499999999999 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216725+0000", 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025639100000000002 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.217223+0000", 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049742899999999997 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.218588+0000", 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00136539 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219283+0000", 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069527 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219452+0000", 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168708 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:18.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219577+0000", 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012494900000000001 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:18.744 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:18.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:18.746 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:18.745+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:18.846 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:18.842+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:18.918 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:18.918 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:18.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:18.947 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:18.945+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:19.048 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:19.046+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:19.104 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:19.105 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:19.105 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:19.105 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:19.105 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:19.119 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:19.163 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:19.162+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:19.249 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:19.249+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:19.283 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:38:19.288 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:19.288 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:19.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:19.288 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:19.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.018158733999996, 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:38:19.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:38:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:19.294 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.007394148000003, 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:38:19.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.003224641000003, 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:38:19.300 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:38:19.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.996097215999995, 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.306 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:38:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:38:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.010057790000005, 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:38:19.311 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.316 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.949152358000006, 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:38:19.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.931019581000001, 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.327 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.927345449000001, 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:19.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:38:19.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.898230166999994, 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:38:19.333 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:38:19.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:38:19.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.864197379000004, 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.828201272000001, 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:38:19.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:38:19.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:38:19.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.349 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.740784887999993, 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.738246817999993, 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:38:19.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:38:19.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:38:19.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.485888122999995, 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.358 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.363 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.463586032999999, 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:38:19.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.391813158000005, 2024-04-17T15:38:19.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:38:19.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.197582957999998, 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.375 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:38:19.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:38:19.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:38:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.158307635, 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:38:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:38:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.03762193, 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:38:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:38:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.032968983999993, 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:38:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:38:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:38:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:38:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:19.397 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:19.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:19.399 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:19.397+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:19.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:19.499 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:19.498+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:19.530 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:19.530 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:19.531 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:19.531 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:19.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:19.631 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:19.630+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:19.635 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:19.635 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:19.666 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:19.666 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:19.696 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:19.696 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:19.701 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:19.698+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:19.706 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:19.707 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:19.721 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:19.727 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:19.727 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:19.759 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:19.760 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:19.790 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:19.791 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:19.807 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:19.806+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:19.821 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:19.854 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:19.854 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:19.884 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:19.884 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:19.899 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:19.944 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:19.942+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:20.004 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:20.002+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:20.072 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:20.072 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:20.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:20.132 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:20.130+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:20.206 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:20.205+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:20.257 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:20.257 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:20.272 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:20.306 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:20.305+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:20.396 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:20.396 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:20.407 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:20.405+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:20.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:20.509 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:20.510+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:20.581 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:20.581 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:20.599 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:20.611 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:20.610+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:20.711 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:20.710+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:20.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:20.812 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:20.814+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:20.913 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:20.910+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:20.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:21.016 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:21.017+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:21.115 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:21.110+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:21.142 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:21.142 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:21.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:21.244 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:21.245+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:21.317 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:21.314+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:21.370 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:21.370 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:21.387 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:21.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:38:21.418 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:21.414+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:21.520 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:21.522+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:21.590 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:21.590 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:21.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:21.621 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:21.618+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:21.718 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:21.719 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:21.721 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:21.722+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:21.732 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:21.822 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:21.822+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:21.840 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:21.840 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:21.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:21.875 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:21.923 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:21.918+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:22.005 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:22.005 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:22.024 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:22.025+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:22.025 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:22.077 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:22.077 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:22.109 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:22.110 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:22.125 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:22.125+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:22.143 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:22.176 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:22.177 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:22.214 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:22.226 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:22.222+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:22.239 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:22.239 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:22.239 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:22.239 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:22.249 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:22.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:22.271 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:22.272 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:22.290 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:38:22.314 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:22.314 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:22.339 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:22.337+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:22.391 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:22.391 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:22.391 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:22.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:22.428 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:22.430+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 82.261666886, 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063603720000000004, 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.517 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "reached pg", 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 44 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253462+0000", 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253499+0000", 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7339999999999998e-05 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253536+0000", 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6746999999999999e-05 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253562+0000", 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6095999999999999e-05 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253940+0000", 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037773800000000002 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for peered", 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253962+0000", 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2566e-05 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259497+0000", 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055350269999999997 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259819+0000", 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000321792 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.521 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040977412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 80.211338655000006, 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049681100000000004, 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 57 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303788+0000", 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.55e-06 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303797+0000", 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8820000000000007e-06 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303842+0000", 2024-04-17T15:38:22.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4231999999999999e-05 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303856+0000", 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4307e-05 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303983+0000", 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127577 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304194+0000", 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000210299 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304573+0000", 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037939199999999999 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.305923+0000", 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013502500000000001 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308569+0000", 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026456159999999999 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308655+0000", 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5539999999999998e-05 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308755+0000", 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010046499999999999 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040977413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 80.208711235999999, 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047062060000000001, 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.528 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 59 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306416+0000", 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306424+0000", 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7519999999999996e-06 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306446+0000", 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2155e-05 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306456+0000", 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0523000000000001e-05 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306569+0000", 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112277 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306739+0000", 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170688 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307048+0000", 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030829700000000002 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310444+0000", 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033961629999999998 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310828+0000", 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038433500000000003 2024-04-17T15:38:22.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310956+0000", 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127997 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.311121+0000", 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016447900000000001 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.533 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.232720203, 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059605389999999999, 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 207 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282410+0000", 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3959999999999999e-06 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282431+0000", 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0996999999999999e-05 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282475+0000", 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4703000000000002e-05 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282501+0000", 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5627e-05 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282659+0000", 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015803900000000001 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282916+0000", 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025698099999999998 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.283628+0000", 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00071140199999999998 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.286242+0000", 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002614782 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288105+0000", 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862437 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288260+0000", 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015568900000000001 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288366+0000", 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000105486 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.194715617, 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033450900000000002, 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 216 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320413+0000", 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.65e-06 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320426+0000", 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2972999999999999e-05 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2326999999999997e-05 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320473+0000", 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4763000000000001e-05 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320604+0000", 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013095899999999999 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320836+0000", 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000232012 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.321267+0000", 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043098000000000002 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.322958+0000", 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016909189999999999 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323607+0000", 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00064901100000000001 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323691+0000", 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4383999999999997e-05 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323755+0000", 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4111999999999999e-05 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.544 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.154483685000002, 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036511180000000001, 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 227 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360644+0000", 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360656+0000", 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.217e-05 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360689+0000", 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2778999999999999e-05 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360704+0000", 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5187e-05 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360849+0000", 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144315 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361057+0000", 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020802200000000001 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361490+0000", 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043335100000000001 2024-04-17T15:38:22.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.363127+0000", 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001636832 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364063+0000", 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093582599999999995 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364177+0000", 2024-04-17T15:38:22.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011425300000000001 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364293+0000", 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115943 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.146548784000004, 2024-04-17T15:38:22.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003177409, 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 229 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368579+0000", 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2740000000000002e-06 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368591+0000", 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1456e-05 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368623+0000", 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2474000000000001e-05 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368638+0000", 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.502e-05 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368758+0000", 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000119505 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368990+0000", 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023266199999999999 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.369391+0000", 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040097100000000002 2024-04-17T15:38:22.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.370944+0000", 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015525389999999999 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371613+0000", 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00066936899999999995 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371693+0000", 2024-04-17T15:38:22.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9886000000000001e-05 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371754+0000", 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1253000000000005e-05 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.139465959000006, 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033033200000000002, 2024-04-17T15:38:22.556 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 231 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375662+0000", 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375673+0000", 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1678999999999999e-05 2024-04-17T15:38:22.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375706+0000", 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2293999999999999e-05 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375721+0000", 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.522e-05 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375868+0000", 2024-04-17T15:38:22.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014661200000000001 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376071+0000", 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020339199999999999 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376467+0000", 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039612099999999998 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.377887+0000", 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001419696 2024-04-17T15:38:22.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378819+0000", 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093196000000000001 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378902+0000", 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2977000000000002e-05 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378963+0000", 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1241999999999994e-05 2024-04-17T15:38:22.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:345 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.097910489, 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003233755, 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.562 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 345 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417216+0000", 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417223+0000", 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3969999999999999e-06 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417240+0000", 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7711e-05 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417250+0000", 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3789999999999995e-06 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417308+0000", 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8663999999999999e-05 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417398+0000", 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9524000000000005e-05 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417555+0000", 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015700299999999999 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.418480+0000", 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00092510400000000005 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420343+0000", 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862596 2024-04-17T15:38:22.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420402+0000", 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.944e-05 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420449+0000", 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6832000000000002e-05 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:398 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.081337394000002, 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041188789999999998, 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 398 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433789+0000", 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433794+0000", 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1490000000000002e-06 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433807+0000", 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2334000000000001e-05 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433813+0000", 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1240000000000002e-06 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433875+0000", 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2309000000000003e-05 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433976+0000", 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100577 2024-04-17T15:38:22.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434109+0000", 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013374099999999999 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434711+0000", 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060139999999999998 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437854+0000", 2024-04-17T15:38:22.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031429069999999999 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437883+0000", 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9539999999999998e-05 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437907+0000", 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3947999999999998e-05 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:402 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.079437374999998, 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047817750000000003, 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 402 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.574 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435689+0000", 2024-04-17T15:38:22.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.850000000000001e-07 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435693+0000", 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435705+0000", 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1484000000000001e-05 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435713+0000", 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6699999999999994e-06 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435756+0000", 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3519999999999997e-05 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435812+0000", 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5998000000000002e-05 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435942+0000", 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000129596 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.436441+0000", 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049949700000000001 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440415+0000", 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039740690000000002 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440444+0000", 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9156999999999999e-05 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440470+0000", 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5499000000000001e-05 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.579 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:522 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 77.008285000000001, 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031631699999999999, 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 522 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506842+0000", 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1629999999999999e-06 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506847+0000", 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506861+0000", 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3811e-05 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506871+0000", 2024-04-17T15:38:22.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5429999999999999e-06 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506925+0000", 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4740000000000001e-05 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507027+0000", 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101766 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507209+0000", 2024-04-17T15:38:22.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018180900000000001 2024-04-17T15:38:22.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509722+0000", 2024-04-17T15:38:22.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025127539999999999 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509938+0000", 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021666099999999999 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509978+0000", 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9987000000000002e-05 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.510004+0000", 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5316999999999998e-05 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:607 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.934503539000005, 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003551916, 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.587 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 607 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580623+0000", 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4020000000000001e-06 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580632+0000", 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1459999999999996e-06 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580654+0000", 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2446000000000002e-05 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580665+0000", 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1165000000000001e-05 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580780+0000", 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114973 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580917+0000", 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013664300000000001 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581189+0000", 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027190100000000001 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582345+0000", 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00115599 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583899+0000", 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015540319999999999 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584059+0000", 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016074500000000001 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584174+0000", 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114473 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.592 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:611 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.928313590000002, 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033528170000000001, 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 611 2024-04-17T15:38:22.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586814+0000", 2024-04-17T15:38:22.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9860000000000001e-06 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586825+0000", 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0686000000000001e-05 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586853+0000", 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8365e-05 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586866+0000", 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587014+0000", 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014742600000000001 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587227+0000", 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021381800000000001 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587506+0000", 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027870100000000001 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.588524+0000", 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001018157 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.589970+0000", 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014462590000000001 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590061+0000", 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0138999999999999e-05 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590165+0000", 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104168 2024-04-17T15:38:22.598 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.842498913, 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034329339999999999, 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.599 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 703 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672629+0000", 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0080000000000001e-06 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672638+0000", 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1419999999999999e-06 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672664+0000", 2024-04-17T15:38:22.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5905e-05 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672676+0000", 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2337000000000001e-05 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672840+0000", 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016395 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673166+0000", 2024-04-17T15:38:22.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000326275 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673711+0000", 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000545047 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675036+0000", 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013244940000000001 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675808+0000", 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00077264900000000004 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675951+0000", 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014292499999999999 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.676060+0000", 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010820200000000001 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.813324901000001, 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003556245, 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 715 2024-04-17T15:38:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701803+0000", 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701818+0000", 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5223e-05 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701849+0000", 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1035999999999999e-05 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701866+0000", 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6643999999999999e-05 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702012+0000", 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014634700000000001 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702345+0000", 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033299399999999998 2024-04-17T15:38:22.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702866+0000", 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052063999999999995 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.704096+0000", 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001229988 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705095+0000", 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00099944500000000006 2024-04-17T15:38:22.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705240+0000", 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144287 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705357+0000", 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117191 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.65859829, 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035344460000000001, 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 778 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.611 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856530+0000", 2024-04-17T15:38:22.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3199999999999998e-06 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856541+0000", 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.183e-05 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856573+0000", 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2060000000000001e-05 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856590+0000", 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6356000000000001e-05 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856741+0000", 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158899999999999 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857099+0000", 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035803499999999998 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857663+0000", 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056350599999999997 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859015+0000", 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013523299999999999 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859910+0000", 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00089519100000000004 2024-04-17T15:38:22.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859996+0000", 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5673000000000005e-05 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.860062+0000", 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5555999999999994e-05 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.616 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.544790516999996, 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032371169999999999, 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 826 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970337+0000", 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:38:22.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970349+0000", 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1440000000000001e-05 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970381+0000", 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1896000000000001e-05 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970395+0000", 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4867e-05 2024-04-17T15:38:22.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970554+0000", 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015837199999999999 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970926+0000", 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037184099999999998 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.971531+0000", 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060493600000000004 2024-04-17T15:38:22.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.972848+0000", 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013169340000000001 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973421+0000", 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057373600000000004 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973506+0000", 2024-04-17T15:38:22.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4285999999999999e-05 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973572+0000", 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6586000000000002e-05 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:22.622 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.453782394000001, 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003083728, 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 865 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061345+0000", 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061356+0000", 2024-04-17T15:38:22.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0823e-05 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061387+0000", 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0766999999999999e-05 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061402+0000", 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5379999999999998e-05 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061519+0000", 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117265 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061739+0000", 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000219106 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.062054+0000", 2024-04-17T15:38:22.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031500400000000002 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.063247+0000", 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011935979999999999 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064266+0000", 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001019023 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064359+0000", 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3040000000000004e-05 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064427+0000", 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7665999999999999e-05 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:22.628 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.282741200000004, 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031575179999999998, 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 937 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:22.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232386+0000", 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232398+0000", 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1864e-05 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232426+0000", 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232440+0000", 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.412e-05 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232621+0000", 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018099899999999999 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232854+0000", 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023273400000000001 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.233176+0000", 2024-04-17T15:38:22.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032190499999999999 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.234217+0000", 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001040673 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235396+0000", 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001179835 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:22.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235480+0000", 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3473000000000005e-05 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235542+0000", 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2042e-05 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:22.634 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:22.636 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:22.636 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:22.633+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:22.737 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:22.734+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:22.771 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:22.772 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:22.772 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:22.772 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:22.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:22.871 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:22.870+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:22.939 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:22.937+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:22.952 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:22.953 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:22.953 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:22.953 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:22.953 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:22.967 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:23.056 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:23.054+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:23.135 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:46 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 80.860215977999999, 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006071562, 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273829+0000", 2024-04-17T15:38:23.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.984e-06 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273845+0000", 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.541e-05 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273886+0000", 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1556e-05 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273920+0000", 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3668999999999999e-05 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274134+0000", 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000213952 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274182+0000", 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7706e-05 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279811+0000", 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056294029999999998 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279899+0000", 2024-04-17T15:38:23.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7881999999999996e-05 2024-04-17T15:38:23.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.141 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:47 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 80.850942719000003, 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048203359999999997, 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:23.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:23.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283103+0000", 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283119+0000", 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6509000000000001e-05 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283153+0000", 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4037e-05 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283175+0000", 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1212999999999998e-05 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283298+0000", 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123712 2024-04-17T15:38:23.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283344+0000", 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6136e-05 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287839+0000", 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004494634 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287921+0000", 2024-04-17T15:38:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1932000000000001e-05 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.831592228000005, 2024-04-17T15:38:23.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032981249999999998, 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 211 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302454+0000", 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302467+0000", 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2996999999999999e-05 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302501+0000", 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4075999999999997e-05 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302525+0000", 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3737e-05 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302682+0000", 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157038 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302937+0000", 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025471400000000001 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.303366+0000", 2024-04-17T15:38:23.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042908300000000003 2024-04-17T15:38:23.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305046+0000", 2024-04-17T15:38:23.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001680193 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305575+0000", 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052928199999999995 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305676+0000", 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100382 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305749+0000", 2024-04-17T15:38:23.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3510000000000006e-05 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.753817703999999, 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032452660000000001, 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.154 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 232 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:23.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380228+0000", 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380240+0000", 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380274+0000", 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3957e-05 2024-04-17T15:38:23.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380297+0000", 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3319000000000002e-05 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380435+0000", 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137596 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380662+0000", 2024-04-17T15:38:23.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022724099999999999 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.381091+0000", 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000429336 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.382850+0000", 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017586800000000001 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383310+0000", 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000460092 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383400+0000", 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9575999999999998e-05 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383471+0000", 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1268999999999998e-05 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.159 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.727396612000007, 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036624269999999998, 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 278 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406649+0000", 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6000000000000001e-06 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406663+0000", 2024-04-17T15:38:23.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3845999999999999e-05 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406699+0000", 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5726000000000003e-05 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406722+0000", 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.304e-05 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406888+0000", 2024-04-17T15:38:23.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166272 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407203+0000", 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031472299999999999 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407899+0000", 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069595699999999998 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.409321+0000", 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014219759999999999 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410041+0000", 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00072015299999999996 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410183+0000", 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142003 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410309+0000", 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126131 2024-04-17T15:38:23.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:353 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.715059427, 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047116850000000002, 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.165 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 353 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:23.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418987+0000", 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.853e-06 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419003+0000", 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5973000000000001e-05 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419043+0000", 2024-04-17T15:38:23.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9975999999999998e-05 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419064+0000", 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1607000000000002e-05 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419233+0000", 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168908 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419516+0000", 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028298800000000002 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419933+0000", 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000416329 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421589+0000", 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016564139999999999 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423544+0000", 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019552250000000001 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423632+0000", 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7416000000000005e-05 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423696+0000", 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3996000000000002e-05 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.170 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:398 6.6 e30/24 6:66924383:reshard::reshard.0000000005:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.698791784999997, 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033955729999999998, 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435253+0000", 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.666e-06 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435266+0000", 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2564e-05 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435303+0000", 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7568999999999999e-05 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435322+0000", 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8743e-05 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435474+0000", 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015201900000000001 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435532+0000", 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7902000000000002e-05 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438561+0000", 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030286449999999999 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438647+0000", 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6465000000000006e-05 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.639935567999999, 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003409586, 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.175 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494109+0000", 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.595e-06 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494118+0000", 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1969999999999996e-06 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494140+0000", 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2617e-05 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494151+0000", 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1174e-05 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494293+0000", 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014123900000000001 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494691+0000", 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039822399999999997 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495275+0000", 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058460000000000001 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497150+0000", 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018747550000000001 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497292+0000", 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141321 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497400+0000", 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010853099999999999 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497517+0000", 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117333 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:551 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.600577369999996, 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003045336, 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 551 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:23.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533469+0000", 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.897e-06 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533486+0000", 2024-04-17T15:38:23.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816e-05 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533523+0000", 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6993999999999999e-05 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533540+0000", 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7186000000000001e-05 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533699+0000", 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015882799999999999 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534082+0000", 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038348700000000001 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534670+0000", 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058795799999999997 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.535977+0000", 2024-04-17T15:38:23.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001306357 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536289+0000", 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000312906 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536410+0000", 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120999 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536511+0000", 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100908 2024-04-17T15:38:23.185 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:649 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.515081652999996, 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031209179999999999, 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.186 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 649 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618964+0000", 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6120000000000001e-06 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618977+0000", 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2574e-05 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619012+0000", 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5051e-05 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619032+0000", 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0071000000000001e-05 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619181+0000", 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148627 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619432+0000", 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251081 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619949+0000", 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051755200000000001 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621369+0000", 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00141994 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621936+0000", 2024-04-17T15:38:23.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056712400000000001 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622018+0000", 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1652999999999999e-05 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622083+0000", 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4633000000000003e-05 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.191 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.192 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.445655742, 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032122729999999999, 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 709 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.194 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:23.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688390+0000", 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3039999999999999e-06 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688402+0000", 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2082999999999999e-05 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688432+0000", 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0332999999999999e-05 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688447+0000", 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5046e-05 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688568+0000", 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121026 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688772+0000", 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020336799999999999 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.689092+0000", 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032027999999999999 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.690444+0000", 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013523470000000001 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691292+0000", 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084744900000000001 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691459+0000", 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166692 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691600+0000", 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141345 2024-04-17T15:38:23.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.403624829999998, 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002981652, 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.200 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 726 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730421+0000", 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1399999999999998e-06 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730436+0000", 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5233e-05 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730468+0000", 2024-04-17T15:38:23.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1574e-05 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730482+0000", 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4693e-05 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730616+0000", 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013382800000000001 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730851+0000", 2024-04-17T15:38:23.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000235455 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.731336+0000", 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048426600000000002 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.732933+0000", 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001597198 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733250+0000", 2024-04-17T15:38:23.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031682299999999999 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733330+0000", 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9752999999999993e-05 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733400+0000", 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0689e-05 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.400287727999995, 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003233166, 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 727 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733758+0000", 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.114e-06 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733769+0000", 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1226000000000001e-05 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733792+0000", 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2580000000000001e-05 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733804+0000", 2024-04-17T15:38:23.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2763e-05 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733944+0000", 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013943199999999999 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734191+0000", 2024-04-17T15:38:23.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024684799999999998 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734584+0000", 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039304900000000002 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.735780+0000", 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011960320000000001 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736834+0000", 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010541400000000001 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736925+0000", 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1101999999999996e-05 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736989+0000", 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3880000000000005e-05 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.036059980000005, 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033824100000000002, 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 880 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097987+0000", 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1159999999999999e-06 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098022+0000", 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-05 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098054+0000", 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1983000000000002e-05 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098069+0000", 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512999999999999e-05 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098228+0000", 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015874500000000001 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098633+0000", 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040438300000000002 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.099238+0000", 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060534800000000002 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.100508+0000", 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00127024 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101208+0000", 2024-04-17T15:38:23.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069981399999999999 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101295+0000", 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6722000000000001e-05 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101366+0000", 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1145999999999999e-05 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.217 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.031566361000003, 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032254129999999999, 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 882 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:23.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102479+0000", 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102490+0000", 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0380000000000001e-05 2024-04-17T15:38:23.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102521+0000", 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1529999999999998e-05 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102537+0000", 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.577e-05 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102681+0000", 2024-04-17T15:38:23.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102934+0000", 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025325100000000002 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.103425+0000", 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049086500000000005 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.104689+0000", 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012646879999999999 2024-04-17T15:38:23.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105549+0000", 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085963200000000004 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105637+0000", 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8438999999999998e-05 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105702+0000", 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5005999999999994e-05 2024-04-17T15:38:23.222 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.028080477000003, 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030913970000000001, 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.223 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105965+0000", 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105975+0000", 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9729999999999992e-06 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106001+0000", 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6253000000000001e-05 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106015+0000", 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3353000000000001e-05 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106141+0000", 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012648600000000001 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106412+0000", 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027110699999999998 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106757+0000", 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000344657 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108260+0000", 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015027949999999999 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108842+0000", 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058205799999999999 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108934+0000", 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1792999999999993e-05 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.109054+0000", 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120665 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.228 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.957966435000003, 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030928700000000002, 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 913 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176080+0000", 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8030000000000001e-06 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176092+0000", 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2306999999999999e-05 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176122+0000", 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9569000000000001e-05 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176143+0000", 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.156e-05 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176345+0000", 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020190099999999999 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176576+0000", 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231091 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176903+0000", 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000326874 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.178180+0000", 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001276868 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179011+0000", 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083103199999999999 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179102+0000", 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0919000000000001e-05 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179170+0000", 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.929320829000005, 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031669530000000001, 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.234 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 925 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:23.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204725+0000", 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204737+0000", 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2116000000000001e-05 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204768+0000", 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0676999999999998e-05 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204789+0000", 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1739999999999999e-05 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204946+0000", 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015635099999999999 2024-04-17T15:38:23.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205169+0000", 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223062 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205492+0000", 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032312699999999998 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.206626+0000", 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011343589999999999 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207735+0000", 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011090659999999999 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207824+0000", 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8603000000000005e-05 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207890+0000", 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5642000000000006e-05 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.921921263000002, 2024-04-17T15:38:23.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030226580000000001, 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 928 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212124+0000", 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1840000000000002e-06 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212136+0000", 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2106000000000001e-05 2024-04-17T15:38:23.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212176+0000", 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9643e-05 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212196+0000", 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212325+0000", 2024-04-17T15:38:23.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012877200000000001 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212601+0000", 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000275588 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212945+0000", 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034397600000000001 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214619+0000", 2024-04-17T15:38:23.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016741779999999999 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214908+0000", 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028898299999999998 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215028+0000", 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120456 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215145+0000", 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116369 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.917756279000002, 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032898250000000001, 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.246 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 930 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216288+0000", 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3260000000000001e-06 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216297+0000", 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0770000000000008e-06 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216318+0000", 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1869999999999999e-05 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216329+0000", 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.079e-05 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216469+0000", 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013962499999999999 2024-04-17T15:38:23.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216725+0000", 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025639100000000002 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.217223+0000", 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049742899999999997 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.218588+0000", 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00136539 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219283+0000", 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069527 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219452+0000", 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168708 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219577+0000", 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012494900000000001 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.252 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:23.254 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:23.254 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:23.253+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:23.355 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:23.353+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:23.430 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:23.430 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:23.431 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:23.431 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:23.446 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:23.491 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:23.490+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:23.557 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:23.557+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:23.572 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:23.572 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:23.572 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:23.572 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:23.572 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:23.586 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:23.658 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:23.657+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:23.757 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:23.757 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 85.489167280999993, 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:23.758 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:23.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 85.478402695, 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.764 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:38:23.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:38:23.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:38:23.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:38:23.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:23.769 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.474233187999999, 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.467105763000006, 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:23.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:38:23.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.481066337000001, 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:38:23.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.786 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.420160905000003, 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.787 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:38:23.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:38:23.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.402028127999998, 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.792 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:23.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:38:23.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:38:23.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:38:23.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.398353995999997, 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.369238714000005, 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:38:23.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:38:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:38:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.811 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.335205926, 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:38:23.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.299209818999998, 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:38:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:38:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:38:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.211793435000004, 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.209255365000004, 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:38:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.956896670000006, 2024-04-17T15:38:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:38:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:38:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:38:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:38:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.934594579999995, 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.862821705000002, 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:38:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:38:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:38:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:38:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.668591504999995, 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.629316181999997, 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:38:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:38:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:38:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:38:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.508630476999997, 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:38:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 77.503977531000004, 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:23.872 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:23.873 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:23.874 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:23.873+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:23.974 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:23.973+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:24.005 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:24.005 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:24.005 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:24.006 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:24.019 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:24.075 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:24.073+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:24.140 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:24.140 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:24.140 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:24.140 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:24.140 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:24.154 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:24.176 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:24.177+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:24.277 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:24.274+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:24.290 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.039774886999993, 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:24.291 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:38:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:38:24.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:38:24.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:24.298 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.007804581000002, 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.990468565, 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.987933923, 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.310 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:24.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:38:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:38:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.887380297999997, 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:38:24.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:38:24.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.994315568000005, 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.971182873000004, 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.324 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.930949386999998, 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:38:24.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.876415356999999, 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.855633734999998, 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.337 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.855222545999993, 2024-04-17T15:38:24.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.345 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.852831141999999, 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.852733083000004, 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:38:24.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:38:24.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:38:24.353 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.850027255000001, 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.354 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:38:24.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:38:24.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:38:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.817291714999996, 2024-04-17T15:38:24.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:38:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.808271555999994, 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:38:24.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.803656208999996, 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.367 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:38:24.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.794262977000002, 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.375 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.760920282000001, 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:38:24.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:38:24.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.701160513000005, 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:38:24.380 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:38:24.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:38:24.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:24.384 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:24.385 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:38:24.385 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:24.387 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:24.385+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:24.387 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:24.487 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:24.486+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:24.560 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:24.561 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:24.561 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:24.561 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:24.575 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:24.586 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:24.586 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:24.617 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:24.620 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:24.618+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:24.648 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:24.648 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:24.678 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:24.679 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:24.690 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:24.686+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:24.709 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:24.710 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:24.742 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:24.742 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:24.747 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:24.747 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:24.747 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:24.747 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:24.748 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:24.762 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:24.774 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:24.775 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:24.803 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:24.802+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:24.808 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:24.808 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:24.892 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:24.893+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:24.928 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:24.928 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:24.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:24.994 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:24.993+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:25.095 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:25.093+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:25.112 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:25.113 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:25.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:25.216 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:25.217+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:25.297 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:25.297+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:38:25.348 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:25.348 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:25.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:25.408 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:25.409+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:25.499 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:25.497+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:25.577 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:25.578 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:25.596 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:25.600 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:25.598+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:25.701 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:25.698+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:25.802 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:25.802+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:25.810 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:25.811 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:25.830 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:25.903 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:25.902+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:25.999 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:25.999 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:26.004 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:26.005+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:26.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:26.106 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:26.102+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:26.206 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:26.206+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:26.229 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:26.230 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:26.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:26.308 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:26.306+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:26.409 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:26.406+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:26.417 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:26.418 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:26.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:26.510 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:26.506+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:26.604 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:26.604 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:26.611 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:26.610+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:26.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:26.712 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:26.710+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:26.732 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:26.732 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:26.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:26.813 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:26.813+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:26.829 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:26.872 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:26.872 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:26.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:26.940 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:26.941+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:27.005 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:27.006 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:27.015 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:27.014+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:27.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:27.037 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:27.056 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:27.056 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:27.067 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:27.068 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:27.070 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:27.098 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:27.099 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:27.116 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:27.117+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:27.132 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:27.132 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:27.165 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:27.165 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 86.929603684, 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063603720000000004, 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "reached pg", 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 44 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253459+0000", 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253462+0000", 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253499+0000", 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7339999999999998e-05 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253536+0000", 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6746999999999999e-05 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253562+0000", 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6095999999999999e-05 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253940+0000", 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037773800000000002 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for peered", 2024-04-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.253962+0000", 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2566e-05 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259497+0000", 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055350269999999997 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:00.259819+0000", 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000321792 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94040977412480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 84.879275453000005, 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049681100000000004, 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 57 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303787+0000", 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303788+0000", 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.55e-06 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303797+0000", 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8820000000000007e-06 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303842+0000", 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4231999999999999e-05 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303856+0000", 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4307e-05 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.303983+0000", 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127577 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304194+0000", 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000210299 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.304573+0000", 2024-04-17T15:38:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037939199999999999 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.305923+0000", 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013502500000000001 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308569+0000", 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026456159999999999 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308655+0000", 2024-04-17T15:38:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5539999999999998e-05 2024-04-17T15:38:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308755+0000", 2024-04-17T15:38:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010046499999999999 2024-04-17T15:38:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94040977413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 84.876648033999999, 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047062060000000001, 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 59 2024-04-17T15:38:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306414+0000", 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306416+0000", 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306424+0000", 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7519999999999996e-06 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306446+0000", 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2155e-05 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306456+0000", 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0523000000000001e-05 2024-04-17T15:38:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306569+0000", 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112277 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306739+0000", 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170688 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307048+0000", 2024-04-17T15:38:27.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030829700000000002 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310444+0000", 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033961629999999998 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310828+0000", 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038433500000000003 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310956+0000", 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127997 2024-04-17T15:38:27.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.311121+0000", 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016447900000000001 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.900657000999999, 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059605389999999999, 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.200 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 207 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282405+0000", 2024-04-17T15:38:27.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282410+0000", 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3959999999999999e-06 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282431+0000", 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0996999999999999e-05 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282475+0000", 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4703000000000002e-05 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282501+0000", 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5627e-05 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282659+0000", 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015803900000000001 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282916+0000", 2024-04-17T15:38:27.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025698099999999998 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.283628+0000", 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00071140199999999998 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.286242+0000", 2024-04-17T15:38:27.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002614782 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288105+0000", 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862437 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288260+0000", 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015568900000000001 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288366+0000", 2024-04-17T15:38:27.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000105486 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.862652414999999, 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033450900000000002, 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.206 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 216 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320410+0000", 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320413+0000", 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.65e-06 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320426+0000", 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2972999999999999e-05 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2326999999999997e-05 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320473+0000", 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4763000000000001e-05 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320604+0000", 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013095899999999999 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.320836+0000", 2024-04-17T15:38:27.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000232012 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.321267+0000", 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043098000000000002 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.322958+0000", 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016909189999999999 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323607+0000", 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00064901100000000001 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323691+0000", 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4383999999999997e-05 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.323755+0000", 2024-04-17T15:38:27.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4111999999999999e-05 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.822420483000002, 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036511180000000001, 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.212 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 227 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360642+0000", 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360644+0000", 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360656+0000", 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.217e-05 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360689+0000", 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2778999999999999e-05 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360704+0000", 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5187e-05 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.360849+0000", 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144315 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361057+0000", 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020802200000000001 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.361490+0000", 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043335100000000001 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.363127+0000", 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001636832 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364063+0000", 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093582599999999995 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364177+0000", 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011425300000000001 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.364293+0000", 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115943 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.814485582000003, 2024-04-17T15:38:27.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003177409, 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 229 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368577+0000", 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368579+0000", 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2740000000000002e-06 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368591+0000", 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1456e-05 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368623+0000", 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2474000000000001e-05 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368638+0000", 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.502e-05 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368758+0000", 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000119505 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.368990+0000", 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023266199999999999 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.369391+0000", 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040097100000000002 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.370944+0000", 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015525389999999999 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371613+0000", 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00066936899999999995 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371693+0000", 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9886000000000001e-05 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371754+0000", 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1253000000000005e-05 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.222 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.807402757000006, 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033033200000000002, 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 231 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375660+0000", 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375662+0000", 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375673+0000", 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1678999999999999e-05 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375706+0000", 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2293999999999999e-05 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375721+0000", 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.522e-05 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375868+0000", 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014661200000000001 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376071+0000", 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020339199999999999 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.376467+0000", 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039612099999999998 2024-04-17T15:38:27.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.377887+0000", 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001419696 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378819+0000", 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00093196000000000001 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378902+0000", 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2977000000000002e-05 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.378963+0000", 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1241999999999994e-05 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:345 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.765847287, 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003233755, 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.228 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 345 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417215+0000", 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417216+0000", 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417223+0000", 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3969999999999999e-06 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417240+0000", 2024-04-17T15:38:27.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7711e-05 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417250+0000", 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3789999999999995e-06 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417308+0000", 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8663999999999999e-05 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417398+0000", 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9524000000000005e-05 2024-04-17T15:38:27.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.417555+0000", 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015700299999999999 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.418480+0000", 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00092510400000000005 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420343+0000", 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001862596 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420402+0000", 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.944e-05 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.420449+0000", 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6832000000000002e-05 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:398 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.233 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.749274192000001, 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041188789999999998, 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 398 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:27.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433788+0000", 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433789+0000", 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433794+0000", 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1490000000000002e-06 2024-04-17T15:38:27.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433807+0000", 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2334000000000001e-05 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433813+0000", 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1240000000000002e-06 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433875+0000", 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2309000000000003e-05 2024-04-17T15:38:27.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.433976+0000", 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100577 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434109+0000", 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013374099999999999 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.434711+0000", 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060139999999999998 2024-04-17T15:38:27.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437854+0000", 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031429069999999999 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437883+0000", 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9539999999999998e-05 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.437907+0000", 2024-04-17T15:38:27.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3947999999999998e-05 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:402 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.747374172999997, 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047817750000000003, 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.239 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 402 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435688+0000", 2024-04-17T15:38:27.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435689+0000", 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.850000000000001e-07 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435693+0000", 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435705+0000", 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1484000000000001e-05 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435713+0000", 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6699999999999994e-06 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435756+0000", 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3519999999999997e-05 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435812+0000", 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5998000000000002e-05 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.435942+0000", 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000129596 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.436441+0000", 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049949700000000001 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440415+0000", 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039740690000000002 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440444+0000", 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9156999999999999e-05 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.440470+0000", 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5499000000000001e-05 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:522 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.676221798, 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031631699999999999, 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 522 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506841+0000", 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506842+0000", 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1629999999999999e-06 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506847+0000", 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506861+0000", 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3811e-05 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506871+0000", 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5429999999999999e-06 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.506925+0000", 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4740000000000001e-05 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507027+0000", 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101766 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.507209+0000", 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018180900000000001 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509722+0000", 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025127539999999999 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509938+0000", 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021666099999999999 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.509978+0000", 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9987000000000002e-05 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.510004+0000", 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5316999999999998e-05 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:607 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.602440337000004, 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003551916, 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.250 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 607 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580622+0000", 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580623+0000", 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4020000000000001e-06 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580632+0000", 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1459999999999996e-06 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580654+0000", 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2446000000000002e-05 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580665+0000", 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1165000000000001e-05 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580780+0000", 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114973 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580917+0000", 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013664300000000001 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:27.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581189+0000", 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027190100000000001 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582345+0000", 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00115599 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583899+0000", 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015540319999999999 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584059+0000", 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016074500000000001 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.584174+0000", 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114473 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:611 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.596250388000001, 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033528170000000001, 2024-04-17T15:38:27.255 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 611 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586812+0000", 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586814+0000", 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9860000000000001e-06 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586825+0000", 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0686000000000001e-05 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586853+0000", 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8365e-05 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.586866+0000", 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587014+0000", 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014742600000000001 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587227+0000", 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021381800000000001 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.587506+0000", 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027870100000000001 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.588524+0000", 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001018157 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.589970+0000", 2024-04-17T15:38:27.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014462590000000001 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590061+0000", 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0138999999999999e-05 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.590165+0000", 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104168 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.260 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.510435711, 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034329339999999999, 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 703 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672627+0000", 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672629+0000", 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0080000000000001e-06 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672638+0000", 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1419999999999999e-06 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672664+0000", 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5905e-05 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672676+0000", 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2337000000000001e-05 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.672840+0000", 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016395 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673166+0000", 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000326275 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.673711+0000", 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000545047 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675036+0000", 2024-04-17T15:38:27.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013244940000000001 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675808+0000", 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00077264900000000004 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.675951+0000", 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014292499999999999 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.676060+0000", 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010820200000000001 2024-04-17T15:38:27.265 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.481261699000001, 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003556245, 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.266 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 715 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701801+0000", 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701803+0000", 2024-04-17T15:38:27.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701818+0000", 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5223e-05 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701849+0000", 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1035999999999999e-05 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.701866+0000", 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6643999999999999e-05 2024-04-17T15:38:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702012+0000", 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014634700000000001 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702345+0000", 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033299399999999998 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.702866+0000", 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052063999999999995 2024-04-17T15:38:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.704096+0000", 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001229988 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705095+0000", 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00099944500000000006 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705240+0000", 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000144287 2024-04-17T15:38:27.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.705357+0000", 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117191 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.326535088, 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035344460000000001, 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.271 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 778 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856527+0000", 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856530+0000", 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3199999999999998e-06 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856541+0000", 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.183e-05 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856573+0000", 2024-04-17T15:38:27.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2060000000000001e-05 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856590+0000", 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6356000000000001e-05 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.856741+0000", 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158899999999999 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857099+0000", 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035803499999999998 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.857663+0000", 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00056350599999999997 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859015+0000", 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013523299999999999 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859910+0000", 2024-04-17T15:38:27.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00089519100000000004 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.859996+0000", 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5673000000000005e-05 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.860062+0000", 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5555999999999994e-05 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.212727314999995, 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032371169999999999, 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 826 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970335+0000", 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970337+0000", 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2230000000000001e-06 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970349+0000", 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1440000000000001e-05 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970381+0000", 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1896000000000001e-05 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970395+0000", 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4867e-05 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970554+0000", 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015837199999999999 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.970926+0000", 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00037184099999999998 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.971531+0000", 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060493600000000004 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.972848+0000", 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013169340000000001 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973421+0000", 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057373600000000004 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973506+0000", 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4285999999999999e-05 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.973572+0000", 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6586000000000002e-05 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 81.121719192, 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003083728, 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 865 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061343+0000", 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061345+0000", 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061356+0000", 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0823e-05 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061387+0000", 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0766999999999999e-05 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061402+0000", 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5379999999999998e-05 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061519+0000", 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117265 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.061739+0000", 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000219106 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.062054+0000", 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031500400000000002 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.063247+0000", 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011935979999999999 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064266+0000", 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001019023 2024-04-17T15:38:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064359+0000", 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3040000000000004e-05 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.064427+0000", 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7665999999999999e-05 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 80.950677998000003, 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031575179999999998, 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 937 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232384+0000", 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232386+0000", 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232398+0000", 2024-04-17T15:38:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1864e-05 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232426+0000", 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232440+0000", 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.412e-05 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232621+0000", 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018099899999999999 2024-04-17T15:38:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.232854+0000", 2024-04-17T15:38:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023273400000000001 2024-04-17T15:38:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.233176+0000", 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032190499999999999 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.234217+0000", 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001040673 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235396+0000", 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001179835 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235480+0000", 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3473000000000005e-05 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:06.235542+0000", 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2042e-05 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:27.296 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:27.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:27.298 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:27.298 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:27.298 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:27.299 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:27.299 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:27.294+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:27.329 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:38:27.398 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:27.397+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:27.433 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:27.433 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:27.433 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:27.433 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:27.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:27.499 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:27.497+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:27.565 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:27.565 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:27.565 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:27.565 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:27.565 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:27.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:27.624 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:27.622+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:27.701 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:27.698+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:27.703 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:27.703 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:46 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 85.428345520999997, 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006071562, 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:27.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273827+0000", 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273829+0000", 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.984e-06 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273845+0000", 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.541e-05 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273886+0000", 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1556e-05 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273920+0000", 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3668999999999999e-05 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274134+0000", 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000213952 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.274182+0000", 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7706e-05 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279811+0000", 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056294029999999998 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.279899+0000", 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7881999999999996e-05 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:47 7.1f e27/26 7:f95f44c2:::notify.0:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:27.708 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 85.419072262, 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048203359999999997, 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283101+0000", 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283103+0000", 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283119+0000", 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6509000000000001e-05 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283153+0000", 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4037e-05 2024-04-17T15:38:27.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283175+0000", 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1212999999999998e-05 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283298+0000", 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123712 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.283344+0000", 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6136e-05 2024-04-17T15:38:27.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287839+0000", 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004494634 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.287921+0000", 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1932000000000001e-05 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.399721771000003, 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032981249999999998, 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 211 2024-04-17T15:38:27.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302451+0000", 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302454+0000", 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302467+0000", 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2996999999999999e-05 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302501+0000", 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4075999999999997e-05 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302525+0000", 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3737e-05 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302682+0000", 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157038 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.302937+0000", 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025471400000000001 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:27.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.303366+0000", 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042908300000000003 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305046+0000", 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001680193 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305575+0000", 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052928199999999995 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305676+0000", 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100382 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.305749+0000", 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3510000000000006e-05 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:27.718 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.321947246999997, 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032452660000000001, 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 232 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:27.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380226+0000", 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380228+0000", 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380240+0000", 2024-04-17T15:38:27.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380274+0000", 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3957e-05 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380297+0000", 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3319000000000002e-05 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380435+0000", 2024-04-17T15:38:27.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137596 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.380662+0000", 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022724099999999999 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.381091+0000", 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000429336 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.382850+0000", 2024-04-17T15:38:27.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017586800000000001 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383310+0000", 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000460092 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383400+0000", 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9575999999999998e-05 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.383471+0000", 2024-04-17T15:38:27.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1268999999999998e-05 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:278 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.295526155000005, 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036624269999999998, 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.724 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 278 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406647+0000", 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406649+0000", 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6000000000000001e-06 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406663+0000", 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3845999999999999e-05 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406699+0000", 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5726000000000003e-05 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406722+0000", 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.304e-05 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.406888+0000", 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166272 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407203+0000", 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031472299999999999 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.407899+0000", 2024-04-17T15:38:27.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069595699999999998 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.409321+0000", 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014219759999999999 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410041+0000", 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00072015299999999996 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410183+0000", 2024-04-17T15:38:27.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142003 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.410309+0000", 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126131 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:353 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.283188969999998, 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047116850000000002, 2024-04-17T15:38:27.729 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 353 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418984+0000", 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.418987+0000", 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.853e-06 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419003+0000", 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5973000000000001e-05 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419043+0000", 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9975999999999998e-05 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419064+0000", 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1607000000000002e-05 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419233+0000", 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168908 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419516+0000", 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028298800000000002 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.419933+0000", 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000416329 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421589+0000", 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016564139999999999 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423544+0000", 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019552250000000001 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423632+0000", 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7416000000000005e-05 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423696+0000", 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3996000000000002e-05 2024-04-17T15:38:27.734 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:398 6.6 e30/24 6:66924383:reshard::reshard.0000000005:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.266921327999995, 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033955729999999998, 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435252+0000", 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435253+0000", 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.666e-06 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435266+0000", 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2564e-05 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435303+0000", 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7568999999999999e-05 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435322+0000", 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8743e-05 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435474+0000", 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015201900000000001 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435532+0000", 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7902000000000002e-05 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438561+0000", 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030286449999999999 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438647+0000", 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6465000000000006e-05 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.208065110999996, 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003409586, 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.739 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494108+0000", 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494109+0000", 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.595e-06 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494118+0000", 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1969999999999996e-06 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494140+0000", 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2617e-05 2024-04-17T15:38:27.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494151+0000", 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1174e-05 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494293+0000", 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014123900000000001 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.494691+0000", 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039822399999999997 2024-04-17T15:38:27.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495275+0000", 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058460000000000001 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497150+0000", 2024-04-17T15:38:27.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018747550000000001 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497292+0000", 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141321 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497400+0000", 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010853099999999999 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497517+0000", 2024-04-17T15:38:27.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117333 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:551 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.168706912999994, 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003045336, 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 551 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533466+0000", 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533469+0000", 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.897e-06 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533486+0000", 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816e-05 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533523+0000", 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6993999999999999e-05 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533540+0000", 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7186000000000001e-05 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.533699+0000", 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015882799999999999 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534082+0000", 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038348700000000001 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.534670+0000", 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058795799999999997 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.535977+0000", 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001306357 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536289+0000", 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000312906 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536410+0000", 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120999 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.536511+0000", 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100908 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:649 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.750 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.083211195999993, 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031209179999999999, 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 649 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618962+0000", 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618964+0000", 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6120000000000001e-06 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.618977+0000", 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2574e-05 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619012+0000", 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5051e-05 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619032+0000", 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0071000000000001e-05 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619181+0000", 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148627 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619432+0000", 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251081 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.619949+0000", 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051755200000000001 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621369+0000", 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00141994 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.621936+0000", 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056712400000000001 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622018+0000", 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1652999999999999e-05 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.622083+0000", 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4633000000000003e-05 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.013785284999997, 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032122729999999999, 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.756 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 709 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688388+0000", 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688390+0000", 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3039999999999999e-06 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688402+0000", 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2082999999999999e-05 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688432+0000", 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0332999999999999e-05 2024-04-17T15:38:27.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688447+0000", 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5046e-05 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688568+0000", 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121026 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.688772+0000", 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020336799999999999 2024-04-17T15:38:27.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.689092+0000", 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032027999999999999 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.690444+0000", 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013523470000000001 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691292+0000", 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084744900000000001 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691459+0000", 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166692 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.691600+0000", 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141345 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.761 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.971754372999996, 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002981652, 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 726 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:27.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730419+0000", 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730421+0000", 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1399999999999998e-06 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730436+0000", 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5233e-05 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730468+0000", 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1574e-05 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730482+0000", 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4693e-05 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730616+0000", 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013382800000000001 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.730851+0000", 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000235455 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.731336+0000", 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048426600000000002 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.732933+0000", 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001597198 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733250+0000", 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031682299999999999 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733330+0000", 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9752999999999993e-05 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733400+0000", 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0689e-05 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.968417271000007, 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003233166, 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.767 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 727 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733756+0000", 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733758+0000", 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.114e-06 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733769+0000", 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1226000000000001e-05 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733792+0000", 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2580000000000001e-05 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733804+0000", 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2763e-05 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.733944+0000", 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013943199999999999 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734191+0000", 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024684799999999998 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.734584+0000", 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039304900000000002 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.735780+0000", 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011960320000000001 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736834+0000", 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010541400000000001 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736925+0000", 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1101999999999996e-05 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.736989+0000", 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3880000000000005e-05 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.604189523000002, 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033824100000000002, 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 880 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097983+0000", 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.097987+0000", 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1159999999999999e-06 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098022+0000", 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-05 2024-04-17T15:38:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098054+0000", 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1983000000000002e-05 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098069+0000", 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512999999999999e-05 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098228+0000", 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015874500000000001 2024-04-17T15:38:27.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.098633+0000", 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040438300000000002 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.099238+0000", 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060534800000000002 2024-04-17T15:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.100508+0000", 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00127024 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101208+0000", 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069981399999999999 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101295+0000", 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6722000000000001e-05 2024-04-17T15:38:27.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.101366+0000", 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1145999999999999e-05 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.599695904000001, 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032254129999999999, 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.778 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 882 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102477+0000", 2024-04-17T15:38:27.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102479+0000", 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102490+0000", 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0380000000000001e-05 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102521+0000", 2024-04-17T15:38:27.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1529999999999998e-05 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102537+0000", 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.577e-05 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102681+0000", 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.102934+0000", 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025325100000000002 2024-04-17T15:38:27.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.103425+0000", 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049086500000000005 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.104689+0000", 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012646879999999999 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105549+0000", 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085963200000000004 2024-04-17T15:38:27.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105637+0000", 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8438999999999998e-05 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105702+0000", 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5005999999999994e-05 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.783 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.596210020000001, 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030913970000000001, 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105963+0000", 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105965+0000", 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.105975+0000", 2024-04-17T15:38:27.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9729999999999992e-06 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106001+0000", 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6253000000000001e-05 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106015+0000", 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3353000000000001e-05 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106141+0000", 2024-04-17T15:38:27.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012648600000000001 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106412+0000", 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027110699999999998 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.106757+0000", 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000344657 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108260+0000", 2024-04-17T15:38:27.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015027949999999999 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108842+0000", 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058205799999999999 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.108934+0000", 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1792999999999993e-05 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.109054+0000", 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120665 2024-04-17T15:38:27.788 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.526095978000001, 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030928700000000002, 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.789 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 913 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176077+0000", 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176080+0000", 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8030000000000001e-06 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176092+0000", 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2306999999999999e-05 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176122+0000", 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9569000000000001e-05 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176143+0000", 2024-04-17T15:38:27.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.156e-05 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176345+0000", 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020190099999999999 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176576+0000", 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231091 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.176903+0000", 2024-04-17T15:38:27.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000326874 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.178180+0000", 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001276868 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179011+0000", 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083103199999999999 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179102+0000", 2024-04-17T15:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0919000000000001e-05 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.179170+0000", 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.497450372000003, 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031669530000000001, 2024-04-17T15:38:27.794 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 925 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204723+0000", 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204725+0000", 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204737+0000", 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2116000000000001e-05 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204768+0000", 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0676999999999998e-05 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204789+0000", 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1739999999999999e-05 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.204946+0000", 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015635099999999999 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205169+0000", 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223062 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.205492+0000", 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032312699999999998 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.206626+0000", 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011343589999999999 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207735+0000", 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011090659999999999 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207824+0000", 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8603000000000005e-05 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.207890+0000", 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5642000000000006e-05 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.799 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.490050805999999, 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030226580000000001, 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 928 2024-04-17T15:38:27.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212122+0000", 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212124+0000", 2024-04-17T15:38:27.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1840000000000002e-06 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212136+0000", 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2106000000000001e-05 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212176+0000", 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9643e-05 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212196+0000", 2024-04-17T15:38:27.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212325+0000", 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012877200000000001 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212601+0000", 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000275588 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.212945+0000", 2024-04-17T15:38:27.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034397600000000001 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214619+0000", 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016741779999999999 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.214908+0000", 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028898299999999998 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215028+0000", 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120456 2024-04-17T15:38:27.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.215145+0000", 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116369 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.485885822, 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032898250000000001, 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 930 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:27.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216287+0000", 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216288+0000", 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3260000000000001e-06 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216297+0000", 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0770000000000008e-06 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216318+0000", 2024-04-17T15:38:27.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1869999999999999e-05 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216329+0000", 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.079e-05 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216469+0000", 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013962499999999999 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.216725+0000", 2024-04-17T15:38:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025639100000000002 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.217223+0000", 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049742899999999997 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.218588+0000", 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00136539 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:27.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219283+0000", 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069527 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219452+0000", 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168708 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.219577+0000", 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012494900000000001 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.810 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:27.811 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:27.811 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:27.812 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:27.812 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:27.810+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:27.913 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:27.913+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:27.988 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:27.988 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:27.988 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:27.989 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:28.003 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:28.047 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:28.046+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:28.115 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:28.113+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:28.123 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:28.123 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:28.123 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:28.123 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:28.123 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:28.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:28.224 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:28.222+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:28.309 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:28.309 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:28.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:28.309 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:28.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.043025353999994, 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:38:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:38:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:38:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:38:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.032260768, 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:38:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:38:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:38:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.028091261, 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.020963836000007, 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.034924410000002, 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.974018978000004, 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:38:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:38:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.955886200999998, 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.952212068999998, 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:38:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:38:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:38:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:38:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.923096787000006, 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:38:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:38:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:38:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.889063999000001, 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.853067891999999, 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:38:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:38:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:38:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.765651508000005, 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:38:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:38:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.763113438000005, 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.510754743000007, 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.488452652999996, 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:38:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:38:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:38:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.416679778000002, 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.222449577999996, 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.183174254999997, 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:38:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:38:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:38:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:38:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.062488549999998, 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:38:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:38:28.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 82.057835604000005, 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:38:28.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:38:28.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:38:28.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.417 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.417 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.417 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:38:28.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:28.419 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:28.414+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:28.519 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:28.517+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:28.597 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:28.598 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:28.612 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:28.620 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:28.621+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:28.721 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:28.718+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:28.732 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:28.732 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:28.732 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:28.732 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:28.732 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:28.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:28.821 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:28.821+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:28.909 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.658858851000005, 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:38:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:38:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:38:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:38:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.626888545, 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:38:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:38:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.609552528999998, 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.607017886999998, 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:38:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:38:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:38:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:38:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.506464261999994, 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:38:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.613399532000003, 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.590266837000001, 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:38:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:38:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.550033350999996, 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.495499320999997, 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.474717698999996, 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:38:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:38:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:38:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.474306510000005, 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:38:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.471915105999997, 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:38:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:38:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.471817047000002, 2024-04-17T15:38:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:38:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.469111218999998, 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:38:28.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:28.986 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.436375678999994, 2024-04-17T15:38:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:38:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:38:28.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.991 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.427355520000006, 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:28.995 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.422740172999994, 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:28.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:28.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:28.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.000 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.413346941, 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.380004245999999, 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.009 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.010 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.010 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:29.010 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:29.010 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.320244477000003, 2024-04-17T15:38:29.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:38:29.010 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.014 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:29.016 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:29.016 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:29.014+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:29.116 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:29.117+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:29.193 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:29.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:29.194 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:29.194 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:29.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:29.255 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:29.254+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:29.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:29.319 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:29.318+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:29.329 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:29.329 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:29.329 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:29.329 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:29.329 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:29.343 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:29.420 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:29.421+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:29.477 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:29.506 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:29.507 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:29.517 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 101.44334868999999, 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:38:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:38:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:38:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:38:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:38:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 101.16125070299999, 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 101.161078549, 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:38:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:38:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:38:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 101.161039719, 2024-04-17T15:38:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:38:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:38:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:38:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.951623529, 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:38:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.95156204600001, 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:38:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:38:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:38:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:38:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.951355468, 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:38:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.951315519, 2024-04-17T15:38:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:38:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:38:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:38:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.951276596, 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:38:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:38:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:38:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.95107701400001, 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:38:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.951031782, 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.724966404, 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:38:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.72484269500001, 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:38:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:38:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:38:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.72474154, 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:38:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:38:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:38:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:38:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.72471832399999, 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:38:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:38:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:38:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:38:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:38:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.72469691400001, 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.72459095000001, 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:38:29.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.72456624900001, 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:38:29.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:38:29.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:38:29.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:38:29.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:38:29.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:29.631 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.724545232, 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:38:29.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:38:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:38:29.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.724430708, 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:29.637 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:29.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:29.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:29.642 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:29.643 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:29.644 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:29.644 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:29.644 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:29.645 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:29.646 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:29.647 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:29.647 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:29.641+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:29.667 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:29.745 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:29.746+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:29.757 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:29.770 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:29.846 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:29.842+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:29.881 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:29.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:29.947 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:29.945+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:30.003 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:30.015 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:30.048 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:30.050+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:30.149 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:30.150+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:30.163 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:30.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:30.251 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:30.246+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:30.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:30.352 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:30.350+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:30.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:38:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:30.453 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:30.453 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:30.453+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:30.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:30.556 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:30.557+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:30.654 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:30.650+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:30.671 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:30.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:30.780 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:30.781+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:30.855 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:30.853+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:30.860 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:30.956 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:30.957+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:31.013 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:31.013 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:31.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:31.068 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:31.069+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:31.159 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:31.158+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:31.175 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:31.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:31.209 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-17T15:38:31.210 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-17T15:38:31.210 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-17T15:38:31.210 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-17T15:38:31.210 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-17T15:38:31.210 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-17T15:38:31.260 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:31.258+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:31.321 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:38:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:31.329 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:31.351 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:31.360 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:31.358+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:31.391 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-17T15:38:31.391 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:31.461 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:31.461+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:31.473 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:31.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:31.562 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:31.558+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:31.630 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:31.631 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:31.645 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:31.663 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:31.661+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:31.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:31.764 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:31.765+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:31.811 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:31.811 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:31.825 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:31.865 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:31.865+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:31.868 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:31.900 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:31.900 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:31.930 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:31.930 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:31.945 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:31.945 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:31.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:31.960 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:31.966 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:31.965+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:32.021 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:32.038 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:32.039 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:32.057 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:32.067 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:32.065+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:32.090 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:32.091 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:32.105 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:32.168 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:32.166+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:32.234 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:32.234 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:32.249 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:32.292 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:32.290+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:32.370 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:32.369+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.147478251999999, 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.416 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.136713666000006, 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.422 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:38:32.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.132544159000005, 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:38:32.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:38:32.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:38:32.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:38:32.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:38:32.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:38:32.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:38:32.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:38:32.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:38:32.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:38:32.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:38:32.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:38:32.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:38:32.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:38:32.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:38:32.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:38:32.437 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.437 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.437 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.438 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:32.438 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:32.438 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.125416733999998, 2024-04-17T15:38:32.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:38:32.438 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.438 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.439 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.439 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.439 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.439 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.439 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:38:32.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.439 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:38:32.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:32.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:38:32.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:38:32.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:38:32.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:38:32.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:38:32.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:38:32.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:38:32.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:38:32.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:38:32.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:38:32.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:38:32.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:38:32.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:38:32.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:38:32.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:38:32.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:38:32.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:38:32.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:38:32.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:38:32.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:38:32.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.449 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.450 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:32.450 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:32.450 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.139377307999993, 2024-04-17T15:38:32.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:38:32.451 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.451 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.451 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.451 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.451 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.451 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.451 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:38:32.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.452 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:32.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:32.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:38:32.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:38:32.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:38:32.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:38:32.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:38:32.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:38:32.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:38:32.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:38:32.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:38:32.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:38:32.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:38:32.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:38:32.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:38:32.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.078471875999995, 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:32.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.060339099000004, 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.473 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.474 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.474 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:32.474 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.056664967000003, 2024-04-17T15:38:32.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:38:32.474 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:38:32.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:38:32.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:38:32.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.027549684999997, 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.480 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:32.485 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.993516897000006, 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:38:32.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:38:32.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:38:32.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.957520790000004, 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:38:32.496 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.870104405999996, 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:32.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:38:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.867566335999996, 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.615207640999998, 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:32.511 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.592905551000001, 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:32.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:38:32.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:38:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:38:32.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.521132675999993, 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.517 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:32.522 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.326902476000001, 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.527 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.287627153000003, 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:38:32.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:38:32.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:38:32.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:38:32.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:38:32.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.166941448000003, 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.533 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:38:32.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:38:32.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:38:32.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.162288501999996, 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:32.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:32.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:32.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:32.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:38:32.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:38:32.544 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.544 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.544 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.544 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:32.544 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:32.544 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:32.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:32.546 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:32.545+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:32.647 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:32.646+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:32.678 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:32.678 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:32.678 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:32.678 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:32.692 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:32.747 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:32.745+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:32.849 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:32.849+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:32.863 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:32.863 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:32.863 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:32.863 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:32.864 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:32.878 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:32.949 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:32.949+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:33.000 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:33.000 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:33.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:33.000 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:33.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.000 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.749545009000002, 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:38:33.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.007 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.717574702999997, 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.700238686999995, 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.018 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.697704044999995, 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:38:33.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:38:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:38:33.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:38:33.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.597150420000006, 2024-04-17T15:38:33.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:38:33.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:38:33.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:33.028 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.704085689999999, 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:33.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:38:33.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:33.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:38:33.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:38:33.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:38:33.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:38:33.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.034 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.680952994999998, 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:33.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:38:33.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:38:33.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:38:33.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.640719508999993, 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.586185478999994, 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.043 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:38:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:38:33.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.565403857000007, 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.564992668000002, 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:33.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:38:33.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:38:33.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:38:33.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.562601263999994, 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.562503204999999, 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.060 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:38:33.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:38:33.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:38:33.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.559797376999995, 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:38:33.064 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.068 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.527061837000005, 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:33.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.518041678000003, 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:38:33.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:38:33.077 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.513426331000005, 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:33.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:38:33.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:38:33.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.504033098999997, 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.085 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.470690403999996, 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:33.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:38:33.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:38:33.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:38:33.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 87.410930635, 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:38:33.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:38:33.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.094 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.094 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.094 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:33.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:33.096 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:33.094+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:33.196 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:33.197+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:33.271 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:33.271 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:33.271 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:33.271 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:33.286 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:33.297 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:33.297+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:33.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:38:33.404 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:33.405+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:33.406 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:33.406 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:33.406 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:33.406 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:33.406 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:33.421 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:33.499 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:33.497+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:33.552 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:33.552 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:33.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:33.552 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.478169859, 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:38:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:38:33.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:38:33.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:38:33.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:38:33.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.196071872, 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:38:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:38:33.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.564 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.19589971800001, 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:38:33.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.570 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.195860888, 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.571 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:38:33.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:38:33.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:38:33.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:38:33.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.986444698, 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:38:33.576 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.986383215, 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.582 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:38:33.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:38:33.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:38:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:38:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.986176637, 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:38:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:38:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.986136688, 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:38:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:38:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:38:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:38:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:38:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.986097765, 2024-04-17T15:38:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.985898183, 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:38:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:38:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:38:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:38:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:38:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.985852951, 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:38:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:38:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:38:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.759787573, 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:38:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:38:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:38:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:38:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.759663864, 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:38:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:38:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:38:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.75956270899999, 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:38:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.75953949300001, 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:38:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:38:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:38:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.759518083, 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:38:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:38:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.759412119, 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.759387418, 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:38:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:38:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:38:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:38:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.75936640099999, 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:38:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:38:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:38:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:38:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 104.759251877, 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:33.666 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:33.668 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:33.666+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:33.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:33.769 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:33.769+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:33.779 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:33.779 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:33.779 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:33.792 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:33.880 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:33.881+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:33.951 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:33.951 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:33.951 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:33.951 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:33.951 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:33.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:34.008 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:34.009+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:34.071 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:34.070+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:34.079 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:34.131 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:34.131 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:34.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:34.131 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:34.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.131 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:38:34.131 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:34.131 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.800288518, 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:38:34.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:38:34.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.79896466, 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:38:34.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:38:34.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.773758321, 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.140 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:38:34.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:38:34.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:38:34.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.771587033, 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.144 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:38:34.148 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.770094163, 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:34.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.768534417, 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:38:34.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:38:34.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:38:34.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.766036701, 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.764415378, 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.161 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:38:34.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:38:34.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:38:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.56062790999999, 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:38:34.165 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:34.169 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 91.824709694000006, 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:34.170 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.171 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.172 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.173 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.174 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.852759610000007, 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.175 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.176 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.177 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.178 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.179 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:34.180 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.833792568000007, 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.181 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.182 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.183 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.803820924999997, 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.186 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:34.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:38:34.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:38:34.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.191 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.788607221000007, 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:38:34.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:38:34.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:38:34.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:38:34.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:38:34.196 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.759208643999997, 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.197 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:38:34.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.741709700000001, 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.206 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.685831965000006, 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.208 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:38:34.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:38:34.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.577394733000006, 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:38:34.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:38:34.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:38:34.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:38:34.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:38:34.218 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.550891554000003, 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.219 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:38:34.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:34.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:34.224 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 58.699850073999997, 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:38:34.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:38:34.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:38:34.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:38:34.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:38:34.230 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.230 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.230 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.230 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:34.230 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:34.230 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:34.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:34.232 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:34.232 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:34.232 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:34.233 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:34.233 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:34.229+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:34.248 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:34.248 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:34.266 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:34.285 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:34.285 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:34.305 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:34.305 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:34.325 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:34.325 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:34.332 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:34.330+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:34.346 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:34.346 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:34.349 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:38:34.365 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:34.365 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:34.382 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:34.433 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:34.430+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:34.534 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:34.533+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:34.536 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:34.537 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:34.551 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:34.635 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:34.630+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:34.711 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:34.711 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:34.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:34.736 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:34.738+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:34.837 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:34.837+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:34.845 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:34.846 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:34.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:34.938 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:34.938+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:35.015 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:35.015 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:35.028 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:35.076 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:35.077+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:35.140 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:35.141+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:35.157 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:35.157 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:35.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:35.242 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:35.238+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:35.342 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:35.341+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:35.343 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:35.343 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:35.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:35.443 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:35.442+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:35.513 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:35.513 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:35.527 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:35.545 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:35.546+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:35.645 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:35.646+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:35.657 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:35.658 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:35.672 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:35.746 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:35.745+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:35.806 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:35.806 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:35.821 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:35.867 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:35.866+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:35.948 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:35.948 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:35.948 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:35.946+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:35.963 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:36.051 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:36.050+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:36.136 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:36.137 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:36.151 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:36.151 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:36.149+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:36.252 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:36.249+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:36.324 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:36.324 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:36.338 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:36.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:36.382 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:38:36.388 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:36.386+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:36.463 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:36.463 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:36.464 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:36.465+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:36.479 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:36.523 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:36.524 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:36.541 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:36.541 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:36.558 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:36.558 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:36.563 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:36.562+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:36.576 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:36.576 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:36.596 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:36.596 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:36.615 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:36.615 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:36.635 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:36.635 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:36.651 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:36.651 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:36.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:36.651 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:36.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.382625524000005, 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032674150000000001, 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266976+0000", 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266978+0000", 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8959999999999999e-06 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.266989+0000", 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.147e-05 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267018+0000", 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8946e-05 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267042+0000", 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3632999999999999e-05 2024-04-17T15:38:36.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267158+0000", 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116316 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267385+0000", 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000227128 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.267724+0000", 2024-04-17T15:38:36.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033908000000000001 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.269424+0000", 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001699971 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270083+0000", 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065826399999999998 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270178+0000", 2024-04-17T15:38:36.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4828999999999996e-05 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.270243+0000", 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5882000000000004e-05 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4440.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.371860937999998, 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033222049999999999, 2024-04-17T15:38:36.657 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4440", 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3929315806", 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 41 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277741+0000", 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277742+0000", 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.807e-06 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277751+0000", 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0629999999999995e-06 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277777+0000", 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5126e-05 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277795+0000", 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8479999999999999e-05 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.277981+0000", 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186322 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278210+0000", 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022902400000000001 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.278558+0000", 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034787400000000002 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280081+0000", 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015231120000000001 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.280910+0000", 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082872800000000004 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281000+0000", 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0229000000000006e-05 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:58.281063+0000", 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2440000000000005e-05 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.662 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.367691430999997, 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067046930000000003, 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 48 2024-04-17T15:38:36.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281910+0000", 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281912+0000", 2024-04-17T15:38:36.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1459999999999999e-06 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281922+0000", 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8679999999999994e-06 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281955+0000", 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3303000000000003e-05 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.281970+0000", 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4574e-05 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282122+0000", 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197400000000001 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282463+0000", 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034116300000000001 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282768+0000", 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030472399999999998 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284704+0000", 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001935958 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288423+0000", 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037193009999999999 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288549+0000", 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012636900000000001 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288615+0000", 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5313000000000003e-05 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94040977410176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:36.668 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.360564006000004, 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064523050000000002, 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 49 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:36.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289038+0000", 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289040+0000", 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289051+0000", 2024-04-17T15:38:36.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1739999999999999e-05 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289085+0000", 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3565999999999997e-05 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289101+0000", 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.56e-05 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289225+0000", 2024-04-17T15:38:36.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012491499999999999 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289357+0000", 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013138900000000001 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.289631+0000", 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027401699999999999 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.290863+0000", 2024-04-17T15:38:36.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001232602 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295170+0000", 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043066479999999997 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295333+0000", 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016334100000000001 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.295490+0000", 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015637 2024-04-17T15:38:36.673 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.374524579999999, 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040982680000000004, 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.674 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 205 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275077+0000", 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275080+0000", 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0599999999999999e-06 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275095+0000", 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5373e-05 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275131+0000", 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.595e-05 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275150+0000", 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8813000000000001e-05 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275294+0000", 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014372500000000001 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.275554+0000", 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000259998 2024-04-17T15:38:36.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.276013+0000", 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000458966 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.277654+0000", 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001641644 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.278856+0000", 2024-04-17T15:38:36.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201819 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279064+0000", 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000207658 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.279175+0000", 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011126200000000001 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.313619148000001, 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036787220000000002, 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 220 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335982+0000", 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335985+0000", 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9699999999999999e-06 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.335998+0000", 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.257e-05 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336030+0000", 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2329999999999997e-05 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336046+0000", 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5415999999999999e-05 2024-04-17T15:38:36.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336240+0000", 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019440500000000001 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336462+0000", 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022233800000000001 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.336887+0000", 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042454899999999998 2024-04-17T15:38:36.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.338568+0000", 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001681028 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339494+0000", 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092610100000000003 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339582+0000", 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7645999999999994e-05 2024-04-17T15:38:36.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.339661+0000", 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9369000000000005e-05 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.295486370999996, 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033688580000000002, 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 225 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354115+0000", 2024-04-17T15:38:36.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354117+0000", 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9130000000000001e-06 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354128+0000", 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0514e-05 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354159+0000", 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.154e-05 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354175+0000", 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5846e-05 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354373+0000", 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019773499999999999 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.354587+0000", 2024-04-17T15:38:36.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021396499999999999 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.355011+0000", 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042431499999999998 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.356660+0000", 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001649188 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357311+0000", 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065101600000000003 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357404+0000", 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3245999999999995e-05 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357484+0000", 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9579999999999994e-05 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.291812238999995, 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034191870000000002, 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 226 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357789+0000", 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357792+0000", 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2929999999999999e-06 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357803+0000", 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1389999999999999e-05 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357835+0000", 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2048999999999998e-05 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357854+0000", 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8822999999999999e-05 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.357967+0000", 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011325299999999999 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358191+0000", 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022343800000000001 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358635+0000", 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000444592 2024-04-17T15:38:36.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360240+0000", 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001604718 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361055+0000", 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081498300000000003 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361139+0000", 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3849000000000003e-05 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.361208+0000", 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9799e-05 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.262696957000003, 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033078090000000001, 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.696 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 234 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386905+0000", 2024-04-17T15:38:36.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386906+0000", 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.863e-06 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386917+0000", 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0457e-05 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386945+0000", 2024-04-17T15:38:36.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8609999999999999e-05 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.386960+0000", 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4333e-05 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387076+0000", 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116328 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387296+0000", 2024-04-17T15:38:36.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000220325 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.387756+0000", 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000459596 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.389136+0000", 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013801200000000001 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390066+0000", 2024-04-17T15:38:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092956400000000002 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390146+0000", 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0653000000000002e-05 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.390212+0000", 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5959999999999999e-05 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:365 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.228664168999998, 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003313528, 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 365 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420937+0000", 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420939+0000", 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.703e-06 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420950+0000", 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0944000000000001e-05 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.420977+0000", 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7123000000000001e-05 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421017+0000", 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9619000000000001e-05 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421345+0000", 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032852700000000001 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.421701+0000", 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035612000000000003 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.422295+0000", 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059372500000000003 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.423822+0000", 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527275 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424062+0000", 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000239297 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424146+0000", 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4083000000000001e-05 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.424251+0000", 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010511200000000001 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.192668061999996, 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037267870000000001, 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.707 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 436 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456933+0000", 2024-04-17T15:38:36.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456935+0000", 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3400000000000001e-06 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456943+0000", 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9999999999999996e-06 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456966+0000", 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3543000000000001e-05 2024-04-17T15:38:36.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.456977+0000", 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0815999999999999e-05 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457075+0000", 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7542999999999998e-05 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457227+0000", 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015221200000000001 2024-04-17T15:38:36.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.457542+0000", 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031505299999999998 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.459093+0000", 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015513650000000001 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460371+0000", 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001277528 2024-04-17T15:38:36.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460547+0000", 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017580199999999999 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.460660+0000", 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113585 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.712 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:567 6.1c e30/24 6:388bc67b:::obj_delete_at_hint.0000000022:head v 30'9, mlcod=30'7)", 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.105251678000002, 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037052529999999999, 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544350+0000", 2024-04-17T15:38:36.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544351+0000", 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.297e-06 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544361+0000", 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4399999999999994e-06 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544383+0000", 2024-04-17T15:38:36.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2416999999999999e-05 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544394+0000", 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0574000000000001e-05 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544598+0000", 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204654 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.544632+0000", 2024-04-17T15:38:36.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4069000000000002e-05 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547931+0000", 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032988129999999998 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.548055+0000", 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012398899999999999 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:568 6.4 e30/24 6:24c8e1ae:gc::gc.19:head v 30'14, mlcod=30'12)", 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.102713608000002, 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035142459999999999, 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546888+0000", 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546889+0000", 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7999999999999993e-07 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546897+0000", 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3480000000000004e-06 2024-04-17T15:38:36.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546916+0000", 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.546928+0000", 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1814000000000001e-05 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547039+0000", 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111117 2024-04-17T15:38:36.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.547064+0000", 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550324+0000", 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032593040000000002 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.550402+0000", 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8415000000000001e-05 2024-04-17T15:38:36.720 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.850354913000004, 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033642580000000002, 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.721 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 754 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799247+0000", 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799249+0000", 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2170000000000001e-06 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799260+0000", 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1523e-05 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799292+0000", 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1760000000000001e-05 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799310+0000", 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7946000000000001e-05 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799465+0000", 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015497199999999999 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.799821+0000", 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035637 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.800382+0000", 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056062199999999999 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802023+0000", 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001640877 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802311+0000", 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000288547 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802489+0000", 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017756900000000001 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.802611+0000", 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121855 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:36.726 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.828052822999993, 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034335809999999998, 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 763 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821549+0000", 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821551+0000", 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1299999999999999e-06 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821562+0000", 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:36.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821592+0000", 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0533000000000001e-05 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821607+0000", 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5173e-05 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.821770+0000", 2024-04-17T15:38:36.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162938 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822146+0000", 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037574700000000001 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.822740+0000", 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059437400000000005 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824048+0000", 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013078880000000001 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824702+0000", 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00065410000000000002 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824864+0000", 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016130199999999999 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.824982+0000", 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118709 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.756279948, 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003559666, 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.732 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 793 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893322+0000", 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893324+0000", 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4899999999999999e-06 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893336+0000", 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2224e-05 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893367+0000", 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1186000000000003e-05 2024-04-17T15:38:36.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893383+0000", 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5820000000000001e-05 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893536+0000", 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.893906+0000", 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037031599999999998 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.894499+0000", 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059258100000000001 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.895869+0000", 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013697970000000001 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896614+0000", 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074534600000000003 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896767+0000", 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153475 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.896881+0000", 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113899 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.562049748000007, 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032695229999999999, 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 876 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:36.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087552+0000", 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087554+0000", 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087565+0000", 2024-04-17T15:38:36.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.136e-05 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087600+0000", 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4347000000000002e-05 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087615+0000", 2024-04-17T15:38:36.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5760000000000002e-05 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087758+0000", 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014232099999999999 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.087994+0000", 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023622500000000001 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.088488+0000", 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049402500000000004 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.089838+0000", 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013504210000000001 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090539+0000", 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000700207 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090698+0000", 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015902099999999999 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.090821+0000", 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123626 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.522774424999994, 2024-04-17T15:38:36.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623308, 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 892 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126827+0000", 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126830+0000", 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4200000000000001e-06 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126841+0000", 2024-04-17T15:38:36.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1556000000000001e-05 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126873+0000", 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1925999999999999e-05 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.126889+0000", 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-05 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127048+0000", 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015944900000000001 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.127427+0000", 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037878 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.128028+0000", 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060112999999999996 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.129392+0000", 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013644810000000001 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130224+0000", 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083171799999999995 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130314+0000", 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0216000000000005e-05 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.130450+0000", 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136012 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.402088719999995, 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036592510000000001, 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.750 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 943 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247513+0000", 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247515+0000", 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8029999999999999e-06 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247524+0000", 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1500000000000005e-06 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247547+0000", 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306999999999999e-05 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247560+0000", 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.288e-05 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.247714+0000", 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153602 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248083+0000", 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036950600000000002 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.248676+0000", 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059293400000000004 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.249955+0000", 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012795110000000001 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.250887+0000", 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000931098 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251045+0000", 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015889499999999999 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.251172+0000", 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012656500000000001 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:945 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:36.755 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 90.397435774000002, 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034452630000000001, 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 945 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:36.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252166+0000", 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252168+0000", 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252178+0000", 2024-04-17T15:38:36.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0363000000000001e-05 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252210+0000", 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2357000000000002e-05 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252225+0000", 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5026e-05 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:36.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252355+0000", 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012945200000000001 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.252603+0000", 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000247645 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.253098+0000", 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049594099999999996 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.254307+0000", 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012083059999999999 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255336+0000", 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00102921 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255494+0000", 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015832500000000001 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:36.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:06.255611+0000", 2024-04-17T15:38:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116675 2024-04-17T15:38:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:36.761 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:36.761 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:36.762 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:36.762 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to '5bf3b3a9b161d70b9aa7806055bdae202e03111c'. 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-04-17T15:38:36.763 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T15:38:36.764 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-04-17T15:38:36.764 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T15:38:36.764 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-04-17T15:38:36.764 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T15:38:36.764 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-17T15:38:36.764 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-17T15:38:36.764 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at 5bf3b3a9b16 boost/redis: Point boost_redis submodule to 1.85 tag 2024-04-17T15:38:36.765 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:36.765 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:36.762+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:36.766 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-17T15:38:36.815 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-17T15:38:36.818 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T15:38:36.819 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-17T15:38:36.863 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:36.862+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:36.940 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:36.940 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:36.940 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:36.941 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:36.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:37.000 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:36.998+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:37.065 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:37.062+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:37.119 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:37.119 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:37.119 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:37.119 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:37.134 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:37.176 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:37.174+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:37.267 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:37.262+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:37.307 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 95.056454371000001, 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.308 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:38:37.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:38:37.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:37.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:38:37.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:38:37.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 95.024484064999996, 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:38:37.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:38:37.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:38:37.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 95.007148048999994, 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023133310000000001, 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.322 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 54 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299423+0000", 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299425+0000", 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3159999999999999e-06 2024-04-17T15:38:37.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299436+0000", 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1046999999999999e-05 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299467+0000", 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0756000000000002e-05 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299482+0000", 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5356999999999999e-05 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299609+0000", 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012685800000000001 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299780+0000", 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171187 2024-04-17T15:38:37.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.299939+0000", 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015851 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301340+0000", 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001401334 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301540+0000", 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200428 2024-04-17T15:38:37.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301619+0000", 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8771999999999997e-05 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301736+0000", 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116766 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.328 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 95.004613406999994, 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:38:37.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.904059782000004, 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001698141, 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402511+0000", 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402513+0000", 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2330000000000001e-06 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402529+0000", 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6337e-05 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402570+0000", 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106999999999998e-05 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402590+0000", 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9865999999999999e-05 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402764+0000", 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017388200000000001 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.402801+0000", 2024-04-17T15:38:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6585999999999998e-05 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404111+0000", 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001310161 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.404209+0000", 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7968999999999997e-05 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 92.010995051999998, 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020742130000000001, 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295576+0000", 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7999999999999995e-07 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295584+0000", 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.926e-06 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295612+0000", 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-05 2024-04-17T15:38:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295629+0000", 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7549000000000001e-05 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295783+0000", 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153313 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.295822+0000", 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9688999999999999e-05 2024-04-17T15:38:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297548+0000", 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001725124 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.297650+0000", 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102142 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:215 6.3 e30/24 6:c31f41d7:gc::gc.10:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.987862356999997, 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001832363, 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318708+0000", 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318710+0000", 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0899999999999999e-06 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318726+0000", 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5489999999999999e-05 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318760+0000", 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4489999999999997e-05 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318780+0000", 2024-04-17T15:38:37.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318913+0000", 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013325300000000001 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.318963+0000", 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9385999999999998e-05 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320458+0000", 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014952019999999999 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.320541+0000", 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2572999999999997e-05 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:226 6.a e30/24 6:5127e642:gc::gc.21:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:37.349 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.947628871000006, 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017987330000000001, 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:37.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358942+0000", 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358955+0000", 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2366e-05 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.358989+0000", 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3983000000000003e-05 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359010+0000", 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0962999999999999e-05 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359183+0000", 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173432 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.359241+0000", 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7862999999999998e-05 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360659+0000", 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001418093 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.360740+0000", 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1285999999999994e-05 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.353 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:318 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.893094841000007, 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022542579999999999, 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413476+0000", 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413477+0000", 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729999999999999e-06 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413485+0000", 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9829999999999996e-06 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413515+0000", 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0377000000000001e-05 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413536+0000", 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0662999999999999e-05 2024-04-17T15:38:37.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413691+0000", 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015527800000000001 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.413745+0000", 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3996999999999998e-05 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415608+0000", 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018625849999999999 2024-04-17T15:38:37.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.415730+0000", 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122302 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:394 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'1, mlcod=0'0)", 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:37.358 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.872313219000006, 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017798759999999999, 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434257+0000", 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434259+0000", 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.906e-06 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434303+0000", 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4206999999999999e-05 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434340+0000", 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.684e-05 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434376+0000", 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5642000000000002e-05 2024-04-17T15:38:37.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434522+0000", 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014628199999999999 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434573+0000", 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0756e-05 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.435855+0000", 2024-04-17T15:38:37.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012824710000000001 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.436037+0000", 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018177199999999999 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:37.364 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.871902030000001, 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:38:37.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.368 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.869510625999993, 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:37.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.869412566999998, 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:38:37.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:38:37.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:37.377 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.866706738999994, 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:37.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:38:37.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:38:37.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:464 6.1 e30/24 6:80b6fe23:reshard::reshard.0000000011:head v 30'4, mlcod=30'2)", 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.833971199000004, 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018285129999999999, 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472599+0000", 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472601+0000", 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5370000000000001e-06 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472615+0000", 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4116e-05 2024-04-17T15:38:37.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472685+0000", 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472712+0000", 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6157e-05 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472872+0000", 2024-04-17T15:38:37.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016037899999999999 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.472926+0000", 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129000000000003e-05 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474316+0000", 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013895509999999999 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.474428+0000", 2024-04-17T15:38:37.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112305 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:476 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'9, mlcod=30'6)", 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.824951040000002, 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001735592, 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481620+0000", 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481621+0000", 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6279999999999999e-06 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481634+0000", 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481662+0000", 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-05 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481679+0000", 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6477000000000002e-05 2024-04-17T15:38:37.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481806+0000", 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012715799999999999 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.481860+0000", 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3803e-05 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483276+0000", 2024-04-17T15:38:37.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014162459999999999 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.483355+0000", 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9163000000000001e-05 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:483 6.3 e30/24 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 30'10, mlcod=30'8)", 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.820335693000004, 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001901626, 2024-04-17T15:38:37.390 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486235+0000", 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486237+0000", 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486249+0000", 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1929999999999999e-05 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486279+0000", 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486292+0000", 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.348e-05 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486437+0000", 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014475600000000001 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.486498+0000", 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1311999999999998e-05 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488051+0000", 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015525560000000001 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.488137+0000", 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5476000000000006e-05 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:501 6.15 e30/24 6:ab569f81:gc::gc.12:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:37.394 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.810942460999996, 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018895839999999999, 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495628+0000", 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495630+0000", 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5799999999999999e-06 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495643+0000", 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3716e-05 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495674+0000", 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0511999999999999e-05 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495689+0000", 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4854e-05 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495862+0000", 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017303899999999999 2024-04-17T15:38:37.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.495917+0000", 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5105000000000002e-05 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497392+0000", 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474766 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.497518+0000", 2024-04-17T15:38:37.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126012 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.777599765999994, 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:611 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 91.717839996999999, 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018622350000000001, 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.403 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588731+0000", 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588733+0000", 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9630000000000001e-06 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588745+0000", 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.241e-05 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588773+0000", 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8129000000000001e-05 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588789+0000", 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5903999999999999e-05 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.588943+0000", 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154048 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.589012+0000", 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9200000000000002e-05 2024-04-17T15:38:37.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590473+0000", 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014611660000000001 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.590593+0000", 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011941499999999999 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.407 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:37.408 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:38:37.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:37.410 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:37.409+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:37.510 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:37.506+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:37.583 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-17T15:38:37.584 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:37.585 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:37.585 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:37.585 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:37.600 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:37.610 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:37.609+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:37.681 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-17T15:38:37.711 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:37.709+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:37.731 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T15:38:37.732 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T15:38:37.733 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-17T15:38:37.764 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:37.765 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:37.765 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:37.765 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:37.765 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:37.779 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T15:38:37.780 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:37.782 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-17T15:38:37.782 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-17T15:38:37.824 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:37.825+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:37.829 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-04-17T15:38:37.830 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-04-17T15:38:37.830 DEBUG:teuthology.orchestra.run.smithi044:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5bf3b3a9b161d70b9aa7806055bdae202e03111c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.83683571500001, 2024-04-17T15:38:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:38:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:38:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:38:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:38:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.55473772800001, 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:38:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.55456557399999, 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:38:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.554526744, 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:38:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:38:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.345110554, 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.34504907100001, 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.344842493, 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:38:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:38:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:38:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.344802544, 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:38:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:38:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:38:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:38:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.344763621, 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:38:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.34456403900001, 2024-04-17T15:38:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:38:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:38:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:38:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:38:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:38:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.344518807, 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:38:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:38:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.118453429, 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:38:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:38:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:38:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:38:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.11832972000001, 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:38:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:38:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:38:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.118228565, 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:38:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:38:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:38:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:38:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.11820534899999, 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:38:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.11818393900001, 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:38:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.11807797500001, 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:38:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:38:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:38:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:38:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.118053274, 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:38:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:38:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:38:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.118032257, 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 109.117917733, 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:38.024 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:38.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:38:38.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:38.029 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:38.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:38.032 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:38.029+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:38.132 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:38.130+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:38.153 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:38.153 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:38.153 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:38.153 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:38.169 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:38.198 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records in 2024-04-17T15:38:38.198 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records out 2024-04-17T15:38:38.198 INFO:tasks.workunit.client.0.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00943347 s, 1.1 GB/s 2024-04-17T15:38:38.233 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:38.230+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:38.297 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:38.297 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:38.298 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:38.298 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:38.298 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:38.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:38.334 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:38.330+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:38.435 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:38.430+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:38.437 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_38 2024-04-17T15:38:38.484 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:38.484 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:38.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:38.484 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 110.153801962, 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:38.489 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 110.152478104, 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:38.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:38:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:38:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 110.127271765, 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032929370000000001, 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.494 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357445+0000", 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357447+0000", 2024-04-17T15:38:38.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.03e-06 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357623+0000", 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017609200000000001 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357656+0000", 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2736e-05 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357677+0000", 2024-04-17T15:38:38.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0937e-05 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357763+0000", 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6012000000000003e-05 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.357787+0000", 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3941e-05 2024-04-17T15:38:38.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360649+0000", 2024-04-17T15:38:38.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028616800000000001 2024-04-17T15:38:38.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.360738+0000", 2024-04-17T15:38:38.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9509e-05 2024-04-17T15:38:38.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.499 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.500 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:38:38.500 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:38.500 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 110.125100477, 2024-04-17T15:38:38.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:38:38.500 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.500 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.501 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.501 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:38.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:38:38.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:38:38.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:38:38.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:38:38.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:38:38.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:38:38.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:38:38.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:38:38.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:38:38.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:38:38.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:38:38.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:38:38.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:38:38.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:38:38.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:38:38.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:38:38.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.508 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.509 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:38:38.509 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:38.509 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 110.123607607, 2024-04-17T15:38:38.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:38:38.509 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.510 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.510 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.510 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:38.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:38.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:38:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:38:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:38:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:38:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:38:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:38:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:38:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:38:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:38:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:38:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:38:38.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:38:38.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:38:38.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:38:38.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:38:38.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:38:38.518 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.518 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.518 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.518 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:38:38.519 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:38.519 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 110.122047861, 2024-04-17T15:38:38.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:38:38.519 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.519 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.519 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.520 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:38.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:38:38.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:38:38.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 110.11955014500001, 2024-04-17T15:38:38.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:38.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:38:38.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:38:38.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:38:38.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:38:38.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:38:38.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:38:38.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:38:38.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:38:38.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:38:38.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:38:38.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:38:38.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:38:38.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.531 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 110.117928822, 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:38.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:38:38.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:38:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:38:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:38:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.538 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'66)", 2024-04-17T15:38:38.538 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:38:38.538 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 109.91414135399999, 2024-04-17T15:38:38.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003099877, 2024-04-17T15:38:38.538 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.538 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570576+0000", 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7800000000000001e-07 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570582+0000", 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2850000000000002e-06 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570595+0000", 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3261000000000001e-05 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570602+0000", 2024-04-17T15:38:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8029999999999999e-06 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570652+0000", 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0132e-05 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.570674+0000", 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1891000000000001e-05 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573653+0000", 2024-04-17T15:38:38.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029792619999999999 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.573676+0000", 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2565000000000002e-05 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 96.178223138000007, 2024-04-17T15:38:38.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:38:38.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:38:38.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:38:38.548 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.548 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.548 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.548 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:38.548 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 93.206273053999993, 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:38:38.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:38.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:38:38.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 93.187306011999993, 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:38:38.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:38:38.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:38.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:38:38.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:38:38.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:38:38.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:38:38.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 93.157334368999997, 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:38:38.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:38:38.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 93.142120664999993, 2024-04-17T15:38:38.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181321, 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 222 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342596+0000", 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342599+0000", 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7530000000000002e-06 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342612+0000", 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3329999999999999e-05 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342643+0000", 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.057e-05 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342658+0000", 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.471e-05 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.342827+0000", 2024-04-17T15:38:38.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169669 2024-04-17T15:38:38.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343062+0000", 2024-04-17T15:38:38.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000234995 2024-04-17T15:38:38.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:38.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.343490+0000", 2024-04-17T15:38:38.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042754700000000002 2024-04-17T15:38:38.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.344934+0000", 2024-04-17T15:38:38.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014439629999999999 2024-04-17T15:38:38.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345625+0000", 2024-04-17T15:38:38.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00069119799999999996 2024-04-17T15:38:38.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345708+0000", 2024-04-17T15:38:38.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2903000000000002e-05 2024-04-17T15:38:38.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.345778+0000", 2024-04-17T15:38:38.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9683000000000004e-05 2024-04-17T15:38:38.577 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.577 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.577 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.578 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:38.578 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:38:38.578 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 93.112722087999998, 2024-04-17T15:38:38.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033354729999999998, 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 230 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.579 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:38:38.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371995+0000", 2024-04-17T15:38:38.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.371997+0000", 2024-04-17T15:38:38.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5900000000000002e-06 2024-04-17T15:38:38.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372009+0000", 2024-04-17T15:38:38.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1866e-05 2024-04-17T15:38:38.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372040+0000", 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0777e-05 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372055+0000", 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4409e-05 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372168+0000", 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113113 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372392+0000", 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022471500000000001 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.372840+0000", 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00044781399999999999 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.374077+0000", 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001236678 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375172+0000", 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010948119999999999 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375261+0000", 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9813000000000002e-05 2024-04-17T15:38:38.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.375330+0000", 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8886000000000004e-05 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 93.095223144000002, 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003282348, 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.586 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 235 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389494+0000", 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389496+0000", 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2340000000000001e-06 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389507+0000", 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1236000000000001e-05 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389538+0000", 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0647e-05 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389553+0000", 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4557e-05 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389679+0000", 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012610900000000001 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.389923+0000", 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00024470500000000001 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.390352+0000", 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042848000000000002 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.391681+0000", 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013294069999999999 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392623+0000", 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00094137699999999997 2024-04-17T15:38:38.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392713+0000", 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9956000000000004e-05 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.392776+0000", 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3639999999999994e-05 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 93.039345409000006, 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 92.930908177000006, 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0032923980000000002, 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.598 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 577 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553809+0000", 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553811+0000", 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9539999999999998e-06 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553821+0000", 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.044e-05 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553849+0000", 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7506000000000001e-05 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.553862+0000", 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554006+0000", 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143764 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554347+0000", 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00034121800000000001 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.554864+0000", 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00051679899999999997 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556214+0000", 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013505800000000001 2024-04-17T15:38:38.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.556970+0000", 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075559499999999996 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557045+0000", 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5234000000000005e-05 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.557101+0000", 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5908000000000001e-05 2024-04-17T15:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:606 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 92.904404998000004, 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029663239999999998, 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.604 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 606 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580312+0000", 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580315+0000", 2024-04-17T15:38:38.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580330+0000", 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5063e-05 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580367+0000", 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7376000000000003e-05 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580393+0000", 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5542999999999999e-05 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580501+0000", 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108699 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.580692+0000", 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019079899999999999 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:38.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.581182+0000", 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00049011900000000001 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.582343+0000", 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011607810000000001 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583140+0000", 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00079723200000000004 2024-04-17T15:38:38.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583220+0000", 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0159000000000003e-05 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.583278+0000", 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8023000000000003e-05 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.609 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 63.053363517999998, 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:38.615 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:38.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:38.617 INFO:tasks.workunit.client.0.smithi044.stdout:quota set for the bucket: buck_2024_03_17_15_38_38 2024-04-17T15:38:38.617 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:38.617+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:38.718 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:38.717+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:38.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:38.785 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:38.785 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:38.785 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:38.785 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:38.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:38.819 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:38.814+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:38.865 INFO:tasks.workunit.client.0.smithi044.stdout:quota enabled for the bucket: buck_2024_03_17_15_38_38 2024-04-17T15:38:38.865 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 10Mb. 2024-04-17T15:38:38.865 INFO:tasks.workunit.client.0.smithi044.stdout:upload file successful 2024-04-17T15:38:38.865 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:38.866 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - Test max objects passed 2024-04-17T15:38:38.866 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:38.920 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:38.918+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:38.926 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:38.927 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:38.946 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:38.946 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:38.963 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:38.963 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:38.976 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:38.976 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:38.982 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:38.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:39.004 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:39.004 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:39.026 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:39.027 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:39.025+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:39.049 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:39.070 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:39.071 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:39.122 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:39.118+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:39.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:39.157 INFO:tasks.workunit.client.0.smithi044.stdout:user qa_user deleted 2024-04-17T15:38:39.157 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:39.187 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records in 2024-04-17T15:38:39.187 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records out 2024-04-17T15:38:39.188 INFO:tasks.workunit.client.0.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0288675 s, 363 MB/s 2024-04-17T15:38:39.223 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:39.221+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:39.270 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:39.271 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:39.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:39.332 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:39.333+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:39.360 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_39 2024-04-17T15:38:39.425 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:39.422+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:39.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:38:39.449 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:39.449 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:39.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:39.525 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:39.522+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:39.626 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:39.622+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:39.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:39.666 INFO:tasks.workunit.client.0.smithi044.stdout:bucket quota max_objs set for the given user: buck_2024_03_17_15_38_39 2024-04-17T15:38:39.727 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:39.725+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:39.772 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:39.772 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:39.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:39.828 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:39.826+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:39.929 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:39.926+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:39.939 INFO:tasks.workunit.client.0.smithi044.stdout:quota enabled for the bucket: buck_2024_03_17_15_38_39 2024-04-17T15:38:39.939 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 10Mb. 2024-04-17T15:38:39.939 INFO:tasks.workunit.client.0.smithi044.stdout:upload file successful 2024-04-17T15:38:39.939 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:39.939 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - Test max objects for the given user passed 2024-04-17T15:38:39.940 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:39.950 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:39.950 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:39.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:40.030 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:40.029+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:40.089 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:40.089 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:40.102 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:40.147 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:40.146+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:40.212 INFO:tasks.workunit.client.0.smithi044.stdout:user qa_user deleted 2024-04-17T15:38:40.213 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:40.231 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:40.229+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:40.244 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:40.244 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:40.245 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records in 2024-04-17T15:38:40.245 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records out 2024-04-17T15:38:40.245 INFO:tasks.workunit.client.0.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0301796 s, 347 MB/s 2024-04-17T15:38:40.259 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:40.332 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:40.329+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:40.392 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_40 2024-04-17T15:38:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:38:40.434 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:40.433+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:40.438 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:40.438 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:40.454 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:40.536 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:40.533+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:40.543 INFO:tasks.workunit.client.0.smithi044.stdout:quota set for the bucket: buck_2024_03_17_15_38_40 2024-04-17T15:38:40.585 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:40.586 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:40.601 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:40.647 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:40.646+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:40.728 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:40.728 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:40.739 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:40.737+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:40.743 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:40.792 INFO:tasks.workunit.client.0.smithi044.stdout:quota enabled for the bucket: buck_2024_03_17_15_38_40 2024-04-17T15:38:40.793 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 10Mb. 2024-04-17T15:38:40.793 INFO:tasks.workunit.client.0.smithi044.stdout:upload file successful 2024-04-17T15:38:40.807 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records in 2024-04-17T15:38:40.807 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records out 2024-04-17T15:38:40.807 INFO:tasks.workunit.client.0.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115692 s, 906 MB/s 2024-04-17T15:38:40.839 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:40.838+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:40.866 INFO:tasks.workunit.client.0.smithi044.stdout:readding file to bucket: 10MBfile1 2024-04-17T15:38:40.866 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:40.866 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-04-17T15:38:40.866 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:40.911 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:40.912 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:40.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:40.940 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:40.941+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:41.041 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:41.041+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:41.091 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:41.106 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:41.106 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:41.122 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:41.131 INFO:tasks.workunit.client.0.smithi044.stdout:user qa_user deleted 2024-04-17T15:38:41.131 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:41.167 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:41.166+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:41.191 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records in 2024-04-17T15:38:41.191 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records out 2024-04-17T15:38:41.192 INFO:tasks.workunit.client.0.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0568098 s, 185 MB/s 2024-04-17T15:38:41.233 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:41.242 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:41.242 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:41.243 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:41.242+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:41.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:41.250 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:41.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:41.268 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:41.269 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:41.286 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:41.286 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:41.306 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:41.326 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:41.344 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:41.342+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:41.345 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:41.346 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_41 2024-04-17T15:38:41.364 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:41.364 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:41.433 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:41.434 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:41.434 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:41.434 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:41.434 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:41.444 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:41.445+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:41.451 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:41.545 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:41.542+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:41.605 INFO:tasks.workunit.client.0.smithi044.stdout:bucket quota max_objs set for the given user: buck_2024_03_17_15_38_41 2024-04-17T15:38:41.634 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 99.382953825000001, 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.635 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:38:41.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:38:41.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:38:41.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:38:41.641 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 99.350983518999996, 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:41.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:38:41.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:38:41.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:38:41.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:38:41.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:38:41.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94040977404416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 99.331112860999994, 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032592430000000002, 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.648 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 55 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301957+0000", 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301959+0000", 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6700000000000001e-06 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301969+0000", 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0404000000000001e-05 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.301996+0000", 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6339999999999999e-05 2024-04-17T15:38:41.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302029+0000", 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302172+0000", 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142769 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302431+0000", 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025925699999999999 2024-04-17T15:38:41.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.302872+0000", 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044054599999999999 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.303982+0000", 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001110183 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.304968+0000", 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098615000000000009 2024-04-17T15:38:41.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305061+0000", 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3048999999999996e-05 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.305216+0000", 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015531599999999999 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.653 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:395 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 96.198401484000001, 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038933890000000001, 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434669+0000", 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434670+0000", 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5400000000000001e-06 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434684+0000", 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4209999999999999e-05 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434708+0000", 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4153000000000001e-05 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434720+0000", 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1943000000000001e-05 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434851+0000", 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013064899999999999 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.434904+0000", 2024-04-17T15:38:41.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2839e-05 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438473+0000", 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035689160000000001 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.438562+0000", 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9139000000000002e-05 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 96.196010079999994, 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.661 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 96.195912020999998, 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:38:41.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:38:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:38:41.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 96.193206192999995, 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 96.104099219999995, 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.670 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:38:41.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:38:41.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:38:41.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5049.0:14 5.2 5:40000000::::head [pgnls start_epoch 71] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:38:41.674 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.3347804160000001, 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065939630000000004, 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5049", 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2262844792", 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 14 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298292+0000", 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3700000000000002e-06 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298304+0000", 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1946999999999999e-05 2024-04-17T15:38:41.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298324+0000", 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9959e-05 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298344+0000", 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0420000000000001e-05 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298487+0000", 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014289500000000001 2024-04-17T15:38:41.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298497+0000", 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.008e-05 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304538+0000", 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060409690000000002 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304605+0000", 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6632999999999997e-05 2024-04-17T15:38:41.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304884+0000", 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027869 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5049.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.321598+0000", 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.3114724459999998, 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002937884, 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5049", 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2262844792", 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 44 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.321598+0000", 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.321598+0000", 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.321600+0000", 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0030000000000001e-06 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.321612+0000", 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1977000000000001e-05 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.321641+0000", 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9867000000000001e-05 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.321656+0000", 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4126e-05 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.321766+0000", 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110592 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.321907+0000", 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141042 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.322110+0000", 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020318199999999999 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.323324+0000", 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012139989999999999 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324379+0000", 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010545800000000001 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324468+0000", 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8949000000000005e-05 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324535+0000", 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7566999999999999e-05 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5049.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94492072938928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.324860+0000", 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.3082105180000001, 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034899309999999999, 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.685 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5049", 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2262844792", 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 45 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324860+0000", 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324860+0000", 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324861+0000", 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5430000000000001e-06 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324869+0000", 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0360000000000006e-06 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324894+0000", 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5003000000000001e-05 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.324907+0000", 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.294e-05 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.325058+0000", 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015097900000000001 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.325308+0000", 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024982500000000001 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.325769+0000", 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000460798 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.326967+0000", 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011980230000000001 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.327990+0000", 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010237709999999999 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.328161+0000", 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017023200000000001 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.328349+0000", 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018878100000000001 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.690 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1166 4.a 4:532b3d6b:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.425119+0000", 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.207950968, 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039043910000000001, 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1166 2024-04-17T15:38:41.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425119+0000", 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425119+0000", 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425122+0000", 2024-04-17T15:38:41.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8329999999999998e-06 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425136+0000", 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4557e-05 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425179+0000", 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2861999999999997e-05 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425202+0000", 2024-04-17T15:38:41.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2427000000000001e-05 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425377+0000", 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175205 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425754+0000", 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037741700000000001 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.426179+0000", 2024-04-17T15:38:41.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042513199999999999 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.428157+0000", 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019777530000000001 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.428763+0000", 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060578800000000001 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.428911+0000", 2024-04-17T15:38:41.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014817199999999999 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.429023+0000", 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011224499999999999 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4886.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93990071066256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.547517+0000", 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.0855527600000001, 2024-04-17T15:38:41.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031600980000000001, 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4886", 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/385706602", 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 45 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.547517+0000", 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.547517+0000", 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.547519+0000", 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.39e-06 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.547527+0000", 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.32e-06 2024-04-17T15:38:41.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.547553+0000", 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6376e-05 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.547565+0000", 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2043e-05 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.547680+0000", 2024-04-17T15:38:41.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114783 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.547807+0000", 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126458 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.548040+0000", 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023285800000000001 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.549430+0000", 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001390468 2024-04-17T15:38:41.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.550297+0000", 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00086732900000000002 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.550465+0000", 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016789800000000001 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.550677+0000", 2024-04-17T15:38:41.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021217499999999999 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4886.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.554471+0000", 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.0785993829999998, 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065120239999999999, 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.702 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4886", 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/385706602", 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 52 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554471+0000", 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554471+0000", 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554473+0000", 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4700000000000001e-06 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554486+0000", 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2463000000000001e-05 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554522+0000", 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6507000000000001e-05 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554544+0000", 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1429000000000001e-05 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554670+0000", 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012646200000000001 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554815+0000", 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000144683 2024-04-17T15:38:41.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.555071+0000", 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025674399999999999 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.556256+0000", 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011847190000000001 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.560821+0000", 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045650760000000004 2024-04-17T15:38:41.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.560906+0000", 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4611999999999996e-05 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.560983+0000", 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6859000000000004e-05 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4886.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93990071066256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.707 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.579626+0000", 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.0534436789999999, 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029513999999999999, 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4886", 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/385706602", 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 68 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.579626+0000", 2024-04-17T15:38:41.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.579626+0000", 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.579628+0000", 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.137e-06 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.579640+0000", 2024-04-17T15:38:41.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1875999999999999e-05 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.579672+0000", 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1242999999999999e-05 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.579686+0000", 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4856e-05 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.579839+0000", 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000152726 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.580084+0000", 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024442499999999999 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.580545+0000", 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046093799999999998 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.581734+0000", 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00118965 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.582384+0000", 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00064990100000000004 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.582471+0000", 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6445000000000003e-05 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.582578+0000", 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107203 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4904.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.708509+0000", 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.9245607800000002, 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028625909999999998, 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.713 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4904", 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/296037479", 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 44 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.708509+0000", 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.708509+0000", 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.708511+0000", 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1169999999999998e-06 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.708522+0000", 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0285999999999999e-05 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.708553+0000", 2024-04-17T15:38:41.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1013999999999998e-05 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.708568+0000", 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4846e-05 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.708679+0000", 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111836 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.708809+0000", 2024-04-17T15:38:41.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129832 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.709001+0000", 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000191872 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.710123+0000", 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011220959999999999 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711181+0000", 2024-04-17T15:38:41.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001057594 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711266+0000", 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5445999999999995e-05 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711372+0000", 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105652 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4904.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846831124192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.711529+0000", 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.9215415170000001, 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029479300000000001, 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4904", 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/296037479", 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 45 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711529+0000", 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711529+0000", 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711530+0000", 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.823e-06 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711539+0000", 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6240000000000008e-06 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711564+0000", 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5466e-05 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711577+0000", 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2683e-05 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711686+0000", 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109159 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.711809+0000", 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012265600000000001 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.712023+0000", 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000213845 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.713264+0000", 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012412980000000001 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.714172+0000", 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000907645 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.714275+0000", 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103396 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.714476+0000", 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201335 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4904.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846831124192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.740400+0000", 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.8926696070000002, 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028381779999999998, 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.724 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4904", 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/296037479", 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 68 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740400+0000", 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740400+0000", 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740403+0000", 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.097e-06 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740412+0000", 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8630000000000003e-06 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740443+0000", 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1007000000000003e-05 2024-04-17T15:38:41.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740458+0000", 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4786e-05 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740568+0000", 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010998200000000001 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740701+0000", 2024-04-17T15:38:41.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013329600000000001 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.740930+0000", 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228321 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.741949+0000", 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001019287 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.743029+0000", 2024-04-17T15:38:41.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010801109999999999 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.743117+0000", 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7571999999999994e-05 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.743239+0000", 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012185599999999999 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4928.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94920316658336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.964691+0000", 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.66837926, 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029765669999999998, 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4928", 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/847961461", 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 45 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.964691+0000", 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.964691+0000", 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.964693+0000", 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1940000000000001e-06 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.964706+0000", 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2629000000000001e-05 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.964742+0000", 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6077e-05 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.964762+0000", 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0579999999999999e-05 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.964888+0000", 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012560199999999999 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.965011+0000", 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012317200000000001 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.965245+0000", 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000234021 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.966910+0000", 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001664722 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.967277+0000", 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036713000000000002 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.967447+0000", 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017057899999999999 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.967667+0000", 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021986099999999999 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5343.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023866921664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.564881+0000", 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.068188998000000001, 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029521460000000001, 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:41.735 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5343", 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3297006156", 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 45 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.564881+0000", 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.564881+0000", 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:41.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.564882+0000", 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0720000000000001e-06 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.564887+0000", 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4680000000000003e-06 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.564900+0000", 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3301e-05 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.564907+0000", 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.703e-06 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.564952+0000", 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5290999999999997e-05 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.565011+0000", 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9101000000000002e-05 2024-04-17T15:38:41.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.565122+0000", 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110561 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.567297+0000", 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002175396 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.567670+0000", 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037264600000000002 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.567740+0000", 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0721000000000003e-05 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.567833+0000", 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2886000000000005e-05 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:41.740 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:41.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:41.742 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:41.738+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:41.841 INFO:tasks.workunit.client.0.smithi044.stdout:quota enabled for the bucket: buck_2024_03_17_15_38_41 2024-04-17T15:38:41.841 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 10Mb. 2024-04-17T15:38:41.841 INFO:tasks.workunit.client.0.smithi044.stdout:upload file successful 2024-04-17T15:38:41.842 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:41.841+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:41.867 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records in 2024-04-17T15:38:41.867 INFO:tasks.workunit.client.0.smithi044.stderr:1+0 records out 2024-04-17T15:38:41.867 INFO:tasks.workunit.client.0.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0234377 s, 447 MB/s 2024-04-17T15:38:41.899 INFO:tasks.workunit.client.0.smithi044.stdout:readding file to bucket: 10MBfile1 2024-04-17T15:38:41.899 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:41.899 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-04-17T15:38:41.900 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:41.919 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:41.919 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:41.920 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:41.920 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:41.934 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:41.943 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:41.941+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:42.044 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:42.042+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:42.070 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:42.070 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:42.070 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:42.070 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:42.070 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:42.086 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:42.171 INFO:tasks.workunit.client.0.smithi044.stdout:user qa_user deleted 2024-04-17T15:38:42.171 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:42.175 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:42.174+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:42.246 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:42.242+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:42.270 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 114.196128067, 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.271 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.278 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.91403008, 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:38:42.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:38:42.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.91385792600001, 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.284 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:38:42.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:38:42.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:38:42.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.290 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.913819096, 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:38:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:38:42.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:38:42.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:38:42.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:38:42.297 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.297 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.297 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.298 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.298 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:42.298 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.704402906, 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:38:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:38:42.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:38:42.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:38:42.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.704341423, 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.304 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:38:42.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:38:42.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.704134845, 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.704094896, 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.316 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:38:42.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:38:42.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:38:42.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:38:42.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.704055973, 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:38:42.322 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:38:42.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:38:42.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:38:42.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:38:42.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:38:42.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:38:42.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:38:42.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:38:42.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:38:42.329 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.329 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.329 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.330 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.330 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:42.330 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.703856391, 2024-04-17T15:38:42.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:38:42.330 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.331 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.331 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.331 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:38:42.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.332 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:42.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:38:42.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:38:42.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:38:42.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:38:42.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:38:42.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:38:42.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:38:42.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:38:42.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.339 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.703811159, 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:38:42.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:38:42.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.477745781, 2024-04-17T15:38:42.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:38:42.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:38:42.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:38:42.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:38:42.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:38:42.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:38:42.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:38:42.351 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.477622072, 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.352 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:42.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.357 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.47752091700001, 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.358 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:38:42.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:38:42.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:38:42.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:38:42.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.364 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.364 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.365 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:42.365 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.477497701, 2024-04-17T15:38:42.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:38:42.365 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.365 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.365 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.366 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.366 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.366 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:38:42.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.366 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:42.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:42.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:42.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:38:42.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:38:42.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:38:42.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:38:42.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:38:42.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.477476291, 2024-04-17T15:38:42.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.379 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.477370327, 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:38:42.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:38:42.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:38:42.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:38:42.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:38:42.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:38:42.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.387 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.387 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:42.387 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.477345626, 2024-04-17T15:38:42.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:38:42.387 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.387 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.388 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.388 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.388 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.388 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.388 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:38:42.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.388 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:42.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:42.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:42.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:38:42.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:38:42.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:38:42.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:38:42.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:38:42.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:38:42.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:38:42.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:38:42.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:38:42.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:38:42.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:38:42.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:38:42.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:38:42.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:38:42.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:38:42.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:38:42.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:38:42.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:38:42.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:38:42.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:38:42.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:38:42.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.399 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.400 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.400 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:42.400 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.47732460899999, 2024-04-17T15:38:42.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:38:42.400 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.400 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.400 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.400 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:42.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:42.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:38:42.406 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 113.477210085, 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.407 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:42.408 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:42.408 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:42.408 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:38:42.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.408 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:42.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:42.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:42.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:42.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:42.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:42.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:42.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:38:42.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:38:42.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:42.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:38:42.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:38:42.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:42.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:38:42.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:42.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:38:42.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:38:42.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:42.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:38:42.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:38:42.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:42.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:38:42.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:38:42.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:42.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:38:42.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:38:42.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:42.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:38:42.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:38:42.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:38:42.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:38:42.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:42.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:38:42.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:38:42.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:42.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:42.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:42.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:38:42.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:38:42.418 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.418 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.418 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.418 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:42.419 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:42.419 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:42.420 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_42 2024-04-17T15:38:42.421 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:42.421+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:42.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:42.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:38:42.510 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:42.510 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_17_15_38_42 with max size as zero 2024-04-17T15:38:42.510 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:42.510 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:42.521 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:42.521+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:42.541 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:42.541 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:42.542 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:42.542 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:42.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:42.622 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:42.618+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:42.682 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_42 2024-04-17T15:38:42.723 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:42.721+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:42.725 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:42.725 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:42.725 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:42.725 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:42.725 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:42.745 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:42.824 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:42.822+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:42.883 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:42.883 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_17_15_38_42 with max objects as zero 2024-04-17T15:38:42.883 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:42.883 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:42.905 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 114.57512606900001, 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033490640000000001, 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330915+0000", 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.330916+0000", 2024-04-17T15:38:42.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8299999999999995e-07 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331090+0000", 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174296 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331115+0000", 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.508e-05 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331134+0000", 2024-04-17T15:38:42.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8363e-05 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331258+0000", 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124726 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.331293+0000", 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4409000000000002e-05 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334158+0000", 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002865041 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.334264+0000", 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106166 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:42.910 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 114.573802211, 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 114.54642458399999, 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 114.544931714, 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:38:42.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:38:42.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:38:42.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 114.543371968, 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:38:42.923 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'17)", 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 114.54087425199999, 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033476539999999998, 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365167+0000", 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365168+0000", 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.42e-06 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365178+0000", 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0227000000000001e-05 2024-04-17T15:38:42.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365201+0000", 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2932999999999999e-05 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365213+0000", 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1433e-05 2024-04-17T15:38:42.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365293+0000", 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0492000000000001e-05 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365317+0000", 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3153999999999999e-05 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368467+0000", 2024-04-17T15:38:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031506749999999999 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368514+0000", 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7320000000000001e-05 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 114.539252929, 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:38:42.932 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:38:42.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.936 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 100.599547245, 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:42.937 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 97.627597160999997, 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.943 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:38:42.948 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 97.608630118999997, 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 97.578658476000001, 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 97.460669515999996, 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 67.474687625000001, 2024-04-17T15:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.969 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.969 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:42.969 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:42.969 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:42.969 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:38:42.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.970 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:42.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:42.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:42.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:38:42.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:38:42.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:38:42.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:38:42.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:38:42.976 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.976 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.976 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.977 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1195 3.b e71/18 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-17T15:38:42.977 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:42.977 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.0542307429999997, 2024-04-17T15:38:42.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015153946, 2024-04-17T15:38:42.977 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.977 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.977 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.977 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:42.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:42.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851811+0000", 2024-04-17T15:38:42.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6400000000000002e-07 2024-04-17T15:38:42.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854045+0000", 2024-04-17T15:38:42.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339170000000002 2024-04-17T15:38:42.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854070+0000", 2024-04-17T15:38:42.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5125000000000001e-05 2024-04-17T15:38:42.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854085+0000", 2024-04-17T15:38:42.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.552e-05 2024-04-17T15:38:42.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854172+0000", 2024-04-17T15:38:42.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6213999999999998e-05 2024-04-17T15:38:42.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854199+0000", 2024-04-17T15:38:42.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7472999999999999e-05 2024-04-17T15:38:42.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866900+0000", 2024-04-17T15:38:42.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012700421999999999 2024-04-17T15:38:42.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866964+0000", 2024-04-17T15:38:42.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4710999999999998e-05 2024-04-17T15:38:42.990 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.990 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1558 4.1e 4:7ad4bdc7:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.4.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.5690501139999999, 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048677649999999996, 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:42.991 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1558 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336992+0000", 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3120000000000001e-06 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337000+0000", 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4529999999999996e-06 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337014+0000", 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3804e-05 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337024+0000", 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0645000000000001e-05 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337112+0000", 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.81e-05 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337259+0000", 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146217 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337407+0000", 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014810499999999999 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.338606+0000", 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011993399999999999 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341796+0000", 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003190525 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341831+0000", 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999997e-05 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341859+0000", 2024-04-17T15:38:42.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7433999999999999e-05 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1592 3.3e e72/18 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head v 72'3, mlcod=71'1)", 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.097758158, 2024-04-17T15:38:42.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0073548179999999999, 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:42.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808284+0000", 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4190000000000001e-06 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809131+0000", 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084668500000000002 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809149+0000", 2024-04-17T15:38:42.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7768e-05 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809158+0000", 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7369999999999995e-06 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809216+0000", 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.808e-05 2024-04-17T15:38:43.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809240+0000", 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4026e-05 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815577+0000", 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063376090000000001 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815638+0000", 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0494000000000001e-05 2024-04-17T15:38:43.001 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1786 4.2f 4:f4ba1581:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.40624979100000003, 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0069053769999999999, 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.002 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1786 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499792+0000", 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1030000000000001e-06 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499801+0000", 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0040000000000005e-06 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499817+0000", 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5254e-05 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499823+0000", 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9370000000000001e-06 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499916+0000", 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3423000000000003e-05 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499995+0000", 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9138e-05 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500091+0000", 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6224999999999994e-05 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501645+0000", 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015532160000000001 2024-04-17T15:38:43.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506580+0000", 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049358099999999997 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506645+0000", 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4945999999999998e-05 2024-04-17T15:38:43.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506697+0000", 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1320999999999999e-05 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1788 4.37 4:ee283571:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.40619811500000003, 2024-04-17T15:38:43.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068546459999999998, 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1788 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499844+0000", 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7000000000000005e-07 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499847+0000", 2024-04-17T15:38:43.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0520000000000002e-06 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499856+0000", 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3389999999999999e-06 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499862+0000", 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8850000000000004e-06 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500390+0000", 2024-04-17T15:38:43.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052792900000000001 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500457+0000", 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6812999999999999e-05 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500557+0000", 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100766 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501651+0000", 2024-04-17T15:38:43.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010932540000000001 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506600+0000", 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049490549999999999 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506654+0000", 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4381e-05 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506698+0000", 2024-04-17T15:38:43.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3602e-05 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1802 4.3b 4:dfd801eb:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.23861570300000001, 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037103000000000001, 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.014 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1802 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667426+0000", 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9599999999999998e-07 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667432+0000", 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0299999999999999e-06 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667443+0000", 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0817e-05 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667448+0000", 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2089999999999996e-06 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667508+0000", 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9923999999999998e-05 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667637+0000", 2024-04-17T15:38:43.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012862299999999999 2024-04-17T15:38:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667797+0000", 2024-04-17T15:38:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016047199999999999 2024-04-17T15:38:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668846+0000", 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010481920000000001 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671034+0000", 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002188892 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671092+0000", 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7629e-05 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671136+0000", 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3615999999999997e-05 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1805 4.3b 4:dd40f243:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.23857467199999999, 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041858249999999998, 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.020 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1805 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667467+0000", 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8400000000000005e-07 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667470+0000", 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4759999999999998e-06 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667478+0000", 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3880000000000002e-06 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667484+0000", 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7919999999999998e-06 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668363+0000", 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087990599999999996 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668481+0000", 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118016 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668631+0000", 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000149068 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671544+0000", 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002913601 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671559+0000", 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4842e-05 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671610+0000", 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0581000000000002e-05 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671652+0000", 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2670999999999999e-05 2024-04-17T15:38:43.025 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.026 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.026 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.026 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.026 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.026 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:43.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:43.028 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:43.026+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:43.052 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_43 2024-04-17T15:38:43.128 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:43.129+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:43.142 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:43.142 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:43.142 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:43.142 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:43.156 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:43.244 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:43.245+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:43.260 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:43.261 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_17_15_38_43 max objects -1 2024-04-17T15:38:43.261 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:43.261 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:43.313 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:43.314 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:43.314 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:43.314 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:43.314 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:43.330 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:43.330 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:43.326+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:43.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:43.428 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_43 2024-04-17T15:38:43.431 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:43.426+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:43.431 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:38:43.506 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:43.507 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:43.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:43.507 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:43.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.507 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 101.225086844, 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:38:43.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:38:43.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:38:43.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:38:43.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:38:43.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:38:43.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:38:43.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:38:43.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:38:43.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:38:43.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:38:43.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:38:43.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:38:43.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:38:43.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:38:43.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:38:43.516 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.516 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.516 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.517 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:43.517 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:43.517 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 101.21846919799999, 2024-04-17T15:38:43.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:38:43.517 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.518 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.518 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.518 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:43.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:43.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:38:43.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:38:43.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:38:43.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:38:43.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:38:43.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:38:43.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:38:43.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:38:43.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:38:43.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:38:43.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:38:43.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:38:43.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:38:43.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:38:43.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:38:43.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:38:43.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.525 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.526 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:43.526 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:43.526 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 101.218131559, 2024-04-17T15:38:43.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:38:43.526 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:43.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:43.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:38:43.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:38:43.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:38:43.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:38:43.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:38:43.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:38:43.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:38:43.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:38:43.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:38:43.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:38:43.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:38:43.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:38:43.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:38:43.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:38:43.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:38:43.534 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.535 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.535 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:43.536 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:43.536 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 98.218716478999994, 2024-04-17T15:38:43.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:38:43.536 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:38:43.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:38:43.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 97.962201172999997, 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.543 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:38:43.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 97.943014148000003, 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:38:43.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:38:43.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:38:43.556 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.557 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.557 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.557 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4886.0:47 7.0 e71/26 7:05bf5b68:::notify.1:head v 71'7, mlcod=71'5)", 2024-04-17T15:38:43.557 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.550728+0000", 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.9565869439999997, 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037588779999999998, 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550728+0000", 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550728+0000", 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550729+0000", 2024-04-17T15:38:43.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0200000000000001e-07 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550735+0000", 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7230000000000001e-06 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550748+0000", 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.292e-05 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550755+0000", 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8789999999999997e-06 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550808+0000", 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3109000000000003e-05 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550829+0000", 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1191000000000001e-05 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.554443+0000", 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036143709999999999 2024-04-17T15:38:43.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.554487+0000", 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3983000000000002e-05 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4886.0:49 7.15 e71/26 7:a93a5511:::notify.2:head v 71'7, mlcod=71'5)", 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.9540042910000004, 2024-04-17T15:38:43.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004153403, 2024-04-17T15:38:43.564 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.564 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.564 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.564 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:43.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553312+0000", 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2099999999999996e-07 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553317+0000", 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5779999999999998e-06 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553328+0000", 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1114999999999999e-05 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553334+0000", 2024-04-17T15:38:43.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1070000000000004e-06 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553390+0000", 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6314999999999999e-05 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553405+0000", 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5305999999999999e-05 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.557426+0000", 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040211689999999998 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.557464+0000", 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8092000000000001e-05 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.568 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4886.0:52 7.d e71/26 7:b4812045:::notify.4:head v 71'6, mlcod=71'4)", 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.9523089589999998, 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052142220000000001, 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555007+0000", 2024-04-17T15:38:43.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2200000000000003e-07 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555013+0000", 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2339999999999999e-06 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555024+0000", 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0964e-05 2024-04-17T15:38:43.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555030+0000", 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.113e-06 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555086+0000", 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6699e-05 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555101+0000", 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4402e-05 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.560184+0000", 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0050833450000000004 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.560221+0000", 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6643000000000001e-05 2024-04-17T15:38:43.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1192 3.1a e71/18 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head v 71'1, mlcod=0'0)", 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.6749759769999999, 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012590545, 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832340+0000", 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.91e-07 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837330+0000", 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049904620000000002 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837357+0000", 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6974999999999998e-05 2024-04-17T15:38:43.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837370+0000", 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837437+0000", 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6382000000000002e-05 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837455+0000", 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8284e-05 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844890+0000", 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074353930000000002 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844930+0000", 2024-04-17T15:38:43.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9458000000000001e-05 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5153.0:48 7.15 e72/26 7:a93a5511:::notify.2:head v 72'51, mlcod=72'49)", 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.8114000379999999, 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041848639999999999, 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695916+0000", 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2900000000000002e-07 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695924+0000", 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1419999999999993e-06 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695935+0000", 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1103e-05 2024-04-17T15:38:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695944+0000", 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695986+0000", 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2580000000000002e-05 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695998+0000", 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1800000000000001e-05 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.700073+0000", 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040746050000000002 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.700100+0000", 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7344000000000001e-05 2024-04-17T15:38:43.583 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1592 3.3e 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.700425554, 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0089542040000000003, 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.584 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1592 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806892+0000", 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3989999999999998e-06 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807868+0000", 2024-04-17T15:38:43.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00097551400000000003 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807890+0000", 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2503000000000001e-05 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807900+0000", 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7550000000000006e-06 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807964+0000", 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3801999999999997e-05 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808072+0000", 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107871 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808170+0000", 2024-04-17T15:38:43.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8197999999999997e-05 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815570+0000", 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074005779999999997 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815774+0000", 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020377899999999999 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815812+0000", 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8098e-05 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815844+0000", 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1707e-05 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1791 4.f 4:f28dd39d:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.0074602560000001, 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038841430000000001, 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1791 2024-04-17T15:38:43.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499857+0000", 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4249999999999999e-06 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499862+0000", 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5759999999999996e-06 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499879+0000", 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7019000000000001e-05 2024-04-17T15:38:43.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499888+0000", 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1470000000000007e-06 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499951+0000", 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3083000000000006e-05 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500041+0000", 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0039999999999999e-05 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500139+0000", 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8010000000000005e-05 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501520+0000", 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001380362 2024-04-17T15:38:43.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503644+0000", 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002124403 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503695+0000", 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1031e-05 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503739+0000", 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4047e-05 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1809 4.27 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.667493+0000", 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.839822768, 2024-04-17T15:38:43.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037478020000000002, 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1809 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667493+0000", 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667493+0000", 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667495+0000", 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.328e-06 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667504+0000", 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2259999999999994e-06 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667527+0000", 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2693000000000001e-05 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667537+0000", 2024-04-17T15:38:43.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:38:43.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667603+0000", 2024-04-17T15:38:43.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6167999999999994e-05 2024-04-17T15:38:43.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667687+0000", 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4430000000000003e-05 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667791+0000", 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010377100000000001 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.670658+0000", 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002867278 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671147+0000", 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048887300000000002 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671200+0000", 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2698999999999998e-05 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671240+0000", 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0482000000000003e-05 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1804 4.39 e72/20 4:9d2afefb:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.3:head v 72'3, mlcod=71'1)", 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.83844353800000004, 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046620460000000004, 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668873+0000", 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4900000000000005e-07 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668883+0000", 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9450000000000005e-06 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668896+0000", 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3396e-05 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668904+0000", 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5610000000000001e-06 2024-04-17T15:38:43.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668984+0000", 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0369000000000003e-05 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669006+0000", 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2118999999999999e-05 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673482+0000", 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044763759999999998 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673534+0000", 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1431000000000003e-05 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.609 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1806 4.35 e72/20 4:ad702198:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.5:head v 72'1, mlcod=0'0)", 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.83806914300000002, 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043242230000000003, 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669247+0000", 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0500000000000002e-07 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669254+0000", 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8199999999999999e-06 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669265+0000", 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1038e-05 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669270+0000", 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1989999999999997e-06 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669320+0000", 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9339999999999999e-05 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669336+0000", 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6118999999999999e-05 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673523+0000", 2024-04-17T15:38:43.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041876880000000002 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673570+0000", 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7114000000000003e-05 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1902 4.27 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:43.614 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.63413104099999995, 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055036649999999996, 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1902 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873185+0000", 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873191+0000", 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1919999999999996e-06 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873207+0000", 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5939000000000001e-05 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873221+0000", 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4566000000000001e-05 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873297+0000", 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5683e-05 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873367+0000", 2024-04-17T15:38:43.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0278999999999996e-05 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873460+0000", 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3231000000000002e-05 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.874219+0000", 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075834800000000005 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878616+0000", 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043977139999999996 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878647+0000", 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878688+0000", 2024-04-17T15:38:43.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1232000000000001e-05 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5276.0:49 7.15 e72/26 7:a93a5511:::notify.2:head v 72'73, mlcod=72'71)", 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.154109+0000", 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.35320589200000002, 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037612840000000002, 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.621 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154109+0000", 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154109+0000", 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154110+0000", 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0900000000000001e-07 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154115+0000", 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7360000000000001e-06 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154125+0000", 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7480000000000005e-06 2024-04-17T15:38:43.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154129+0000", 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8779999999999997e-06 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154180+0000", 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0379e-05 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154202+0000", 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2487e-05 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.157826+0000", 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036234919999999999 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.157871+0000", 2024-04-17T15:38:43.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4954999999999999e-05 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5276.0:52 7.d e72/26 7:b4812045:::notify.4:head v 72'72, mlcod=72'70)", 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.35116073199999998, 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043756890000000003, 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.626 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6700000000000003e-07 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156160+0000", 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4510000000000002e-06 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156170+0000", 2024-04-17T15:38:43.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9420000000000007e-06 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156174+0000", 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6589999999999998e-06 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156221+0000", 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6761000000000002e-05 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156235+0000", 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3903999999999999e-05 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.160505+0000", 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004269592 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.160530+0000", 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5712999999999999e-05 2024-04-17T15:38:43.630 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2010 4.f 4:f1d5b99b:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.25764867600000002, 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004172701, 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2010 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249668+0000", 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2440000000000001e-06 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:43.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249675+0000", 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.635e-06 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249692+0000", 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7604999999999998e-05 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9330000000000007e-06 2024-04-17T15:38:43.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249770+0000", 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8769000000000005e-05 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249840+0000", 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0542000000000003e-05 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249899+0000", 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8946000000000001e-05 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250933+0000", 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001034002 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253733+0000", 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027994920000000002 2024-04-17T15:38:43.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253794+0000", 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0860999999999999e-05 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253839+0000", 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5671999999999999e-05 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.637 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:43.638 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:43.638 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:43.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:43.640 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:43.640 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:43.640 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:43.641 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:43.641 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:43.641 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:43.642 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:43.642 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:43.642 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:43.643 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:43.643 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:43.638+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:43.655 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:43.663 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:43.663 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_17_15_38_43 with max size -1 2024-04-17T15:38:43.663 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:43.663 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:43.677 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:43.698 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:43.740 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:43.738+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:43.760 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:43.760 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:43.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:43.872 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:43.873+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:43.939 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:43.939 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:43.941 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:43.941+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:43.956 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:44.052 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:44.053+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:44.119 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:44.119 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:44.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:44.180 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:44.181+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:44.244 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:44.242+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:44.297 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:44.297 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:44.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:44.346 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:44.346+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:44.431 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:44.431 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:44.446 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:44.442+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:44.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:44.547 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:44.545+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:44.564 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:44.564 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:44.581 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:44.648 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:44.646+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:44.718 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:44.718 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:44.733 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:44.748 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:44.749+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:44.850 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:44.846+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:44.895 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:44.895 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:44.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:44.920 INFO:tasks.workunit.client.0.smithi044.stderr:200+0 records in 2024-04-17T15:38:44.920 INFO:tasks.workunit.client.0.smithi044.stderr:200+0 records out 2024-04-17T15:38:44.920 INFO:tasks.workunit.client.0.smithi044.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.2553 s, 1.7 GB/s 2024-04-17T15:38:44.950 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:44.949+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:45.051 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:45.049+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:45.064 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_38_45 2024-04-17T15:38:45.098 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:45.099 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:45.113 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:45.159 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:45.158+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:45.200 INFO:tasks.workunit.client.0.smithi044.stdout:quota set for the bucket: buck_2024_03_17_15_38_45 2024-04-17T15:38:45.253 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:45.253+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:45.253 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:45.254 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:45.269 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:45.354 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:45.353+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:45.441 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:45.442 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:45.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:45.456 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:45.453+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:45.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:38:45.556 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:45.554+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:45.575 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:45.575 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:45.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:45.675 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:45.674+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:45.719 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:45.757 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:45.757 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:45.764 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:45.765+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:45.771 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:45.824 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:38:45.864 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:45.865 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:45.865+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:45.880 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:45.881 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:45.897 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:45.897 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:45.913 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:45.914 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:45.934 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:45.950 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:45.950 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:45.954 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:45.954 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:45.961 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:45.961+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:45.965 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:45.972 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:45.973 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:45.990 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:46.062 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:46.058+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:46.093 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:46.094 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:46.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:46.094 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:46.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.094 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 103.84195200400001, 2024-04-17T15:38:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:38:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:38:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:38:46.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:38:46.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:38:46.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:38:46.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:38:46.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:38:46.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:38:46.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94040977409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 103.809981698, 2024-04-17T15:38:46.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063899200000000003, 2024-04-17T15:38:46.106 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.106 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.106 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.106 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.106 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.106 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.106 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 47 2024-04-17T15:38:46.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.107 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:46.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282087+0000", 2024-04-17T15:38:46.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282089+0000", 2024-04-17T15:38:46.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6309999999999999e-06 2024-04-17T15:38:46.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282101+0000", 2024-04-17T15:38:46.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1922999999999999e-05 2024-04-17T15:38:46.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282134+0000", 2024-04-17T15:38:46.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2639999999999999e-05 2024-04-17T15:38:46.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282153+0000", 2024-04-17T15:38:46.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9471e-05 2024-04-17T15:38:46.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282316+0000", 2024-04-17T15:38:46.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162385 2024-04-17T15:38:46.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282543+0000", 2024-04-17T15:38:46.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022765400000000001 2024-04-17T15:38:46.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:46.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.282856+0000", 2024-04-17T15:38:46.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031304400000000001 2024-04-17T15:38:46.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.284545+0000", 2024-04-17T15:38:46.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001688525 2024-04-17T15:38:46.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288218+0000", 2024-04-17T15:38:46.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673352 2024-04-17T15:38:46.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288368+0000", 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014972799999999999 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.288476+0000", 2024-04-17T15:38:46.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010856700000000001 2024-04-17T15:38:46.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.117 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.117 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:400 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'7, mlcod=30'5)", 2024-04-17T15:38:46.117 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:46.118 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.655008259, 2024-04-17T15:38:46.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041553170000000004, 2024-04-17T15:38:46.118 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.118 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.118 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:46.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437060+0000", 2024-04-17T15:38:46.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437062+0000", 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7e-06 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437072+0000", 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437101+0000", 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8296000000000001e-05 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437114+0000", 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.364e-05 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437258+0000", 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143156 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437313+0000", 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5036e-05 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441107+0000", 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003794314 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441215+0000", 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108362 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.123 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:402 6.c e30/24 6:3677c228:::obj_delete_at_hint.0000000006:head v 30'2, mlcod=0'0)", 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.6549102, 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039938819999999998, 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:46.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437158+0000", 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437159+0000", 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5000000000000002e-07 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437166+0000", 2024-04-17T15:38:46.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2599999999999999e-06 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437177+0000", 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1306e-05 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437190+0000", 2024-04-17T15:38:46.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2607e-05 2024-04-17T15:38:46.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437318+0000", 2024-04-17T15:38:46.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128412 2024-04-17T15:38:46.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.437378+0000", 2024-04-17T15:38:46.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0163e-05 2024-04-17T15:38:46.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441031+0000", 2024-04-17T15:38:46.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036529750000000001 2024-04-17T15:38:46.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.441152+0000", 2024-04-17T15:38:46.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050899999999999 2024-04-17T15:38:46.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.130 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.131 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:404 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'3, mlcod=27'1)", 2024-04-17T15:38:46.131 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:46.131 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.652204372, 2024-04-17T15:38:46.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039126220000000001, 2024-04-17T15:38:46.132 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.132 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.132 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.132 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:46.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439864+0000", 2024-04-17T15:38:46.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439866+0000", 2024-04-17T15:38:46.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.933e-06 2024-04-17T15:38:46.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439881+0000", 2024-04-17T15:38:46.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4949999999999999e-05 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439912+0000", 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0825999999999999e-05 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.439932+0000", 2024-04-17T15:38:46.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0262999999999999e-05 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440087+0000", 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155425 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.440144+0000", 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6433e-05 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443669+0000", 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035255460000000001 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.443776+0000", 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107246 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:549 6.15 e30/24 6:ae95b544:::obj_delete_at_hint.0000000020:head v 30'5, mlcod=30'3)", 2024-04-17T15:38:46.138 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 100.563097399, 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038959620000000002, 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528971+0000", 2024-04-17T15:38:46.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528972+0000", 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.108e-06 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.528980+0000", 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9799999999999998e-06 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529000+0000", 2024-04-17T15:38:46.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9738e-05 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529014+0000", 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3917000000000001e-05 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529156+0000", 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142786 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.529209+0000", 2024-04-17T15:38:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2651000000000001e-05 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532777+0000", 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035676290000000001 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:05.532867+0000", 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0153000000000002e-05 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.142 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5049.0:14 5.2 5:40000000::::head [pgnls start_epoch 71] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.793778595, 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065939630000000004, 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5049", 2024-04-17T15:38:46.143 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2262844792", 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 14 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298292+0000", 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3700000000000002e-06 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298304+0000", 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1946999999999999e-05 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298324+0000", 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9959e-05 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298344+0000", 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0420000000000001e-05 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298487+0000", 2024-04-17T15:38:46.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014289500000000001 2024-04-17T15:38:46.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:46.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298497+0000", 2024-04-17T15:38:46.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.008e-05 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304538+0000", 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060409690000000002 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304605+0000", 2024-04-17T15:38:46.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6632999999999997e-05 2024-04-17T15:38:46.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304884+0000", 2024-04-17T15:38:46.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027869 2024-04-17T15:38:46.149 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.149 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.150 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.150 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1166 4.a 4:532b3d6b:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:46.150 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.425119+0000", 2024-04-17T15:38:46.150 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.6669491470000004, 2024-04-17T15:38:46.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039043910000000001, 2024-04-17T15:38:46.151 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.151 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.151 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.151 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.151 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.151 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.151 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1166 2024-04-17T15:38:46.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.153 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425119+0000", 2024-04-17T15:38:46.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425119+0000", 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425122+0000", 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8329999999999998e-06 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425136+0000", 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4557e-05 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425179+0000", 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2861999999999997e-05 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425202+0000", 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2427000000000001e-05 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425377+0000", 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175205 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.425754+0000", 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037741700000000001 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.426179+0000", 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042513199999999999 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.428157+0000", 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019777530000000001 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.428763+0000", 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060578800000000001 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.428911+0000", 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014817199999999999 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.429023+0000", 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011224499999999999 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4886.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.554471+0000", 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.5375975620000002, 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065120239999999999, 2024-04-17T15:38:46.159 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4886", 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/385706602", 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 52 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554471+0000", 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554471+0000", 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554473+0000", 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4700000000000001e-06 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554486+0000", 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2463000000000001e-05 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554522+0000", 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6507000000000001e-05 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554544+0000", 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1429000000000001e-05 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554670+0000", 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012646200000000001 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.554815+0000", 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000144683 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.555071+0000", 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025674399999999999 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.556256+0000", 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011847190000000001 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.560821+0000", 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045650760000000004 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.560906+0000", 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4611999999999996e-05 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.560983+0000", 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6859000000000004e-05 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.164 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5153.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.702298+0000", 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.3897706579999998, 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039251470000000004, 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5153", 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/971585509", 2024-04-17T15:38:46.165 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 52 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702298+0000", 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702298+0000", 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702299+0000", 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.277e-06 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702305+0000", 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.806e-06 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702321+0000", 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6708e-05 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702329+0000", 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8169999999999999e-06 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702421+0000", 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1475000000000001e-05 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702497+0000", 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6636000000000003e-05 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.702652+0000", 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000154282 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.704349+0000", 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016973610000000001 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.706129+0000", 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001780406 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.706182+0000", 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2377999999999999e-05 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.706223+0000", 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1001000000000003e-05 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.28860975, 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:38:46.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:38:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:38:46.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1795 4.3c 4:3d96143f:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:42.500208+0000", 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.5918602719999999, 2024-04-17T15:38:46.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041140300000000003, 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1795 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500208+0000", 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500208+0000", 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500210+0000", 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6330000000000001e-06 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500218+0000", 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1100000000000003e-06 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500256+0000", 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8367e-05 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500274+0000", 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8416000000000001e-05 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500356+0000", 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1732999999999998e-05 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500437+0000", 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0661000000000006e-05 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.500550+0000", 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113248 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.502025+0000", 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001474677 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.504219+0000", 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002194072 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.504280+0000", 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1246000000000003e-05 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.504322+0000", 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1866999999999997e-05 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1807 4.20 4:07124e4f:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.4242948470000001, 2024-04-17T15:38:46.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066949260000000003, 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1807 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667776+0000", 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.43e-06 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667809+0000", 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3052999999999997e-05 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667846+0000", 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7478999999999998e-05 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667868+0000", 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1933000000000002e-05 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.668039+0000", 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017102600000000001 2024-04-17T15:38:46.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.668368+0000", 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032887999999999998 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.669608+0000", 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001240306 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.671529+0000", 2024-04-17T15:38:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019204929999999999 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674159+0000", 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026297159999999998 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674339+0000", 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018073500000000001 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674468+0000", 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128875 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1900 4.20 4:07124e4f:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:42.873462+0000", 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.2186062120000001, 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053275450000000004, 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.285 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1900 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.873462+0000", 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.873462+0000", 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.873465+0000", 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7e-06 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.873480+0000", 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4883e-05 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.873519+0000", 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9443999999999997e-05 2024-04-17T15:38:46.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.873542+0000", 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3408999999999999e-05 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.873721+0000", 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017863199999999999 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.873864+0000", 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143189 2024-04-17T15:38:46.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874172+0000", 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030779400000000001 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.875832+0000", 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001659981 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.878548+0000", 2024-04-17T15:38:46.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027159490000000001 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.878688+0000", 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013986200000000001 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.878790+0000", 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101702 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:1902 4.27 e72/20 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head v 72'4, mlcod=72'2)", 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:42.874706+0000", 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.217362713, 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039476279999999999, 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874706+0000", 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874706+0000", 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874708+0000", 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.227e-06 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874724+0000", 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5852999999999999e-05 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874755+0000", 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1362999999999998e-05 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874774+0000", 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9293e-05 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874943+0000", 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016831499999999999 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.874999+0000", 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6119999999999998e-05 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.878569+0000", 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035700910000000001 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.878653+0000", 2024-04-17T15:38:46.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4365999999999998e-05 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1918 4.1f 4:fa1fad10:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.7.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:43.039799+0000", 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.0522692359999999, 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048960590000000003, 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.295 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1918 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.039799+0000", 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.039799+0000", 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.039801+0000", 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1799999999999999e-06 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.039812+0000", 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1117e-05 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.039839+0000", 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7129000000000001e-05 2024-04-17T15:38:46.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.039854+0000", 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.465e-05 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.040003+0000", 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014854500000000001 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.040392+0000", 2024-04-17T15:38:46.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038969299999999998 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.040858+0000", 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000465966 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.043104+0000", 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022454799999999998 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.044410+0000", 2024-04-17T15:38:46.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001306132 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.044571+0000", 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016090200000000001 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.044695+0000", 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000124265 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5276.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:43.155677+0000", 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.9363911969999998, 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054991939999999998, 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5276", 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1469732848", 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 52 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.301 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.155677+0000", 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.155677+0000", 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.155680+0000", 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6599999999999999e-06 2024-04-17T15:38:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.155692+0000", 2024-04-17T15:38:46.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2500000000000001e-05 2024-04-17T15:38:46.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.155732+0000", 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9687000000000001e-05 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.155754+0000", 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1746000000000002e-05 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.155888+0000", 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013431200000000001 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.156017+0000", 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012859899999999999 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.156206+0000", 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000189638 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.157537+0000", 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001331205 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.161016+0000", 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034785620000000001 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.161100+0000", 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4049999999999997e-05 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.161176+0000", 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6235000000000004e-05 2024-04-17T15:38:46.306 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5291.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93850890415872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:43.359769+0000", 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.7322995529999998, 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039258119999999999, 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5291", 2024-04-17T15:38:46.307 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/4089652313", 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 45 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.359769+0000", 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.359769+0000", 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.359770+0000", 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7400000000000001e-06 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.359783+0000", 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2116999999999999e-05 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.359807+0000", 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4586000000000001e-05 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.359819+0000", 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2247e-05 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.359986+0000", 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000167045 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.360237+0000", 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025068099999999999 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.360739+0000", 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000502086 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.362006+0000", 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012663520000000001 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.363338+0000", 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013329049999999999 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.363497+0000", 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015850099999999999 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.363694+0000", 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019755200000000001 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2039 4.20 4:04f1a871:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.8.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:43.416858+0000", 2024-04-17T15:38:46.312 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.6752107020000002, 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043588710000000003, 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2039 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.416858+0000", 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.416858+0000", 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.416860+0000", 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6570000000000001e-06 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.416874+0000", 2024-04-17T15:38:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3533000000000001e-05 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.416913+0000", 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666000000000003e-05 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.416936+0000", 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2503000000000001e-05 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.417112+0000", 2024-04-17T15:38:46.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175756 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.417448+0000", 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033592000000000002 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.417908+0000", 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046059900000000001 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.419905+0000", 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001997052 2024-04-17T15:38:46.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.421021+0000", 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011158629999999999 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.421130+0000", 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010939599999999999 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.421216+0000", 2024-04-17T15:38:46.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5926000000000004e-05 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5538.0:14 5.2 5:40000000::::head [pgnls start_epoch 73] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e73)", 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:43.542768+0000", 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.5493002589999998, 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056580830000000004, 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.318 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5538", 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/3162869723", 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 14 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.542768+0000", 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.542768+0000", 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.542771+0000", 2024-04-17T15:38:46.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7470000000000001e-06 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.542781+0000", 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0689999999999999e-05 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.542802+0000", 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1049000000000001e-05 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.542818+0000", 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6002999999999999e-05 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.542947+0000", 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128849 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.542957+0000", 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7899999999999994e-06 2024-04-17T15:38:46.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.548049+0000", 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050918480000000004 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.548138+0000", 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9399000000000002e-05 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:43.548426+0000", 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028770800000000002 2024-04-17T15:38:46.323 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.324 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.324 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.324 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.324 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.324 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:46.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:46.326 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:46.326+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:46.426 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:46.425+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:46.502 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:46.502 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:46.503 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:38:46.503 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:46.517 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:46.568 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:46.566+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:46.627 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:46.625+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:46.636 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:46.636 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:46.637 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:46.637 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:46.637 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:46.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:46.740 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:46.738+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:46.827 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:46.827 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:46.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:46.827 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:46.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.827 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.752938735, 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.833 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.470840748, 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.834 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:38:46.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:38:46.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:38:46.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.470668594, 2024-04-17T15:38:46.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:38:46.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:38:46.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.844 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.47062976399999, 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:46.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:46.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:38:46.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:38:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.261213574, 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.850 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:46.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:46.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:38:46.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:38:46.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:38:46.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:38:46.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.261152091, 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:38:46.856 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:38:46.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:38:46.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:38:46.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:38:46.861 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.260945513, 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.862 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.867 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.260905564, 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.26086664100001, 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.873 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:38:46.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.878 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.260667059, 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.879 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.26062182699999, 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:46.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:38:46.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:38:46.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:38:46.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:38:46.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.03455644899999, 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.895 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.03443274, 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.896 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:38:46.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:38:46.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:38:46.901 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.034331585, 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:38:46.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.907 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.034308369, 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.034286959, 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:38:46.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:38:46.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:38:46.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.918 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.034180995, 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.034156294, 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.924 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:46.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:38:46.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:38:46.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.034135277, 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:38:46.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.03402075299999, 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:38:46.935 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:46.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:46.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:46.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:46.941 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:46.942 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:46.942+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:46.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:47.043 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:47.041+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:47.068 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:47.068 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:47.068 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:47.068 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:47.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:47.145 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:47.146+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:47.245 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:47.245+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:47.247 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:47.247 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:47.247 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:47.247 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:47.247 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:47.261 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:47.347 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:47.346+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:47.427 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:47.427 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 119.093513722, 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:47.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:38:47.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:38:47.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:38:47.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:38:47.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 119.066136095, 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:47.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:38:47.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:38:47.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:38:47.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 119.064643225, 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:38:47.442 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 119.063083479, 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 119.05896444, 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:38:47.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.11925875599999, 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:38:47.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:38:47.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:38:47.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:47.457 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 102.14730867199999, 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:38:47.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 102.12834162999999, 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.463 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 102.098369987, 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.469 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:38:47.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:38:47.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:47.474 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 101.98038102699999, 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.475 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:38:47.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.994399135999998, 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.480 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:38:47.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:38:47.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:38:47.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1195 3.b e71/18 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.5739422540000003, 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015153946, 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851811+0000", 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6400000000000002e-07 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854045+0000", 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339170000000002 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854070+0000", 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5125000000000001e-05 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854085+0000", 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.552e-05 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854172+0000", 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6213999999999998e-05 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854199+0000", 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7472999999999999e-05 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866900+0000", 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012700421999999999 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866964+0000", 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4710999999999998e-05 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1558 4.1e 4:7ad4bdc7:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.4.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.0887616250000001, 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048677649999999996, 2024-04-17T15:38:47.491 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.492 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.492 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.492 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1558 2024-04-17T15:38:47.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.493 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:47.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:47.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336992+0000", 2024-04-17T15:38:47.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3120000000000001e-06 2024-04-17T15:38:47.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337000+0000", 2024-04-17T15:38:47.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4529999999999996e-06 2024-04-17T15:38:47.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337014+0000", 2024-04-17T15:38:47.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3804e-05 2024-04-17T15:38:47.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337024+0000", 2024-04-17T15:38:47.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0645000000000001e-05 2024-04-17T15:38:47.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337112+0000", 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.81e-05 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337259+0000", 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146217 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:47.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337407+0000", 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014810499999999999 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.338606+0000", 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011993399999999999 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341796+0000", 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003190525 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341831+0000", 2024-04-17T15:38:47.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999997e-05 2024-04-17T15:38:47.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341859+0000", 2024-04-17T15:38:47.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7433999999999999e-05 2024-04-17T15:38:47.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.501 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.501 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1592 3.3e e72/18 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head v 72'3, mlcod=71'1)", 2024-04-17T15:38:47.501 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:47.501 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.6174696690000001, 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0073548179999999999, 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808284+0000", 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4190000000000001e-06 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809131+0000", 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084668500000000002 2024-04-17T15:38:47.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809149+0000", 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7768e-05 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809158+0000", 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7369999999999995e-06 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809216+0000", 2024-04-17T15:38:47.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.808e-05 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809240+0000", 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4026e-05 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815577+0000", 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063376090000000001 2024-04-17T15:38:47.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815638+0000", 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0494000000000001e-05 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1786 4.2f 4:f4ba1581:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.9259613020000002, 2024-04-17T15:38:47.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0069053769999999999, 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1786 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499792+0000", 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1030000000000001e-06 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499801+0000", 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0040000000000005e-06 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499817+0000", 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5254e-05 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499823+0000", 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9370000000000001e-06 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499916+0000", 2024-04-17T15:38:47.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3423000000000003e-05 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499995+0000", 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9138e-05 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500091+0000", 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6224999999999994e-05 2024-04-17T15:38:47.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501645+0000", 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015532160000000001 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506580+0000", 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049358099999999997 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506645+0000", 2024-04-17T15:38:47.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4945999999999998e-05 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506697+0000", 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1320999999999999e-05 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1788 4.37 4:ee283571:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.9259096260000002, 2024-04-17T15:38:47.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068546459999999998, 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1788 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499844+0000", 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7000000000000005e-07 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499847+0000", 2024-04-17T15:38:47.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0520000000000002e-06 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499856+0000", 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3389999999999999e-06 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499862+0000", 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8850000000000004e-06 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500390+0000", 2024-04-17T15:38:47.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052792900000000001 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500457+0000", 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6812999999999999e-05 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500557+0000", 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100766 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501651+0000", 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010932540000000001 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506600+0000", 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049490549999999999 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506654+0000", 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4381e-05 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506698+0000", 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3602e-05 2024-04-17T15:38:47.517 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1802 4.3b 4:dfd801eb:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.7583272140000004, 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037103000000000001, 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1802 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667426+0000", 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9599999999999998e-07 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667432+0000", 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0299999999999999e-06 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667443+0000", 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0817e-05 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667448+0000", 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2089999999999996e-06 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667508+0000", 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9923999999999998e-05 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667637+0000", 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012862299999999999 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667797+0000", 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016047199999999999 2024-04-17T15:38:47.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668846+0000", 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010481920000000001 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671034+0000", 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002188892 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671092+0000", 2024-04-17T15:38:47.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7629e-05 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671136+0000", 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3615999999999997e-05 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1805 4.3b 4:dd40f243:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.7582861830000001, 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041858249999999998, 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.523 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1805 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:47.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667467+0000", 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8400000000000005e-07 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667470+0000", 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4759999999999998e-06 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667478+0000", 2024-04-17T15:38:47.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3880000000000002e-06 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667484+0000", 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7919999999999998e-06 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668363+0000", 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087990599999999996 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668481+0000", 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118016 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668631+0000", 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000149068 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671544+0000", 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002913601 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671559+0000", 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4842e-05 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671610+0000", 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0581000000000002e-05 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671652+0000", 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2670999999999999e-05 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2005 4.3b 4:def2cdb5:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.249645+0000", 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.1761074420000002, 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040978730000000001, 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2005 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.529 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249645+0000", 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249645+0000", 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249647+0000", 2024-04-17T15:38:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4619999999999999e-06 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249656+0000", 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3389999999999999e-06 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249671+0000", 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5398000000000001e-05 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249680+0000", 2024-04-17T15:38:47.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8720000000000008e-06 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249738+0000", 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7844999999999999e-05 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250364+0000", 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00062641599999999997 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250496+0000", 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013194199999999999 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253341+0000", 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028444189999999999 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253649+0000", 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030801500000000002 2024-04-17T15:38:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253702+0000", 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2658999999999998e-05 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253743+0000", 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1505999999999999e-05 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2012 4.2f 4:f5c53708:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.1760516919999997, 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040517310000000003, 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2012 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2799999999999996e-07 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249704+0000", 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9289999999999998e-06 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249713+0000", 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9760000000000001e-06 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249719+0000", 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0780000000000001e-06 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249772+0000", 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2988999999999997e-05 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249872+0000", 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9638999999999999e-05 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249981+0000", 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108669 2024-04-17T15:38:47.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250869+0000", 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088786099999999999 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253676+0000", 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028077520000000002 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253719+0000", 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2837999999999999e-05 2024-04-17T15:38:47.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253753+0000", 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3472000000000001e-05 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.540 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:47.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:47.542 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:47.542+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:47.643 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:47.642+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:47.673 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:47.673 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:47.673 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:47.673 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:47.686 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:47.744 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:47.741+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:47.802 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:47.802 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:47.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:47.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:38:47.860 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:47.861+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:47.945 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:47.946+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:47.975 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:47.976 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:47.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:47.976 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:47.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.976 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:47.977 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:47.977 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.69255607300001, 2024-04-17T15:38:47.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:38:47.977 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.977 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.977 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.978 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:47.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:47.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:38:47.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:38:47.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:38:47.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:38:47.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:38:47.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:38:47.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:38:47.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:38:47.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:38:47.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:38:47.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:38:47.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:38:47.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:38:47.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:38:47.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:38:47.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:38:47.985 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.985 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.985 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.986 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:47.986 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:47.986 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.685938427, 2024-04-17T15:38:47.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:38:47.986 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.987 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.987 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.987 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:47.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:47.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:38:47.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:38:47.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:38:47.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:38:47.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:38:47.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:38:47.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:38:47.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:38:47.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:47.995 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 105.685600788, 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:47.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:38:47.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:47.999 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 102.686185708, 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.000 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:38:48.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:38:48.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 102.429670402, 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:48.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.010 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:588 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 102.41048337700001, 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038753020000000002, 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:48.011 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 588 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564301+0000", 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564303+0000", 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.95e-06 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564313+0000", 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0067e-05 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564339+0000", 2024-04-17T15:38:48.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564353+0000", 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4027e-05 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564488+0000", 2024-04-17T15:38:48.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000135186 2024-04-17T15:38:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.564676+0000", 2024-04-17T15:38:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018809499999999999 2024-04-17T15:38:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.565062+0000", 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038646900000000002 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.566141+0000", 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001079064 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568055+0000", 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001913917 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568126+0000", 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0234000000000006e-05 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.568177+0000", 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0997e-05 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4886.0:47 7.0 e71/26 7:05bf5b68:::notify.1:head v 71'7, mlcod=71'5)", 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.550728+0000", 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.4240561730000003, 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037588779999999998, 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550728+0000", 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550728+0000", 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550729+0000", 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0200000000000001e-07 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550735+0000", 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7230000000000001e-06 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550748+0000", 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.292e-05 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550755+0000", 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8789999999999997e-06 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550808+0000", 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3109000000000003e-05 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.550829+0000", 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1191000000000001e-05 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.554443+0000", 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036143709999999999 2024-04-17T15:38:48.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.554487+0000", 2024-04-17T15:38:48.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3983000000000002e-05 2024-04-17T15:38:48.022 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.022 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.022 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4886.0:49 7.15 e71/26 7:a93a5511:::notify.2:head v 71'7, mlcod=71'5)", 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.4214735199999993, 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004153403, 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553312+0000", 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2099999999999996e-07 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553317+0000", 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5779999999999998e-06 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553328+0000", 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1114999999999999e-05 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553334+0000", 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1070000000000004e-06 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553390+0000", 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6314999999999999e-05 2024-04-17T15:38:48.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553405+0000", 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5305999999999999e-05 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.557426+0000", 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040211689999999998 2024-04-17T15:38:48.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.557464+0000", 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8092000000000001e-05 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4886.0:52 7.d e71/26 7:b4812045:::notify.4:head v 71'6, mlcod=71'4)", 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.4197781880000004, 2024-04-17T15:38:48.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052142220000000001, 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:48.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555007+0000", 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2200000000000003e-07 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555013+0000", 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2339999999999999e-06 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555024+0000", 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0964e-05 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555030+0000", 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.113e-06 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555086+0000", 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6699e-05 2024-04-17T15:38:48.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555101+0000", 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4402e-05 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.560184+0000", 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0050833450000000004 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.560221+0000", 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6643000000000001e-05 2024-04-17T15:38:48.031 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1192 3.1a e71/18 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head v 71'1, mlcod=0'0)", 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.1424452059999997, 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012590545, 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832340+0000", 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.91e-07 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837330+0000", 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049904620000000002 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837357+0000", 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6974999999999998e-05 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837370+0000", 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:38:48.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837437+0000", 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6382000000000002e-05 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837455+0000", 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8284e-05 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844890+0000", 2024-04-17T15:38:48.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074353930000000002 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844930+0000", 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9458000000000001e-05 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5153.0:48 7.15 e72/26 7:a93a5511:::notify.2:head v 72'51, mlcod=72'49)", 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:48.036 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.2788692670000001, 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041848639999999999, 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695916+0000", 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2900000000000002e-07 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695924+0000", 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1419999999999993e-06 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695935+0000", 2024-04-17T15:38:48.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1103e-05 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695944+0000", 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695986+0000", 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2580000000000002e-05 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695998+0000", 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1800000000000001e-05 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.700073+0000", 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040746050000000002 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.700100+0000", 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7344000000000001e-05 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1592 3.3e 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:48.040 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.1678947830000004, 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0089542040000000003, 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1592 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806892+0000", 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3989999999999998e-06 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807868+0000", 2024-04-17T15:38:48.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00097551400000000003 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807890+0000", 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2503000000000001e-05 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807900+0000", 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7550000000000006e-06 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807964+0000", 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3801999999999997e-05 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808072+0000", 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107871 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808170+0000", 2024-04-17T15:38:48.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8197999999999997e-05 2024-04-17T15:38:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815570+0000", 2024-04-17T15:38:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074005779999999997 2024-04-17T15:38:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815774+0000", 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020377899999999999 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815812+0000", 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8098e-05 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815844+0000", 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1707e-05 2024-04-17T15:38:48.046 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1791 4.f 4:f28dd39d:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.4749294849999997, 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038841430000000001, 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:48.047 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1791 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499857+0000", 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4249999999999999e-06 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499862+0000", 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5759999999999996e-06 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499879+0000", 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7019000000000001e-05 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499888+0000", 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1470000000000007e-06 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499951+0000", 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3083000000000006e-05 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500041+0000", 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0039999999999999e-05 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500139+0000", 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8010000000000005e-05 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501520+0000", 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001380362 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503644+0000", 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002124403 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503695+0000", 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1031e-05 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503739+0000", 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4047e-05 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1809 4.27 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.667493+0000", 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.3072919970000001, 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037478020000000002, 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.053 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1809 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667493+0000", 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667493+0000", 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667495+0000", 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.328e-06 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667504+0000", 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2259999999999994e-06 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667527+0000", 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2693000000000001e-05 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667537+0000", 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8539999999999992e-06 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667603+0000", 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6167999999999994e-05 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667687+0000", 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4430000000000003e-05 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667791+0000", 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010377100000000001 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.670658+0000", 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002867278 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671147+0000", 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00048887300000000002 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671200+0000", 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2698999999999998e-05 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671240+0000", 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0482000000000003e-05 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.058 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1804 4.39 e72/20 4:9d2afefb:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.3:head v 72'3, mlcod=71'1)", 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.3059127669999997, 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046620460000000004, 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668873+0000", 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4900000000000005e-07 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668883+0000", 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9450000000000005e-06 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668896+0000", 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3396e-05 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668904+0000", 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5610000000000001e-06 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668984+0000", 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0369000000000003e-05 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669006+0000", 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2118999999999999e-05 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673482+0000", 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044763759999999998 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673534+0000", 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1431000000000003e-05 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1806 4.35 e72/20 4:ad702198:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.5:head v 72'1, mlcod=0'0)", 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.305538372, 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043242230000000003, 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.063 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669247+0000", 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0500000000000002e-07 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669254+0000", 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8199999999999999e-06 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669265+0000", 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1038e-05 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669270+0000", 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1989999999999997e-06 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669320+0000", 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9339999999999999e-05 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669336+0000", 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6118999999999999e-05 2024-04-17T15:38:48.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673523+0000", 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041876880000000002 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673570+0000", 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7114000000000003e-05 2024-04-17T15:38:48.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1902 4.27 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.1016002699999996, 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055036649999999996, 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:48.068 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1902 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873185+0000", 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873191+0000", 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1919999999999996e-06 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873207+0000", 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5939000000000001e-05 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873221+0000", 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4566000000000001e-05 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873297+0000", 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5683e-05 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873367+0000", 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0278999999999996e-05 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873460+0000", 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3231000000000002e-05 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.874219+0000", 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075834800000000005 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878616+0000", 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043977139999999996 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878647+0000", 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878688+0000", 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1232000000000001e-05 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.073 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5276.0:49 7.15 e72/26 7:a93a5511:::notify.2:head v 72'73, mlcod=72'71)", 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.154109+0000", 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.8206751209999998, 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037612840000000002, 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154109+0000", 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154109+0000", 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154110+0000", 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0900000000000001e-07 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154115+0000", 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7360000000000001e-06 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154125+0000", 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7480000000000005e-06 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154129+0000", 2024-04-17T15:38:48.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8779999999999997e-06 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154180+0000", 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0379e-05 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.154202+0000", 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2487e-05 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.157826+0000", 2024-04-17T15:38:48.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036234919999999999 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.157871+0000", 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4954999999999999e-05 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5276.0:52 7.d e72/26 7:b4812045:::notify.4:head v 72'72, mlcod=72'70)", 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.8186299610000001, 2024-04-17T15:38:48.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043756890000000003, 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6700000000000003e-07 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156160+0000", 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4510000000000002e-06 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156170+0000", 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9420000000000007e-06 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156174+0000", 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6589999999999998e-06 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156221+0000", 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6761000000000002e-05 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156235+0000", 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3903999999999999e-05 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.160505+0000", 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004269592 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.160530+0000", 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5712999999999999e-05 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2010 4.f 4:f1d5b99b:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.7251179050000003, 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004172701, 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:48.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2010 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:48.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249668+0000", 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2440000000000001e-06 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249675+0000", 2024-04-17T15:38:48.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.635e-06 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249692+0000", 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7604999999999998e-05 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9330000000000007e-06 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:48.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249770+0000", 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8769000000000005e-05 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249840+0000", 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0542000000000003e-05 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249899+0000", 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8946000000000001e-05 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:48.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250933+0000", 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001034002 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253733+0000", 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027994920000000002 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253794+0000", 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0860999999999999e-05 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:48.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253839+0000", 2024-04-17T15:38:48.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5671999999999999e-05 2024-04-17T15:38:48.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.089 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:48.089 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:48.089 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:48.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:48.091 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:48.091 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:48.089+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:48.194 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:48.190+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:38:48.267 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:48.267 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:48.267 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:48.267 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:48.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:48.291 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:48.292 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:48.293 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:48.293+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:48.322 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:48.353 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:48.353 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:48.370 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:48.370 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:48.390 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:48.390 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:48.394 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:48.390+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:48.401 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:48.402 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:48.410 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:48.410 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:48.415 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:48.430 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:48.431 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:48.450 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:48.451 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:48.495 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:48.494+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:48.540 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:48.541 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:48.555 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:48.596 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:48.598+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:48.667 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:48.667 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:48.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:48.696 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:48.698+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:48.798 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:48.797+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:48.807 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:48.807 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:48.816 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:48.904 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:48.905+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:48.979 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:48.980 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:48.993 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:49.036 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:49.037+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:49.100 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:49.101+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:49.128 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:49.128 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:49.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:49.202 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:49.202+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:49.270 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:49.270 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:49.284 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:49.291 INFO:tasks.workunit.client.0.smithi044.stdout:quota enabled for the bucket: buck_2024_03_17_15_38_45 2024-04-17T15:38:49.291 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 2Gb. 2024-04-17T15:38:49.292 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:49.292 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-04-17T15:38:49.292 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:49.292 INFO:tasks.workunit.client.0.smithi044.stdout:delete objects successful 2024-04-17T15:38:49.328 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:49.330+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:49.404 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:49.402+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:49.454 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:49.455 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:49.469 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:49.511 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:49.514+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:49.605 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:49.602+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:49.638 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:49.639 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:49.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:49.739 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:49.742+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:49.808 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:49.805+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:49.816 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:49.816 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:49.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:49.908 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:49.909+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:49.927 INFO:tasks.workunit.client.0.smithi044.stderr:100+0 records in 2024-04-17T15:38:49.927 INFO:tasks.workunit.client.0.smithi044.stderr:100+0 records out 2024-04-17T15:38:49.927 INFO:tasks.workunit.client.0.smithi044.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.632765 s, 1.7 GB/s 2024-04-17T15:38:49.998 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:49.999 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:50.009 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:50.009+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:50.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:50.110 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:50.110+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:50.140 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:50.140 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:50.155 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:50.247 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:50.246+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:50.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:38:50.311 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:50.309+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:50.327 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:50.327 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:50.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:50.427 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:50.426+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:50.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:50.509 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:50.509 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:50.513 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:50.510+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:50.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:50.604 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:50.604 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:50.613 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:50.613+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:50.620 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:50.637 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:50.637 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:50.654 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:50.655 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:50.674 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:50.694 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:50.695 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:50.695 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:50.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:50.714 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:50.713+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:50.714 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:50.733 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:50.815 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:50.814+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:50.835 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:50.835 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:50.835 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:50.835 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:50.835 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:50.849 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:50.916 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:50.917+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:51.017 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:51.017+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:51.021 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:51.021 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:51.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:51.021 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:51.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.021 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.021 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:51.021 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.949397847, 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:51.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:38:51.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:38:51.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:51.027 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.66729986, 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015266952, 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.028 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 35 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354750+0000", 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6599999999999995e-07 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354871+0000", 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120689 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354893+0000", 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1776999999999998e-05 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354902+0000", 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5130000000000002e-06 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.362869+0000", 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079668859999999994 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363118+0000", 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000248368 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.363523+0000", 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040531200000000001 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368588+0000", 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050646550000000004 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369861+0000", 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012735680000000001 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.369948+0000", 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6521999999999996e-05 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370017+0000", 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8895999999999999e-05 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:51.033 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.667127706, 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01554582, 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 36 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354922+0000", 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354923+0000", 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2999999999999999e-07 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354929+0000", 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2899999999999999e-06 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354940+0000", 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0686999999999999e-05 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354947+0000", 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7100000000000007e-06 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365400+0000", 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010452782000000001 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.365722+0000", 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032234400000000002 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.366119+0000", 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039678899999999999 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368611+0000", 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024921959999999999 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370166+0000", 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015543589999999999 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370325+0000", 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158942 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.370468+0000", 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142791 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.66708887599999, 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017393959000000001, 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.039 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 37 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354961+0000", 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3399999999999999e-07 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354968+0000", 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0060000000000003e-06 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.354979+0000", 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-04-17T15:38:51.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.355005+0000", 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.601e-05 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367314+0000", 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012309191000000001 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367464+0000", 2024-04-17T15:38:51.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015014800000000001 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.367737+0000", 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027268099999999999 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.368715+0000", 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097862399999999999 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372216+0000", 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003501213 2024-04-17T15:38:51.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372296+0000", 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9863000000000004e-05 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.372355+0000", 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8199000000000003e-05 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.457672686, 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018072112000000001, 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 111 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564377+0000", 2024-04-17T15:38:51.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564384+0000", 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4840000000000001e-06 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564400+0000", 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5783000000000001e-05 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564411+0000", 2024-04-17T15:38:51.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577815+0000", 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013403953999999999 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.577945+0000", 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012976900000000001 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578141+0000", 2024-04-17T15:38:51.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019583799999999999 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582042+0000", 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039010920000000001 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582090+0000", 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8102999999999997e-05 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582232+0000", 2024-04-17T15:38:51.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142366 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582449+0000", 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021641400000000001 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.457611203, 2024-04-17T15:38:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018594973000000001, 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 112 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564438+0000", 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564439+0000", 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1230000000000001e-06 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564598+0000", 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015886200000000001 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564613+0000", 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.451e-05 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564622+0000", 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.578867+0000", 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014245399000000001 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579113+0000", 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024537099999999998 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.579488+0000", 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037482599999999998 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582569+0000", 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003081037 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582756+0000", 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582902+0000", 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146608 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583033+0000", 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013106899999999999 2024-04-17T15:38:51.055 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.457404625, 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.056 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.061 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.457364676, 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:51.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:38:51.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:38:51.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.45732575300001, 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.067 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.072 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.457126171, 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:38:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:38:51.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:51.078 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.45708093899999, 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:38:51.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:38:51.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:38:51.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:38:51.083 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.23101556100001, 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014941183, 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 133 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791034+0000", 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791035+0000", 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1600000000000001e-07 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791039+0000", 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5650000000000003e-06 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791047+0000", 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4069999999999993e-06 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791053+0000", 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3979999999999998e-06 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796567+0000", 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055141779999999998 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796627+0000", 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9951999999999998e-05 2024-04-17T15:38:51.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.796730+0000", 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010251600000000001 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800000+0000", 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032706319999999999 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805713+0000", 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005713091 2024-04-17T15:38:51.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805859+0000", 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145642 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805975+0000", 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116186 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.089 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.230891852, 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015132428, 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 134 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791158+0000", 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0299999999999999e-07 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791228+0000", 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9831000000000003e-05 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791239+0000", 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.095e-05 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791246+0000", 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9979999999999997e-06 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797206+0000", 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059595469999999999 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797447+0000", 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024120000000000001 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.797826+0000", 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037947000000000002 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800033+0000", 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022064300000000001 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805997+0000", 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059639519999999998 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806136+0000", 2024-04-17T15:38:51.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139834 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806290+0000", 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015361300000000001 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.230790697, 2024-04-17T15:38:51.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015319309999999999, 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 135 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791259+0000", 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7700000000000005e-07 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791264+0000", 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4190000000000004e-06 2024-04-17T15:38:51.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791270+0000", 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791274+0000", 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4789999999999998e-06 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799362+0000", 2024-04-17T15:38:51.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080881630000000006 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799447+0000", 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4915999999999998e-05 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.799553+0000", 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000105435 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805175+0000", 2024-04-17T15:38:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056221220000000002 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806308+0000", 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001132868 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806456+0000", 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014846400000000001 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806578+0000", 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121863 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.230767481, 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017895558999999998, 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 136 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791282+0000", 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2000000000000001e-07 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791286+0000", 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791292+0000", 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7860000000000002e-06 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791296+0000", 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2950000000000004e-06 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800059+0000", 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087625749999999999 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800119+0000", 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0637999999999998e-05 2024-04-17T15:38:51.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800218+0000", 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8735999999999998e-05 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.805345+0000", 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051275230000000002 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.808878+0000", 2024-04-17T15:38:51.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035324890000000002 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809018+0000", 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013959899999999999 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809178+0000", 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159982 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.230746071, 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019916955, 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 137 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791303+0000", 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791304+0000", 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5999999999999999e-07 2024-04-17T15:38:51.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791379+0000", 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5140000000000002e-05 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791388+0000", 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6279999999999994e-06 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791397+0000", 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1770000000000004e-06 2024-04-17T15:38:51.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800724+0000", 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093275389999999993 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.800974+0000", 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024941999999999998 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.801361+0000", 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038767000000000001 2024-04-17T15:38:51.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806670+0000", 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053085210000000001 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810921+0000", 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042514500000000004 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811081+0000", 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015922199999999999 2024-04-17T15:38:51.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811220+0000", 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013982799999999999 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.230640107, 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020129418, 2024-04-17T15:38:51.112 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 138 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791409+0000", 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791410+0000", 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.63e-07 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791414+0000", 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8089999999999999e-06 2024-04-17T15:38:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791420+0000", 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1e-06 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791427+0000", 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9149999999999999e-06 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806704+0000", 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015277107999999999 2024-04-17T15:38:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806789+0000", 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4802000000000006e-05 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.806894+0000", 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104985 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810035+0000", 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031414619999999998 2024-04-17T15:38:51.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811248+0000", 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212877 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811379+0000", 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131163 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811539+0000", 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159734 2024-04-17T15:38:51.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.230615406, 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020399807999999998, 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.118 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 139 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791434+0000", 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.46e-07 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791438+0000", 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9500000000000003e-06 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791444+0000", 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5979999999999996e-06 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791448+0000", 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1219999999999997e-06 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807360+0000", 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015912224999999999 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807606+0000", 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024612100000000002 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.807993+0000", 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038660000000000002 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810179+0000", 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021856179999999998 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811565+0000", 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001386237 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811701+0000", 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013629199999999999 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811834+0000", 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013269900000000001 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.230594389, 2024-04-17T15:38:51.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020707494, 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 140 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:51.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791455+0000", 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-07 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791539+0000", 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3696000000000006e-05 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791548+0000", 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7229999999999993e-06 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791553+0000", 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000001e-06 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809256+0000", 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017702486999999999 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809325+0000", 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9573999999999995e-05 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.809434+0000", 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108903 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810886+0000", 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001451985 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.811879+0000", 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099321999999999995 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812016+0000", 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136379 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812163+0000", 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014670800000000001 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 122.23047986500001, 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:51.129 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:51.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:51.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:51.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:51.135 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:51.135 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:51.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:51.137 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:51.137+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:51.237 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:51.237+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:51.254 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:51.254 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:51.254 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:51.254 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:51.268 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:51.328 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:38:51.338 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:51.337+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:51.428 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:51.429 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:51.429 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:51.429 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:51.429 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:51.440 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:51.437+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:51.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:51.541 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:51.542+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 123.278483325, 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046280009999999996, 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.612 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332239+0000", 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332240+0000", 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.553e-06 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332253+0000", 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2106999999999999e-05 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332285+0000", 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1996000000000003e-05 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332300+0000", 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5665999999999999e-05 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332376+0000", 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5576999999999998e-05 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.332410+0000", 2024-04-17T15:38:51.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3835999999999999e-05 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336801+0000", 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043911059999999997 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.336867+0000", 2024-04-17T15:38:51.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6160000000000004e-05 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'15)", 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 123.251105698, 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041991909999999997, 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359617+0000", 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359618+0000", 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.567e-06 2024-04-17T15:38:51.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359628+0000", 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0297e-05 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359655+0000", 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6132e-05 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359667+0000", 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2094e-05 2024-04-17T15:38:51.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359747+0000", 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0366999999999998e-05 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.359770+0000", 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3396000000000001e-05 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363719+0000", 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039482730000000004 2024-04-17T15:38:51.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363816+0000", 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7065000000000007e-05 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 123.249612828, 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047206269999999998, 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361109+0000", 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361111+0000", 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.294e-06 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361119+0000", 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2260000000000005e-06 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361143+0000", 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4519999999999999e-05 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361156+0000", 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2166e-05 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361233+0000", 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7318999999999996e-05 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.361257+0000", 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3764000000000002e-05 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365742+0000", 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044851559999999997 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.365830+0000", 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8182000000000004e-05 2024-04-17T15:38:51.625 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.626 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.626 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-04-17T15:38:51.626 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:51.626 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 123.248053082, 2024-04-17T15:38:51.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057933070000000001, 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362669+0000", 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362670+0000", 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3430000000000001e-06 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362812+0000", 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014176299999999999 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362842+0000", 2024-04-17T15:38:51.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0236e-05 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.362862+0000", 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9593999999999999e-05 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363027+0000", 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016456199999999999 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.363062+0000", 2024-04-17T15:38:51.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5442999999999999e-05 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368352+0000", 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052900330000000004 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.368462+0000", 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110333 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4176.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'18)", 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 123.243934043, 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040162519999999997, 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366788+0000", 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366790+0000", 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.443e-06 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366819+0000", 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459e-05 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366842+0000", 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3366999999999998e-05 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366865+0000", 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2796e-05 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366945+0000", 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9368000000000003e-05 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.366969+0000", 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3981999999999998e-05 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370725+0000", 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037561600000000001 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:36:48.370804+0000", 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9677000000000003e-05 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.634 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 109.30422835900001, 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00442663, 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 60 2024-04-17T15:38:51.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306494+0000", 2024-04-17T15:38:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306497+0000", 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0750000000000002e-06 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306509+0000", 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2291e-05 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306543+0000", 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4125999999999998e-05 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306561+0000", 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7714e-05 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306667+0000", 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010627400000000001 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.306846+0000", 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179016 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.307024+0000", 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017715400000000001 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.308176+0000", 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011520289999999999 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310659+0000", 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002483533 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310800+0000", 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014125300000000001 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.310920+0000", 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120165 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.640 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 106.33227827499999, 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036961479999999998, 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.641 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 206 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278444+0000", 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278447+0000", 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4139999999999998e-06 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278463+0000", 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.594e-05 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278501+0000", 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7626000000000002e-05 2024-04-17T15:38:51.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278526+0000", 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4978999999999999e-05 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278678+0000", 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015203600000000001 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.278923+0000", 2024-04-17T15:38:51.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000245548 2024-04-17T15:38:51.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:51.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.279397+0000", 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00047316399999999998 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.280886+0000", 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014897630000000001 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.281976+0000", 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001089399 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282064+0000", 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8395999999999999e-05 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.282140+0000", 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5883000000000005e-05 2024-04-17T15:38:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 106.31331123299999, 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003749844, 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 210 2024-04-17T15:38:51.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297411+0000", 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297415+0000", 2024-04-17T15:38:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1699999999999999e-06 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297428+0000", 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2356e-05 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297460+0000", 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2159999999999997e-05 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297476+0000", 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5954e-05 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297636+0000", 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016023200000000001 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.297990+0000", 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035458700000000001 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.298742+0000", 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075194499999999996 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.300457+0000", 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017147880000000001 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301017+0000", 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00055990900000000004 2024-04-17T15:38:51.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301094+0000", 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6537000000000003e-05 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.301161+0000", 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7206000000000007e-05 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:51.653 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 106.28333959, 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037418400000000002, 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 218 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327383+0000", 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327385+0000", 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7460000000000001e-06 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327398+0000", 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2330000000000001e-05 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327429+0000", 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1550000000000001e-05 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327447+0000", 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8105999999999999e-05 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327595+0000", 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014725200000000001 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.327984+0000", 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000389835 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.328715+0000", 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00073040500000000005 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330400+0000", 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016846809999999999 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.330832+0000", 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043288700000000002 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331004+0000", 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017146300000000001 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.331124+0000", 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000120585 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:418 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 106.16535063000001, 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003804066, 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.659 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 418 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445372+0000", 2024-04-17T15:38:51.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445373+0000", 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5039999999999999e-06 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445379+0000", 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.032e-06 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445392+0000", 2024-04-17T15:38:51.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3227999999999999e-05 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445402+0000", 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5759999999999995e-06 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445465+0000", 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3214999999999997e-05 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445598+0000", 2024-04-17T15:38:51.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132817 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.445821+0000", 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022262700000000001 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.447147+0000", 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001326025 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449081+0000", 2024-04-17T15:38:51.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001933913 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449126+0000", 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5661999999999998e-05 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.449176+0000", 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9466999999999999e-05 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 76.179368738999997, 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035997350000000002, 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1020 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431353+0000", 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431357+0000", 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431377+0000", 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9548e-05 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431420+0000", 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3720000000000002e-05 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431444+0000", 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.323e-05 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431587+0000", 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014356699999999999 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431739+0000", 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015218600000000001 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.431926+0000", 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018640900000000001 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.432970+0000", 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001043766 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434608+0000", 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001638708 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434725+0000", 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116989 2024-04-17T15:38:51.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:35.434953+0000", 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022786900000000001 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1195 3.b e71/18 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.758911856999999, 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015153946, 2024-04-17T15:38:51.670 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851811+0000", 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6400000000000002e-07 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854045+0000", 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339170000000002 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854070+0000", 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5125000000000001e-05 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854085+0000", 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.552e-05 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854172+0000", 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6213999999999998e-05 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854199+0000", 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7472999999999999e-05 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866900+0000", 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012700421999999999 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866964+0000", 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4710999999999998e-05 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1558 4.1e 4:7ad4bdc7:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.4.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:51.674 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.273731228000001, 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048677649999999996, 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1558 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:51.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336991+0000", 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.336992+0000", 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3120000000000001e-06 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337000+0000", 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4529999999999996e-06 2024-04-17T15:38:51.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337014+0000", 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3804e-05 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337024+0000", 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0645000000000001e-05 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337112+0000", 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.81e-05 2024-04-17T15:38:51.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337259+0000", 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146217 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337407+0000", 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014810499999999999 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.338606+0000", 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0011993399999999999 2024-04-17T15:38:51.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341796+0000", 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003190525 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341831+0000", 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999997e-05 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341859+0000", 2024-04-17T15:38:51.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7433999999999999e-05 2024-04-17T15:38:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1592 3.3e e72/18 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head v 72'3, mlcod=71'1)", 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.8024392720000009, 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0073548179999999999, 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:51.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808283+0000", 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808284+0000", 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4190000000000001e-06 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809131+0000", 2024-04-17T15:38:51.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00084668500000000002 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809149+0000", 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7768e-05 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809158+0000", 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7369999999999995e-06 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809216+0000", 2024-04-17T15:38:51.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.808e-05 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.809240+0000", 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4026e-05 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815577+0000", 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063376090000000001 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815638+0000", 2024-04-17T15:38:51.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0494000000000001e-05 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1786 4.2f 4:f4ba1581:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.110930905, 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0069053769999999999, 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.686 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1786 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499791+0000", 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499792+0000", 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1030000000000001e-06 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499801+0000", 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0040000000000005e-06 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499817+0000", 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5254e-05 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499823+0000", 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9370000000000001e-06 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499916+0000", 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3423000000000003e-05 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499995+0000", 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9138e-05 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500091+0000", 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6224999999999994e-05 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501645+0000", 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015532160000000001 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506580+0000", 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049358099999999997 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506645+0000", 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4945999999999998e-05 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506697+0000", 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1320999999999999e-05 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1788 4.37 4:ee283571:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:51.691 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.110879229, 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068546459999999998, 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1788 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499843+0000", 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499844+0000", 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7000000000000005e-07 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499847+0000", 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0520000000000002e-06 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499856+0000", 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3389999999999999e-06 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499862+0000", 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8850000000000004e-06 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500390+0000", 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00052792900000000001 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500457+0000", 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6812999999999999e-05 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500557+0000", 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100766 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501651+0000", 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010932540000000001 2024-04-17T15:38:51.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506600+0000", 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049490549999999999 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506654+0000", 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4381e-05 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.506698+0000", 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3602e-05 2024-04-17T15:38:51.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1802 4.3b 4:dfd801eb:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.9432968170000002, 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0037103000000000001, 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.697 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1802 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667425+0000", 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667426+0000", 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9599999999999998e-07 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667432+0000", 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0299999999999999e-06 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667443+0000", 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0817e-05 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667448+0000", 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2089999999999996e-06 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667508+0000", 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9923999999999998e-05 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667637+0000", 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012862299999999999 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:51.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667797+0000", 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016047199999999999 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668846+0000", 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010481920000000001 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671034+0000", 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002188892 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671092+0000", 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7629e-05 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671136+0000", 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3615999999999997e-05 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1805 4.3b 4:dd40f243:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.9432557859999999, 2024-04-17T15:38:51.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041858249999999998, 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1805 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667466+0000", 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667467+0000", 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8400000000000005e-07 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667470+0000", 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4759999999999998e-06 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667478+0000", 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3880000000000002e-06 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.667484+0000", 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7919999999999998e-06 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668363+0000", 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00087990599999999996 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668481+0000", 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118016 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668631+0000", 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000149068 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671544+0000", 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002913601 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671559+0000", 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4842e-05 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671610+0000", 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0581000000000002e-05 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.671652+0000", 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2670999999999999e-05 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.707 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2005 4.3b 4:def2cdb5:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.249645+0000", 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.361077045, 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040978730000000001, 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2005 2024-04-17T15:38:51.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249645+0000", 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249645+0000", 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249647+0000", 2024-04-17T15:38:51.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4619999999999999e-06 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249656+0000", 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3389999999999999e-06 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249671+0000", 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5398000000000001e-05 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249680+0000", 2024-04-17T15:38:51.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8720000000000008e-06 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249738+0000", 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7844999999999999e-05 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250364+0000", 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00062641599999999997 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250496+0000", 2024-04-17T15:38:51.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013194199999999999 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253341+0000", 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028444189999999999 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253649+0000", 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030801500000000002 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253702+0000", 2024-04-17T15:38:51.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2658999999999998e-05 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253743+0000", 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1505999999999999e-05 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2012 4.2f 4:f5c53708:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.3610212950000005, 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040517310000000003, 2024-04-17T15:38:51.713 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2012 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2799999999999996e-07 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249704+0000", 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9289999999999998e-06 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249713+0000", 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9760000000000001e-06 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249719+0000", 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0780000000000001e-06 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249772+0000", 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2988999999999997e-05 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249872+0000", 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9638999999999999e-05 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249981+0000", 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108669 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250869+0000", 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00088786099999999999 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:51.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253676+0000", 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028077520000000002 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253719+0000", 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2837999999999999e-05 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253753+0000", 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3472000000000001e-05 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:51.719 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:51.719 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:51.720 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:51.721 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:51.721+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:51.821 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:51.821+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:51.886 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:51.887 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:51.887 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:51.887 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:51.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:51.944 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:51.945+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:52.023 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:52.022+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:52.099 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:52.100 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:52.100 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:52.100 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:52.100 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:52.116 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:52.160 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:52.161+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:52.224 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:52.225+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:52.268 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:52.268 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:52.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:52.268 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:52.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.268 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:48 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:52.268 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:52.268 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 109.98685490699999, 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048265230000000001, 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282229+0000", 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282231+0000", 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.243e-06 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282249+0000", 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7940000000000001e-05 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282292+0000", 2024-04-17T15:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3619999999999999e-05 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282313+0000", 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1154000000000001e-05 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282575+0000", 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026139199999999999 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.282622+0000", 2024-04-17T15:38:52.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7562999999999998e-05 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.286927+0000", 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043050220000000004 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.287055+0000", 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127589 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:49 7.0 e27/26 7:05bf5b68:::notify.1:head v 27'2, mlcod=0'0)", 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 109.980237261, 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049805889999999997, 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288846+0000", 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288848+0000", 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8369999999999999e-06 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288865+0000", 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6714e-05 2024-04-17T15:38:52.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288906+0000", 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1208999999999998e-05 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.288929+0000", 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2714e-05 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289054+0000", 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124905 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289105+0000", 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1879000000000003e-05 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293710+0000", 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046046969999999996 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293827+0000", 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011663399999999999 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:50 7.15 e27/26 7:a93a5511:::notify.2:head v 27'1, mlcod=0'0)", 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 109.979899622, 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047243179999999999, 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.277 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289184+0000", 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2e-07 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289192+0000", 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8860000000000004e-06 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289219+0000", 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7254e-05 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289240+0000", 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-05 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289375+0000", 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013440899999999999 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.289414+0000", 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8727999999999999e-05 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293806+0000", 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043924100000000002 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:02.293908+0000", 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102191 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:52.281 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 106.980484542, 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041405920000000002, 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 208 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:52.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288599+0000", 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288603+0000", 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6569999999999999e-06 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288617+0000", 2024-04-17T15:38:52.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4212999999999999e-05 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288648+0000", 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.082e-05 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288662+0000", 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4786999999999999e-05 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.288916+0000", 2024-04-17T15:38:52.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025359500000000001 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289315+0000", 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00039953299999999998 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.289888+0000", 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00057222299999999996 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.291454+0000", 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001566376 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292480+0000", 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001026316 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292633+0000", 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152659 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.292739+0000", 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106413 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:568 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 106.723969236, 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047316889999999999, 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.287 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 568 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545114+0000", 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545116+0000", 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.832e-06 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545128+0000", 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1931e-05 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545147+0000", 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9391000000000001e-05 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545160+0000", 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.26e-05 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545264+0000", 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010391900000000001 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545399+0000", 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013489700000000001 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.545735+0000", 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033612300000000002 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.546792+0000", 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001056993 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549708+0000", 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029163269999999998 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549784+0000", 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6027999999999998e-05 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:37:05.549846+0000", 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1648000000000003e-05 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4886.0:49 7.15 e71/26 7:a93a5511:::notify.2:head v 71'7, mlcod=71'5)", 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.715772354, 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004153403, 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.295 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553311+0000", 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553312+0000", 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2099999999999996e-07 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553317+0000", 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5779999999999998e-06 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553328+0000", 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1114999999999999e-05 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553334+0000", 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1070000000000004e-06 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553390+0000", 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6314999999999999e-05 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.553405+0000", 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5305999999999999e-05 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.557426+0000", 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040211689999999998 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.557464+0000", 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8092000000000001e-05 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4886.0:52 7.d e71/26 7:b4812045:::notify.4:head v 71'6, mlcod=71'4)", 2024-04-17T15:38:52.299 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.714077022, 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052142220000000001, 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555006+0000", 2024-04-17T15:38:52.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555007+0000", 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2200000000000003e-07 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555013+0000", 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2339999999999999e-06 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555024+0000", 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0964e-05 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555030+0000", 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.113e-06 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555086+0000", 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6699e-05 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.555101+0000", 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4402e-05 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.560184+0000", 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0050833450000000004 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.560221+0000", 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6643000000000001e-05 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1192 3.1a e71/18 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head v 71'1, mlcod=0'0)", 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.436744040000001, 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012590545, 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832340+0000", 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.91e-07 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837330+0000", 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049904620000000002 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837357+0000", 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6974999999999998e-05 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837370+0000", 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837437+0000", 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6382000000000002e-05 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837455+0000", 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8284e-05 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844890+0000", 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074353930000000002 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844930+0000", 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9458000000000001e-05 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5153.0:48 7.15 e72/26 7:a93a5511:::notify.2:head v 72'51, mlcod=72'49)", 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.573168101, 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041848639999999999, 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695915+0000", 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695916+0000", 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2900000000000002e-07 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695924+0000", 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1419999999999993e-06 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695935+0000", 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1103e-05 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695944+0000", 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695986+0000", 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2580000000000002e-05 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.695998+0000", 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1800000000000001e-05 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.700073+0000", 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040746050000000002 2024-04-17T15:38:52.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.700100+0000", 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7344000000000001e-05 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1592 3.3e 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.462193617000001, 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0089542040000000003, 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.312 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1592 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:52.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806892+0000", 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3989999999999998e-06 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807868+0000", 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00097551400000000003 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807890+0000", 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2503000000000001e-05 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807900+0000", 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7550000000000006e-06 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807964+0000", 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3801999999999997e-05 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808072+0000", 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107871 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808170+0000", 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8197999999999997e-05 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815570+0000", 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074005779999999997 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815774+0000", 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020377899999999999 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815812+0000", 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8098e-05 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815844+0000", 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1707e-05 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1791 4.f 4:f28dd39d:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.7692283189999998, 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038841430000000001, 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1791 2024-04-17T15:38:52.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499855+0000", 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499857+0000", 2024-04-17T15:38:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4249999999999999e-06 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499862+0000", 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5759999999999996e-06 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499879+0000", 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7019000000000001e-05 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499888+0000", 2024-04-17T15:38:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1470000000000007e-06 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.499951+0000", 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3083000000000006e-05 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500041+0000", 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0039999999999999e-05 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.500139+0000", 2024-04-17T15:38:52.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8010000000000005e-05 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.501520+0000", 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001380362 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503644+0000", 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002124403 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503695+0000", 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1031e-05 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.503739+0000", 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4047e-05 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1804 4.39 e72/20 4:9d2afefb:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.3:head v 72'3, mlcod=71'1)", 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.6002116009999998, 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046620460000000004, 2024-04-17T15:38:52.323 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668872+0000", 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668873+0000", 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4900000000000005e-07 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668883+0000", 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9450000000000005e-06 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668896+0000", 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3396e-05 2024-04-17T15:38:52.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668904+0000", 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5610000000000001e-06 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668984+0000", 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0369000000000003e-05 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669006+0000", 2024-04-17T15:38:52.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2118999999999999e-05 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673482+0000", 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044763759999999998 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673534+0000", 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1431000000000003e-05 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1806 4.35 e72/20 4:ad702198:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.5:head v 72'1, mlcod=0'0)", 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.5998372060000001, 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043242230000000003, 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669246+0000", 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669247+0000", 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0500000000000002e-07 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669254+0000", 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8199999999999999e-06 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669265+0000", 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1038e-05 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669270+0000", 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1989999999999997e-06 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669320+0000", 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9339999999999999e-05 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669336+0000", 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6118999999999999e-05 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673523+0000", 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041876880000000002 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673570+0000", 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7114000000000003e-05 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.331 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1902 4.27 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3958991039999997, 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055036649999999996, 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1902 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873185+0000", 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873191+0000", 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1919999999999996e-06 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873207+0000", 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5939000000000001e-05 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873221+0000", 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4566000000000001e-05 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873297+0000", 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5683e-05 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873367+0000", 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0278999999999996e-05 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873460+0000", 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3231000000000002e-05 2024-04-17T15:38:52.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.874219+0000", 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075834800000000005 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878616+0000", 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043977139999999996 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878647+0000", 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878688+0000", 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1232000000000001e-05 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5276.0:52 7.d e72/26 7:b4812045:::notify.4:head v 72'72, mlcod=72'70)", 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.1129287950000002, 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043756890000000003, 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.337 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156155+0000", 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6700000000000003e-07 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156160+0000", 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4510000000000002e-06 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156170+0000", 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9420000000000007e-06 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156174+0000", 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6589999999999998e-06 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156221+0000", 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6761000000000002e-05 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.156235+0000", 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3903999999999999e-05 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.160505+0000", 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004269592 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.160530+0000", 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5712999999999999e-05 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2010 4.f 4:f1d5b99b:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:52.341 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.0194167390000004, 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004172701, 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2010 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:52.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249667+0000", 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249668+0000", 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2440000000000001e-06 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249675+0000", 2024-04-17T15:38:52.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.635e-06 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249692+0000", 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7604999999999998e-05 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249701+0000", 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9330000000000007e-06 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249770+0000", 2024-04-17T15:38:52.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8769000000000005e-05 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249840+0000", 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0542000000000003e-05 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.249899+0000", 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8946000000000001e-05 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.250933+0000", 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001034002 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253733+0000", 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027994920000000002 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253794+0000", 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0860999999999999e-05 2024-04-17T15:38:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:43.253839+0000", 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5671999999999999e-05 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2185 3.19 3:9a84a28a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.29165586599999999, 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014021347, 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2185 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:38:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977430+0000", 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9399999999999998e-06 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979749+0000", 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023181920000000002 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979782+0000", 2024-04-17T15:38:52.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3657e-05 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979794+0000", 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1815e-05 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979891+0000", 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6688999999999995e-05 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.980098+0000", 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206763 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.980290+0000", 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019285 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.990912+0000", 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010621558 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991294+0000", 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038154900000000002 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991373+0000", 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9305e-05 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991449+0000", 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6029e-05 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2192 3.0 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.21252248900000001, 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016712945, 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2192 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056609+0000", 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8192000000000002e-05 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058326+0000", 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017167980000000001 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058354+0000", 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8469000000000001e-05 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058368+0000", 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3567000000000001e-05 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058448+0000", 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9943000000000004e-05 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058629+0000", 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018072100000000001 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058790+0000", 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016184000000000001 2024-04-17T15:38:52.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.069821+0000", 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011030629 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073138+0000", 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033164679999999999 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073206+0000", 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8324999999999994e-05 2024-04-17T15:38:52.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073274+0000", 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7992999999999998e-05 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.19431975200000001, 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.358 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:38:52.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:38:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:38:52.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.19095324999999999, 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:38:52.362 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:38:52.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:38:52.367 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.368 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.368 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.368 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:52.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:52.370 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:52.370+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:52.470 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:52.470+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:52.566 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:52.566 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:52.571 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:52.574+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:52.588 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:52.672 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:52.673+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:52.728 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:52.728 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:52.728 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:52.728 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:52.729 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:52.748 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:52.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:52.793 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:52.793+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:52.873 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:52.873+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:52.946 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:52.947 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:52.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:52.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:52.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.947 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1566 4.34 4:2de1a18d:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.4.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:52.948 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.337156+0000", 2024-04-17T15:38:52.948 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 11.608908414, 2024-04-17T15:38:52.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045290130000000001, 2024-04-17T15:38:52.948 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.948 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.948 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.948 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.949 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.949 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.949 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1566 2024-04-17T15:38:52.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.949 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337156+0000", 2024-04-17T15:38:52.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337156+0000", 2024-04-17T15:38:52.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337158+0000", 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.804e-06 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337165+0000", 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5270000000000004e-06 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337180+0000", 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.554e-05 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337189+0000", 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1980000000000001e-06 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337428+0000", 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023965100000000001 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337528+0000", 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010014999999999999 2024-04-17T15:38:52.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.337656+0000", 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127322 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.339832+0000", 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021766799999999998 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341623+0000", 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017902949999999999 2024-04-17T15:38:52.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341656+0000", 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3426999999999997e-05 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.341685+0000", 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9419000000000001e-05 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.955 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1594 3.2f 3:f6989893:::5305729a-6754-489e-9706-ab50dfde728d.4412.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:52.956 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:38:52.956 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 11.118478738, 2024-04-17T15:38:52.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015262937000000001, 2024-04-17T15:38:52.956 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.956 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1594 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:38:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827588+0000", 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6780000000000001e-06 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829147+0000", 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015589810000000001 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829171+0000", 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4267999999999999e-05 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829180+0000", 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2240000000000001e-06 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829244+0000", 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3565999999999994e-05 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829368+0000", 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123977 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829722+0000", 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035428599999999999 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.838390+0000", 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0086673889999999993 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842776+0000", 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043862700000000003 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842818+0000", 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2061999999999998e-05 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842849+0000", 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1235999999999997e-05 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1684 4.34 4:2de1a18d:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.4.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.160431+0000", 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.785633743, 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070235929999999999, 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1684 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160431+0000", 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160431+0000", 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160433+0000", 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.576e-06 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160441+0000", 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0439999999999996e-06 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160469+0000", 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8011999999999999e-05 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160483+0000", 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.466e-05 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160542+0000", 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8289999999999999e-05 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160613+0000", 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1087999999999994e-05 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.160703+0000", 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0002999999999999e-05 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.161737+0000", 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0010341040000000001 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.167314+0000", 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055771909999999996 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.167400+0000", 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5566e-05 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.167455+0000", 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5059000000000003e-05 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.5415.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94043215969696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.422245+0000", 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.52382004, 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049826089999999998, 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.5415", 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/2797811486", 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 51 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422245+0000", 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422245+0000", 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422246+0000", 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3799999999999996e-07 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422251+0000", 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.775e-06 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422264+0000", 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.362e-05 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422269+0000", 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3140000000000003e-06 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422321+0000", 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1372999999999998e-05 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422376+0000", 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4834999999999999e-05 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422458+0000", 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2164999999999997e-05 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.422912+0000", 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000453988 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.427094+0000", 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041822259999999998 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.427132+0000", 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8300000000000003e-05 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.427227+0000", 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5074999999999994e-05 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1811 4.19 e72/20 4:9a67dc75:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.10:head v 72'2, mlcod=0'0)", 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.668943+0000", 2024-04-17T15:38:52.972 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.277121862, 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046476729999999997, 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668943+0000", 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668943+0000", 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668944+0000", 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8599999999999998e-07 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668948+0000", 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6199999999999998e-06 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668958+0000", 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3880000000000006e-06 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.668963+0000", 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5509999999999999e-06 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669017+0000", 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3956000000000003e-05 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.669039+0000", 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1401999999999999e-05 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673543+0000", 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045041869999999998 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.673591+0000", 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7982999999999998e-05 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.5460.0:56 7.14 e72/26 7:2b04a3e9:::notify.6:head v 72'66, mlcod=72'64)", 2024-04-17T15:38:52.976 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.790778+0000", 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.155286565000001, 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043548939999999998, 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.790778+0000", 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.790778+0000", 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.790779+0000", 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4199999999999995e-07 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.790784+0000", 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0490000000000003e-06 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.790794+0000", 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0379e-05 2024-04-17T15:38:52.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.790801+0000", 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7739999999999999e-06 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.790857+0000", 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5387999999999999e-05 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.790867+0000", 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0359e-05 2024-04-17T15:38:52.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.795106+0000", 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0042391989999999999 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.795133+0000", 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7104e-05 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2190 3.9 e76/18 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:52.980 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.90690676800000003, 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012233502, 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:38:52.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3299999999999998e-07 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043625+0000", 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004467047 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043654+0000", 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8178e-05 2024-04-17T15:38:52.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043667+0000", 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3388e-05 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043737+0000", 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9486999999999994e-05 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043755+0000", 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8209000000000001e-05 2024-04-17T15:38:52.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051330+0000", 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075749349999999997 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051392+0000", 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1925000000000001e-05 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2191 3.3b e76/18 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:52.984 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.89343339499999996, 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017593028, 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:38:52.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052633+0000", 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.218e-06 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057496+0000", 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048628489999999998 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057528+0000", 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2636999999999999e-05 2024-04-17T15:38:52.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057546+0000", 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7368999999999999e-05 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057647+0000", 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101662 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057685+0000", 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7333000000000003e-05 2024-04-17T15:38:52.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070062+0000", 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0123774 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070225+0000", 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016255999999999999 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.988 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2192 3.0 e76/18 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.88716797800000002, 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014023864, 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:38:52.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058899+0000", 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061931+0000", 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003032145 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061958+0000", 2024-04-17T15:38:52.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6344000000000001e-05 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061971+0000", 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3739e-05 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062054+0000", 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2442999999999997e-05 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062080+0000", 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5970999999999999e-05 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072852+0000", 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010772415 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072921+0000", 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.868e-05 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2194 3.0 e76/18 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.865402212, 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017385022, 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080665+0000", 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082876+0000", 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022112590000000001 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082917+0000", 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0142999999999998e-05 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082936+0000", 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9760000000000001e-05 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083070+0000", 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013328299999999999 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083100+0000", 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0450000000000002e-05 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.097937+0000", 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014836716 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098048+0000", 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110968 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:52.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2201 3.3d e76/18 3:bf2548c9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_20:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.79214037599999998, 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00815747, 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153925+0000", 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155682+0000", 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017575239999999999 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155706+0000", 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3890999999999999e-05 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155719+0000", 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.313e-05 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155796+0000", 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6862999999999999e-05 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:52.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155821+0000", 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162033+0000", 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006211823 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162082+0000", 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8742999999999997e-05 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2210 3.9 e76/18 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.696253393, 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015862533000000002, 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249813+0000", 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.051e-06 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253690+0000", 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038778990000000002 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253719+0000", 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8643e-05 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253731+0000", 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1667e-05 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253802+0000", 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1154000000000003e-05 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253830+0000", 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8489000000000001e-05 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265608+0000", 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011777881 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265674+0000", 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5748999999999997e-05 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.65957397200000001, 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:53.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:38:53.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2216 3.3b e76/18 3:dce33251:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_35:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.63326423700000001, 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014445159000000001, 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7599999999999996e-07 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316913+0000", 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041116140000000004 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316938+0000", 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5439000000000002e-05 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316953+0000", 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4352000000000001e-05 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317067+0000", 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011370999999999999 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317096+0000", 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9762000000000001e-05 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327173+0000", 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010077114 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327246+0000", 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2391999999999994e-05 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2217 3.16 3:685b1a75:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.62974600400000003, 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015566544, 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:53.014 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2217 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316321+0000", 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.888e-06 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317806+0000", 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001485295 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317826+0000", 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9772e-05 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317839+0000", 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.275e-05 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317905+0000", 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6295000000000001e-05 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318050+0000", 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014553499999999999 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318184+0000", 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013408100000000001 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327767+0000", 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095827919999999997 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331806+0000", 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040388439999999998 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331852+0000", 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5688e-05 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331885+0000", 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3603999999999999e-05 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2220 3.9 e76/18 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head v 76'3, mlcod=76'1)", 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.59381158999999994, 2024-04-17T15:38:53.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080201279999999996, 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352255+0000", 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1519999999999999e-06 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356205+0000", 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039496339999999996 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356229+0000", 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3944e-05 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356239+0000", 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0039e-05 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356306+0000", 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7041999999999999e-05 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356330+0000", 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3434999999999998e-05 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360227+0000", 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003897064 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360273+0000", 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6817999999999998e-05 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2222 3.3b e76/18 3:de6332b5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_41:head v 76'3, mlcod=76'1)", 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.57444752799999999, 2024-04-17T15:38:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013173443999999999, 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371619+0000", 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6029999999999999e-06 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375645+0000", 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040257330000000001 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375689+0000", 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3884999999999997e-05 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375704+0000", 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5792000000000001e-05 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375811+0000", 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001064 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375845+0000", 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4406999999999998e-05 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384724+0000", 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088788570000000004 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384791+0000", 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6767000000000006e-05 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:38:53.027 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.52911458600000005, 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.43447625400000001, 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.41501981500000001, 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:53.038 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:53.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:53.043 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:53.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:53.045 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:53.046 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:53.046 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:53.047 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:53.047 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:53.046+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:53.071 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:53.101 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:53.101 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:53.141 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:53.141 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:53.145 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:53.145+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:53.174 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:53.175 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:53.222 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:53.222 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:53.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:53.247 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:53.246+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:53.347 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:53.345+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:53.351 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:38:53.438 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:53.439 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:53.448 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:53.449+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:53.465 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:53.557 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:53.557+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:53.650 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:53.650+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:53.662 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:53.662 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:53.682 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:53.750 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:53.749+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:53.828 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:53.828 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:53.846 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:53.850 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:53.849+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:53.951 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:53.954+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:53.991 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:53.992 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:54.008 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:54.052 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:54.054+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:54.153 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:54.153+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:54.194 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:54.194 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:54.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:54.263 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:54.266+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:54.355 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:54.353+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:54.363 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:54.363 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:54.372 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:38:54.383 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:54.456 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:54.457+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:54.557 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:54.557+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:54.571 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:54.572 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:54.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:54.658 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:54.658+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:54.722 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:54.722 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:54.738 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:54.759 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:54.757+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:54.790 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 1Gb. 2024-04-17T15:38:54.791 INFO:tasks.workunit.client.0.smithi044.stdout:upload file successful 2024-04-17T15:38:54.791 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:54.791 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-04-17T15:38:54.791 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:38:54.859 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:54.862+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:54.910 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:54.910 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:54.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:54.961 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:54.961+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:55.061 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:55.062+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:55.067 INFO:tasks.workunit.client.0.smithi044.stdout:user qa_user deleted 2024-04-17T15:38:55.067 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:38:55.101 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:55.101 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:55.116 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:55.163 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:55.166+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:55.210 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:55.264 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:55.266+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:55.283 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:55.284 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:55.298 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:55.367 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:55.367 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:55.383 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:55.386+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:55.385 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:55.385 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:55.402 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:55.419 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:55.420 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:55.440 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:55.441 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:55.461 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:55.465 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:55.465 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:55.465 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:55.466+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:55.479 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:55.482 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:55.482 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:55.501 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:55.571 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:55.574+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:55.653 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:55.654 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:38:55.654 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:38:55.654 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:38:55.654 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:55.666 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:55.665+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:55.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:55.767 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:38:55.770+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:38:55.842 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 127.76840183900001, 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.843 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:38:55.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 127.276408617, 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 127.276368668, 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:38:55.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 127.276329745, 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:38:55.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:38:55.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:38:55.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 127.276130163, 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.866 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:38:55.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 127.276084931, 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.872 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:38:55.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:38:55.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:38:55.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:55.877 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 127.049483857, 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:55.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:38:55.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.8729807149999997, 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2191 3.3b 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7940228839999999, 2024-04-17T15:38:55.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024079896999999999, 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2191 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047034+0000", 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051686+0000", 2024-04-17T15:38:55.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046523550000000004 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051729+0000", 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3032999999999999e-05 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051748+0000", 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9148999999999999e-05 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051911+0000", 2024-04-17T15:38:55.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016241300000000001 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052338+0000", 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000427549 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052584+0000", 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000245861 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.059685+0000", 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071007229999999998 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070946+0000", 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011261136 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071036+0000", 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0066000000000001e-05 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071110+0000", 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4609000000000003e-05 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2195 3.f 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7514654520000001, 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022167662000000001, 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.894 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2195 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089591+0000", 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.134e-06 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093534+0000", 2024-04-17T15:38:55.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039429010000000004 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093579+0000", 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5423000000000002e-05 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093601+0000", 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1622999999999999e-05 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093781+0000", 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017973500000000001 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094072+0000", 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029165799999999998 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094318+0000", 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024528400000000002 2024-04-17T15:38:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103355+0000", 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090377029999999994 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111447+0000", 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080915640000000007 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111616+0000", 2024-04-17T15:38:55.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016912200000000001 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111756+0000", 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013951499999999999 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7428587750000002, 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:38:55.900 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:38:55.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:38:55.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.73265395, 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:38:55.906 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:38:55.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2207 3.15 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.6265422090000001, 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022770393999999999, 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2207 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214516+0000", 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.284e-06 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218674+0000", 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004158953 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218721+0000", 2024-04-17T15:38:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6669999999999999e-05 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218749+0000", 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7846000000000001e-05 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218887+0000", 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013819200000000001 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219113+0000", 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022536100000000001 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219315+0000", 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020251500000000001 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232744+0000", 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013428796999999999 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.236964+0000", 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042205189999999998 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237138+0000", 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173198 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237282+0000", 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014405900000000001 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2214 3.2f e76/45 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head v 76'3, mlcod=72'1)", 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:38:55.917 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.5519178079999998, 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022854762000000001, 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:38:55.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289138+0000", 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293890+0000", 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047525909999999996 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293918+0000", 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7742999999999998e-05 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293933+0000", 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4623e-05 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294082+0000", 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149662 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294148+0000", 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5345999999999994e-05 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311863+0000", 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017715564999999999 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311990+0000", 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012724899999999999 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2216 3.3b 3:dce33251:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.307335+0000", 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.5337183109999999, 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020880069000000001, 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2216 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.307335+0000", 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.307335+0000", 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.307366+0000", 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0929999999999997e-05 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312129+0000", 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047628039999999998 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312157+0000", 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8563000000000001e-05 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312177+0000", 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9318999999999999e-05 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312308+0000", 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013134600000000001 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312541+0000", 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023259100000000001 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312759+0000", 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000218781 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.322021+0000", 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092614540000000006 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.328054+0000", 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006033137 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.328143+0000", 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8907999999999996e-05 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.328215+0000", 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2236000000000004e-05 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2218 3.39 3:9d9d4055:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.5137297529999998, 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023480399999999998, 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.927 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2218 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327327+0000", 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331723+0000", 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043962680000000001 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331760+0000", 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6903000000000002e-05 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331783+0000", 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3598999999999999e-05 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331906+0000", 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012282300000000001 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332168+0000", 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026144100000000001 2024-04-17T15:38:55.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332408+0000", 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024071499999999999 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.345166+0000", 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012757961 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350543+0000", 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053770720000000001 2024-04-17T15:38:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350728+0000", 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018468599999999999 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350804+0000", 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6066e-05 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2219 3.11 3:8990f5d3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.337039+0000", 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.5040145730000001, 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021972254, 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2219 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.337039+0000", 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.337039+0000", 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.337042+0000", 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341094+0000", 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040514610000000001 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341126+0000", 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2483000000000001e-05 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341143+0000", 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6742999999999999e-05 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341280+0000", 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013707899999999999 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341562+0000", 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028206699999999999 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341825+0000", 2024-04-17T15:38:55.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026330499999999997 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.356408+0000", 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014582725 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.358722+0000", 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002313444 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.358883+0000", 2024-04-17T15:38:55.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016161600000000001 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.359011+0000", 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012785800000000001 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2237 3.2a e76/18 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.313264078, 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022753497000000001, 2024-04-17T15:38:55.938 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527792+0000", 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7130000000000001e-06 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534227+0000", 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064349760000000002 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534276+0000", 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8996999999999999e-05 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534302+0000", 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6279e-05 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534552+0000", 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024917100000000002 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534609+0000", 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7837000000000002e-05 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550416+0000", 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015806222000000002 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550543+0000", 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012730200000000001 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.942 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.2671060710000002, 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:38:55.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:38:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.1392498569999998, 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:38:55.948 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:38:55.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:38:55.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:38:55.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:38:55.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:38:55.953 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:38:55.955 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:55.954+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:55.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:38:56.055 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:56.058+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:56.074 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:56.074 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:56.074 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:56.074 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:56.091 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:38:56.157 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:56.158+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:56.211 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:56.212 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:56.212 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:56.212 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:56.212 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:56.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:38:56.258 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:56.258+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:56.358 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:56.357+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:56.367 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:56.367 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:56.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:56.367 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:56.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.367 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1195 3.b e71/18 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-17T15:38:56.367 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.515104054999998, 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015153946, 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851811+0000", 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6400000000000002e-07 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854045+0000", 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339170000000002 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854070+0000", 2024-04-17T15:38:56.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5125000000000001e-05 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854085+0000", 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.552e-05 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854172+0000", 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6213999999999998e-05 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854199+0000", 2024-04-17T15:38:56.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7472999999999999e-05 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866900+0000", 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012700421999999999 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866964+0000", 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4710999999999998e-05 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2186 3.3 e76/18 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.995724+0000", 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.3711908859999999, 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016460343999999998, 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.995724+0000", 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.995724+0000", 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.995724+0000", 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4200000000000002e-07 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.002950+0000", 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072265920000000004 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.002982+0000", 2024-04-17T15:38:56.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1707e-05 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.002997+0000", 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4854e-05 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.003078+0000", 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1460999999999998e-05 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.003103+0000", 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4844000000000001e-05 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.012112+0000", 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090091719999999993 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.012184+0000", 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1371999999999994e-05 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2187 3.20 e76/18 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.004329+0000", 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.3625858270000002, 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01414376, 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.004329+0000", 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.004329+0000", 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.004329+0000", 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3200000000000001e-07 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010745+0000", 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006415624 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010771+0000", 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6248e-05 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010786+0000", 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4901e-05 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010878+0000", 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1972999999999995e-05 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010915+0000", 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7645999999999998e-05 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.018412+0000", 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074971719999999999 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.018472+0000", 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9864000000000001e-05 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2197 3.39 e76/18 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:56.379 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.120229+0000", 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.2466857710000001, 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015148755, 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.120229+0000", 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.120229+0000", 2024-04-17T15:38:56.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.120229+0000", 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.98e-07 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126678+0000", 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064495560000000004 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126704+0000", 2024-04-17T15:38:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.525e-05 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126713+0000", 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7839999999999998e-06 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126783+0000", 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9319000000000005e-05 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126800+0000", 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7129000000000002e-05 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.135298+0000", 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084984290000000001 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.135377+0000", 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9090000000000003e-05 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.383 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2198 3.3a e76/18 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.2441647900000001, 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019644212000000001, 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:38:56.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9499999999999998e-07 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129524+0000", 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067742130000000003 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129550+0000", 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5395999999999999e-05 2024-04-17T15:38:56.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129565+0000", 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5064e-05 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129665+0000", 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100381 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129688+0000", 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3479999999999999e-05 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142322+0000", 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012633287999999999 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142394+0000", 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2094999999999993e-05 2024-04-17T15:38:56.388 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2202 3.30 e76/18 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.1978019499999997, 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017043618999999999, 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169115+0000", 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0990000000000001e-06 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174068+0000", 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049531810000000001 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174103+0000", 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4885000000000002e-05 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174119+0000", 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6263999999999999e-05 2024-04-17T15:38:56.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174216+0000", 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7578000000000007e-05 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174246+0000", 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9810000000000001e-05 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186092+0000", 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011845496 2024-04-17T15:38:56.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186156+0000", 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4306000000000004e-05 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2205 3.17 3:ea2615d0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.1726610229999999, 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017729135, 2024-04-17T15:38:56.393 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2205 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194257+0000", 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1470000000000001e-06 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196293+0000", 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020363099999999999 2024-04-17T15:38:56.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196318+0000", 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5194999999999998e-05 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196331+0000", 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2977e-05 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196416+0000", 2024-04-17T15:38:56.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5049000000000005e-05 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196543+0000", 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012732100000000001 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196639+0000", 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5302000000000003e-05 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.202228+0000", 2024-04-17T15:38:56.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055891480000000004 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211895+0000", 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096668139999999993 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211941+0000", 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6783999999999998e-05 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211983+0000", 2024-04-17T15:38:56.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1087999999999997e-05 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2208 3.1b 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.1427129499999999, 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021369764999999999, 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.399 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2208 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224204+0000", 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6259999999999999e-06 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226060+0000", 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001855766 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226089+0000", 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8806000000000002e-05 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226103+0000", 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.483e-05 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226194+0000", 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0162999999999997e-05 2024-04-17T15:38:56.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226364+0000", 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017058399999999999 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226515+0000", 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000150493 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236552+0000", 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010037107999999999 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245450+0000", 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088980710000000005 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245517+0000", 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7325999999999999e-05 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245571+0000", 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3992000000000001e-05 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2230 3.3a e76/18 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.9116235120000002, 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018369284999999999, 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:38:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455293+0000", 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.841e-06 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460234+0000", 2024-04-17T15:38:56.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049411330000000003 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460257+0000", 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3159999999999998e-05 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460268+0000", 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1056000000000001e-05 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460336+0000", 2024-04-17T15:38:56.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7595000000000006e-05 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460368+0000", 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2205000000000001e-05 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473473+0000", 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013105314 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473660+0000", 2024-04-17T15:38:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698099999999999 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2232 3.1b 3:da25f619:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.897358068, 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017288061, 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.409 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2232 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469559+0000", 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.649e-06 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.471972+0000", 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002412862 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472008+0000", 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5945999999999998e-05 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472023+0000", 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5122e-05 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472113+0000", 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0183e-05 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472254+0000", 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014096900000000001 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:56.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472363+0000", 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010873499999999999 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.482529+0000", 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010166019 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486718+0000", 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041890080000000001 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486790+0000", 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1953999999999996e-05 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486844+0000", 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4614000000000003e-05 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2234 3.17 3:eb70e137:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.8767055900000003, 2024-04-17T15:38:56.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017531280999999999, 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2234 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490212+0000", 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3749999999999999e-06 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492617+0000", 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024048540000000001 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492639+0000", 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1472e-05 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492648+0000", 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9870000000000005e-06 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492729+0000", 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1034999999999999e-05 2024-04-17T15:38:56.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492870+0000", 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014136800000000001 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.493035+0000", 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016558 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.497649+0000", 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046137119999999998 2024-04-17T15:38:56.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507638+0000", 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099891249999999997 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507687+0000", 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8869000000000003e-05 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507740+0000", 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2904e-05 2024-04-17T15:38:56.419 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2240 3.1f 3:f8ad20ec:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.8134133289999999, 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018806135000000002, 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.420 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2240 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553505+0000", 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.715e-06 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556184+0000", 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026795149999999999 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556217+0000", 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2323000000000002e-05 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556231+0000", 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4662e-05 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556329+0000", 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7598999999999998e-05 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556493+0000", 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016452900000000001 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556649+0000", 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000155291 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.564664+0000", 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080152699999999997 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572214+0000", 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00754991 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572260+0000", 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6526000000000001e-05 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572307+0000", 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6795000000000002e-05 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2241 3.12 3:4bb118b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.8014313770000001, 2024-04-17T15:38:56.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018446299999999999, 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2241 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565485+0000", 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566940+0000", 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001454718 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566971+0000", 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0550999999999999e-05 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566996+0000", 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5537999999999998e-05 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567065+0000", 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9153999999999996e-05 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567197+0000", 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013143200000000001 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567298+0000", 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101488 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.573358+0000", 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060601309999999999 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583838+0000", 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010479197000000001 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583890+0000", 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2117999999999998e-05 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583929+0000", 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9530000000000003e-05 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.430 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2245 3.17 3:e9b13e02:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.7636929779999999, 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018296036000000002, 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2245 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.431 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603225+0000", 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1379999999999999e-06 2024-04-17T15:38:56.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604941+0000", 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001716595 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604968+0000", 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7137000000000001e-05 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604980+0000", 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1704e-05 2024-04-17T15:38:56.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605056+0000", 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6265000000000002e-05 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605181+0000", 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012499399999999999 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605283+0000", 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102027 2024-04-17T15:38:56.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.613207+0000", 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079242050000000001 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621395+0000", 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081871159999999995 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621463+0000", 2024-04-17T15:38:56.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8354000000000003e-05 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621517+0000", 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4500999999999999e-05 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2249 3.20 e76/18 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.7137759580000003, 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021006212999999999, 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.436 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653140+0000", 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-06 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658320+0000", 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051792610000000001 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658379+0000", 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8829999999999997e-05 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658398+0000", 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9193000000000001e-05 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658487+0000", 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9685999999999995e-05 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658514+0000", 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6818999999999999e-05 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674073+0000", 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015559078 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674145+0000", 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1360999999999997e-05 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2258 3.17 3:e8df4510:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:38:56.440 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.6264765379999999, 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017321514, 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2258 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740440+0000", 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4609999999999998e-06 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742267+0000", 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018265239999999999 2024-04-17T15:38:56.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742291+0000", 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3787000000000001e-05 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742301+0000", 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0253e-05 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742388+0000", 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7157000000000006e-05 2024-04-17T15:38:56.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742592+0000", 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020355699999999999 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742772+0000", 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018084399999999999 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.748426+0000", 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056539870000000001 2024-04-17T15:38:56.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757641+0000", 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092143060000000002 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757693+0000", 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1916999999999998e-05 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757759+0000", 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6721e-05 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.445 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2260 3.23 3:c7e72049:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.762236+0000", 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.604678571, 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015847752, 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2260 2024-04-17T15:38:56.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762236+0000", 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762236+0000", 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762239+0000", 2024-04-17T15:38:56.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9550000000000001e-06 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.763985+0000", 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017460360000000001 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764013+0000", 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8561e-05 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764029+0000", 2024-04-17T15:38:56.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5196e-05 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764102+0000", 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2980999999999998e-05 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764291+0000", 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018989699999999999 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764414+0000", 2024-04-17T15:38:56.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012263199999999999 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776332+0000", 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011918256 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777966+0000", 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001633607 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.778030+0000", 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3812999999999994e-05 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.778084+0000", 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3817999999999999e-05 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2267 3.6 3:601e7e13:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.834685+0000", 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.53222982, 2024-04-17T15:38:56.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013562207999999999, 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2267 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.834685+0000", 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.834685+0000", 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.834688+0000", 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0979999999999998e-06 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836460+0000", 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017721270000000001 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836490+0000", 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9779999999999999e-05 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836500+0000", 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0696999999999999e-05 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836582+0000", 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1744999999999997e-05 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836751+0000", 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016934900000000001 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836917+0000", 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016564600000000001 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.844145+0000", 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072279299999999996 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848119+0000", 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039738999999999998 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848187+0000", 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848247+0000", 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.999e-05 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.456 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2272 3.1f 3:fba75e94:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.888365+0000", 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.4785489730000001, 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016997089999999999, 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2272 2024-04-17T15:38:56.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.888365+0000", 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.888365+0000", 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.888368+0000", 2024-04-17T15:38:56.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8169999999999999e-06 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890244+0000", 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018755989999999999 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890284+0000", 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0222999999999998e-05 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890299+0000", 2024-04-17T15:38:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4600000000000001e-05 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890382+0000", 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3430999999999995e-05 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890548+0000", 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000165396 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890662+0000", 2024-04-17T15:38:56.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114203 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.896562+0000", 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059003500000000004 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.905235+0000", 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0086729029999999992 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.905307+0000", 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2009999999999997e-05 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.905363+0000", 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5557999999999999e-05 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2278 3.1b 3:d8a1e895:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:38:56.462 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.4158310529999998, 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017298622, 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2278 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951086+0000", 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459999999999998e-06 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952905+0000", 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001818442 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952936+0000", 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1260000000000002e-05 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952950+0000", 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3658e-05 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953031+0000", 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1593000000000003e-05 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953143+0000", 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011195400000000001 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953266+0000", 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012241500000000001 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.961279+0000", 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080132980000000003 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968256+0000", 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006977507 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968326+0000", 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9251999999999994e-05 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968382+0000", 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6297e-05 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.467 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:56.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:38:56.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:38:56.470 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:56.469+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:56.570 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:56.569+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:56.627 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:56.628 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:56.628 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:56.628 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:56.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:38:56.671 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:56.674+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:56.773 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:38:56.774+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:38:56.795 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:56.795 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:56.795 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:56.795 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:56.795 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:56.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:38:56.874 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:56.874+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:56.924 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:56.924 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:56.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:56.924 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:56.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.924 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1192 3.1a e71/18 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head v 71'1, mlcod=0'0)", 2024-04-17T15:38:56.924 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.090717507000001, 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012590545, 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832340+0000", 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.91e-07 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837330+0000", 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049904620000000002 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837357+0000", 2024-04-17T15:38:56.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6974999999999998e-05 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837370+0000", 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837437+0000", 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6382000000000002e-05 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837455+0000", 2024-04-17T15:38:56.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8284e-05 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844890+0000", 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074353930000000002 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844930+0000", 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9458000000000001e-05 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.928 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1592 3.3e 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.116167084000001, 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0089542040000000003, 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1592 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:56.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806892+0000", 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3989999999999998e-06 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807868+0000", 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00097551400000000003 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807890+0000", 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2503000000000001e-05 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807900+0000", 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7550000000000006e-06 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807964+0000", 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3801999999999997e-05 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808072+0000", 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107871 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808170+0000", 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8197999999999997e-05 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815570+0000", 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074005779999999997 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815774+0000", 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020377899999999999 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815812+0000", 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8098e-05 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815844+0000", 2024-04-17T15:38:56.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1707e-05 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1902 4.27 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.049872571, 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055036649999999996, 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.934 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1902 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873185+0000", 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873191+0000", 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1919999999999996e-06 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873207+0000", 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5939000000000001e-05 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873221+0000", 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4566000000000001e-05 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873297+0000", 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5683e-05 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873367+0000", 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0278999999999996e-05 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873460+0000", 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3231000000000002e-05 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.874219+0000", 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075834800000000005 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878616+0000", 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043977139999999996 2024-04-17T15:38:56.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878647+0000", 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878688+0000", 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1232000000000001e-05 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2185 3.19 3:9a84a28a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.9456293330000003, 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014021347, 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2185 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977430+0000", 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9399999999999998e-06 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979749+0000", 2024-04-17T15:38:56.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023181920000000002 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979782+0000", 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3657e-05 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979794+0000", 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1815e-05 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979891+0000", 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6688999999999995e-05 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.980098+0000", 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206763 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.980290+0000", 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019285 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.990912+0000", 2024-04-17T15:38:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010621558 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991294+0000", 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038154900000000002 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991373+0000", 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9305e-05 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991449+0000", 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6029e-05 2024-04-17T15:38:56.944 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2192 3.0 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.8664959559999996, 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016712945, 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2192 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.945 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056609+0000", 2024-04-17T15:38:56.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8192000000000002e-05 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058326+0000", 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017167980000000001 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058354+0000", 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8469000000000001e-05 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058368+0000", 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3567000000000001e-05 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058448+0000", 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9943000000000004e-05 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058629+0000", 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018072100000000001 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058790+0000", 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016184000000000001 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.069821+0000", 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011030629 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073138+0000", 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033164679999999999 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073206+0000", 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8324999999999994e-05 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073274+0000", 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7992999999999998e-05 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.8482932190000003, 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.950 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.8449267169999999, 2024-04-17T15:38:56.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:38:56.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:38:56.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:38:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:38:56.959 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2228 3.32 e76/18 3:4e7df19b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_47:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.493379708, 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010461764, 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431443+0000", 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017654840000000001 2024-04-17T15:38:56.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431467+0000", 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3864999999999999e-05 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431483+0000", 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6413999999999999e-05 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431600+0000", 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117169 2024-04-17T15:38:56.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431627+0000", 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6684000000000001e-05 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440072+0000", 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084452910000000006 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440139+0000", 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6656999999999996e-05 2024-04-17T15:38:56.963 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2229 3.19 3:997f76dc:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.4844309769999997, 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012913452000000001, 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.964 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2229 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438628+0000", 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1720000000000001e-06 2024-04-17T15:38:56.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440848+0000", 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022202670000000002 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440869+0000", 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0557999999999999e-05 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440882+0000", 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2781e-05 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440948+0000", 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6066000000000001e-05 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.441073+0000", 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012537400000000001 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.441189+0000", 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011582999999999999 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.450838+0000", 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096493240000000008 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451446+0000", 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060818500000000002 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451486+0000", 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9885000000000002e-05 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451539+0000", 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3010000000000002e-05 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2231 3.3e 3:7e08bf39:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.4648117410000001, 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016293021000000001, 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.969 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2231 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458262+0000", 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6534000000000001e-05 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460097+0000", 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001835298 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460124+0000", 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7359e-05 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460140+0000", 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5241e-05 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460208+0000", 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8579999999999997e-05 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460333+0000", 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012509500000000001 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:38:56.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460467+0000", 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013373599999999999 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472830+0000", 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012363486 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474285+0000", 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014549669999999999 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474416+0000", 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013019099999999999 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474538+0000", 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012253399999999999 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2233 3.25 3:a45e43c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:38:56.974 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.4436200289999999, 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012859545999999999, 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2233 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479440+0000", 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4240000000000002e-06 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481115+0000", 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001674593 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481140+0000", 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4757e-05 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481150+0000", 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.061e-05 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481230+0000", 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0129000000000005e-05 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481395+0000", 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000164418 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481541+0000", 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014615400000000001 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.489435+0000", 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078943510000000008 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492174+0000", 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027384570000000001 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492230+0000", 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5816000000000002e-05 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492296+0000", 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6836999999999997e-05 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.979 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2235 3.19 3:9b2d1060:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.421977826, 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012884441, 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2235 2024-04-17T15:38:56.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501082+0000", 2024-04-17T15:38:56.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8710000000000001e-06 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503033+0000", 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001951068 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503060+0000", 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6670999999999999e-05 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503075+0000", 2024-04-17T15:38:56.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4916000000000001e-05 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503170+0000", 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5733e-05 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503327+0000", 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001562 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503493+0000", 2024-04-17T15:38:56.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000166088 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513393+0000", 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099001009999999997 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513830+0000", 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043754999999999998 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513900+0000", 2024-04-17T15:38:56.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9951999999999997e-05 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513964+0000", 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3291000000000001e-05 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2239 3.1a e76/18 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head v 76'3, mlcod=71'1)", 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.3747465710000002, 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012593248, 2024-04-17T15:38:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548313+0000", 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4710000000000001e-06 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553543+0000", 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052302770000000002 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553577+0000", 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3538000000000003e-05 2024-04-17T15:38:56.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553591+0000", 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4765e-05 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553678+0000", 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6640999999999999e-05 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553708+0000", 2024-04-17T15:38:56.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0114e-05 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.560838+0000", 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071303670000000003 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.560904+0000", 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5074999999999996e-05 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2244 3.19 3:9a9a742a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.329849383, 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013573603, 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2244 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593211+0000", 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.207e-06 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594773+0000", 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015622489999999999 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594798+0000", 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5111999999999999e-05 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594808+0000", 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0319999999999999e-05 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594884+0000", 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5105999999999995e-05 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.595066+0000", 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182065 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.595223+0000", 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015709 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.599821+0000", 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045988009999999996 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606657+0000", 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006835374 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606726+0000", 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9496e-05 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606781+0000", 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4783e-05 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.267726959, 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:56.995 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:56.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:56.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.000 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2251 3.1a e76/18 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head v 76'4, mlcod=76'2)", 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.2509952770000003, 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011149496, 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:38:57.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672063+0000", 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.778e-06 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676433+0000", 2024-04-17T15:38:57.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043691900000000002 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676451+0000", 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187999999999999e-05 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676462+0000", 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1286e-05 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676534+0000", 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1865000000000004e-05 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676553+0000", 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8760999999999999e-05 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.683146+0000", 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0065932439999999998 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.683211+0000", 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5184000000000005e-05 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2252 3.25 3:a447a9ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.2447974860000004, 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014955945, 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2252 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:38:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678262+0000", 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0639999999999998e-06 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680355+0000", 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020922559999999998 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680381+0000", 2024-04-17T15:38:57.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6437000000000001e-05 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680395+0000", 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3653e-05 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680498+0000", 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103486 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680682+0000", 2024-04-17T15:38:57.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018336700000000001 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680824+0000", 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014226399999999999 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692441+0000", 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011617331 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693055+0000", 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000614092 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693133+0000", 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7996000000000003e-05 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693215+0000", 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1998999999999999e-05 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2261 3.37 e76/45 3:ef87aca3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_80:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.1455471020000001, 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010338282000000001, 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777511+0000", 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782642+0000", 2024-04-17T15:38:57.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051310230000000002 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782676+0000", 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4786000000000002e-05 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782694+0000", 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7776000000000001e-05 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782790+0000", 2024-04-17T15:38:57.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5699999999999995e-05 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782826+0000", 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5836e-05 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.787780+0000", 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049541580000000002 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.787848+0000", 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8152999999999996e-05 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2265 3.25 3:a7c7e3b2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.1099095749999996, 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012222443, 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2265 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813150+0000", 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814795+0000", 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001644653 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814822+0000", 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7008999999999998e-05 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814833+0000", 2024-04-17T15:38:57.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0899e-05 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814966+0000", 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133151 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.815140+0000", 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403199999999999 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.815291+0000", 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015072100000000001 2024-04-17T15:38:57.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825222+0000", 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099317290000000003 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825268+0000", 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5850999999999999e-05 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825306+0000", 2024-04-17T15:38:57.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8241000000000002e-05 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825370+0000", 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3291000000000001e-05 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2267 3.6 e76/18 3:601e7e13:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_86:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.086023183, 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010876569000000001, 2024-04-17T15:38:57.020 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837036+0000", 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2110000000000001e-06 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838535+0000", 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499043 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838563+0000", 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.826e-05 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838578+0000", 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4776e-05 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838661+0000", 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2915000000000002e-05 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838706+0000", 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4882999999999997e-05 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.847835+0000", 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091295309999999998 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.847910+0000", 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4950000000000006e-05 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.024 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:57.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:38:57.026 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:57.025+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:57.126 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:57.125+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:57.197 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:57.197 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:57.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:57.197 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:57.211 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:38:57.252 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:57.253+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:57.328 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:57.330+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:57.370 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:38:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:38:57.370 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:57.384 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:38:57.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:38:57.452 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:57.453+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:57.513 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1594 3.2f 3:f6989893:::5305729a-6754-489e-9706-ab50dfde728d.4412.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.685432446, 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015262937000000001, 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1594 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827588+0000", 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6780000000000001e-06 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829147+0000", 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015589810000000001 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829171+0000", 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4267999999999999e-05 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829180+0000", 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2240000000000001e-06 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829244+0000", 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3565999999999994e-05 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829368+0000", 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123977 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829722+0000", 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035428599999999999 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.838390+0000", 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0086673889999999993 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842776+0000", 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043862700000000003 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842818+0000", 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2061999999999998e-05 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842849+0000", 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1235999999999997e-05 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2190 3.9 e76/18 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.4738604759999996, 2024-04-17T15:38:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012233502, 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3299999999999998e-07 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043625+0000", 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004467047 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043654+0000", 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8178e-05 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043667+0000", 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3388e-05 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043737+0000", 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9486999999999994e-05 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043755+0000", 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8209000000000001e-05 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051330+0000", 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075749349999999997 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051392+0000", 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1925000000000001e-05 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2191 3.3b e76/18 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.4603871030000004, 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017593028, 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:38:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052633+0000", 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.218e-06 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057496+0000", 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048628489999999998 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057528+0000", 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2636999999999999e-05 2024-04-17T15:38:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057546+0000", 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7368999999999999e-05 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057647+0000", 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101662 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057685+0000", 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7333000000000003e-05 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070062+0000", 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0123774 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070225+0000", 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016255999999999999 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2192 3.0 e76/18 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.4541216859999997, 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014023864, 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058899+0000", 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061931+0000", 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003032145 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061958+0000", 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6344000000000001e-05 2024-04-17T15:38:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061971+0000", 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3739e-05 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062054+0000", 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2442999999999997e-05 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062080+0000", 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5970999999999999e-05 2024-04-17T15:38:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072852+0000", 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010772415 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072921+0000", 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.868e-05 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2194 3.0 e76/18 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:38:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.43235592, 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017385022, 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080665+0000", 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082876+0000", 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022112590000000001 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082917+0000", 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0142999999999998e-05 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082936+0000", 2024-04-17T15:38:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9760000000000001e-05 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083070+0000", 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013328299999999999 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083100+0000", 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0450000000000002e-05 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.097937+0000", 2024-04-17T15:38:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014836716 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098048+0000", 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110968 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2201 3.3d e76/18 3:bf2548c9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_20:head v 76'1, mlcod=0'0)", 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.3590940839999996, 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00815747, 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153925+0000", 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155682+0000", 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017575239999999999 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155706+0000", 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3890999999999999e-05 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155719+0000", 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.313e-05 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155796+0000", 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6862999999999999e-05 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155821+0000", 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162033+0000", 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006211823 2024-04-17T15:38:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162082+0000", 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8742999999999997e-05 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2210 3.9 e76/18 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.2632071009999999, 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015862533000000002, 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249813+0000", 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.051e-06 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253690+0000", 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038778990000000002 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253719+0000", 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8643e-05 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253731+0000", 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1667e-05 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253802+0000", 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1154000000000003e-05 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253830+0000", 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8489000000000001e-05 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265608+0000", 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011777881 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265674+0000", 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5748999999999997e-05 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.2265276800000002, 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:38:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2216 3.3b e76/18 3:dce33251:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_35:head v 76'2, mlcod=0'0)", 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.2002179450000003, 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014445159000000001, 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7599999999999996e-07 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316913+0000", 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041116140000000004 2024-04-17T15:38:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316938+0000", 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5439000000000002e-05 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316953+0000", 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4352000000000001e-05 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317067+0000", 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011370999999999999 2024-04-17T15:38:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317096+0000", 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9762000000000001e-05 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327173+0000", 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010077114 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327246+0000", 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2391999999999994e-05 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2217 3.16 3:685b1a75:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.196699712, 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015566544, 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2217 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316321+0000", 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.888e-06 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317806+0000", 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001485295 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317826+0000", 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9772e-05 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317839+0000", 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.275e-05 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317905+0000", 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6295000000000001e-05 2024-04-17T15:38:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318050+0000", 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014553499999999999 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318184+0000", 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013408100000000001 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327767+0000", 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095827919999999997 2024-04-17T15:38:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331806+0000", 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040388439999999998 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331852+0000", 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5688e-05 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331885+0000", 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3603999999999999e-05 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2220 3.9 e76/18 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head v 76'3, mlcod=76'1)", 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.1607652980000003, 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080201279999999996, 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352255+0000", 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1519999999999999e-06 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356205+0000", 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039496339999999996 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356229+0000", 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3944e-05 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356239+0000", 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0039e-05 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356306+0000", 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7041999999999999e-05 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356330+0000", 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3434999999999998e-05 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360227+0000", 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003897064 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360273+0000", 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6817999999999998e-05 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2222 3.3b e76/18 3:de6332b5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_41:head v 76'3, mlcod=76'1)", 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.1414012360000001, 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013173443999999999, 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371619+0000", 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6029999999999999e-06 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375645+0000", 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040257330000000001 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375689+0000", 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3884999999999997e-05 2024-04-17T15:38:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375704+0000", 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5792000000000001e-05 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375811+0000", 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001064 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375845+0000", 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4406999999999998e-05 2024-04-17T15:38:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384724+0000", 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088788570000000004 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384791+0000", 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6767000000000006e-05 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.0960682940000002, 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:38:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:38:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.0014299619999996, 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.9819735229999997, 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:38:57.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:38:57.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:38:57.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:38:57.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:38:57.583 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.7954783120000002, 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.589 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2263 3.24 3:26b54de5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.7218701620000001, 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016875999999999999, 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2263 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791151+0000", 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8679999999999999e-06 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792521+0000", 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013701430000000001 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792555+0000", 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3504000000000003e-05 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792568+0000", 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792660+0000", 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1842999999999995e-05 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792856+0000", 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000196217 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.793040+0000", 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018371699999999999 2024-04-17T15:38:57.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.802663+0000", 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096231790000000008 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807825+0000", 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051621469999999997 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807940+0000", 2024-04-17T15:38:57.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115178 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.808024+0000", 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4091999999999994e-05 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2268 3.3b e76/18 3:dd4f1f8c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_87:head v 76'4, mlcod=76'2)", 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.6643695010000004, 2024-04-17T15:38:57.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0098387490000000008, 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848651+0000", 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.655e-06 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852668+0000", 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004016955 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852684+0000", 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5914e-05 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852695+0000", 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1335000000000001e-05 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852766+0000", 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0754999999999996e-05 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852785+0000", 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8887999999999999e-05 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858432+0000", 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00564702 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858488+0000", 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6227000000000002e-05 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2271 3.24 3:26dc27af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.6352412169999999, 2024-04-17T15:38:57.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017910166000000002, 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2271 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877780+0000", 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5679999999999998e-06 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879011+0000", 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001231078 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879048+0000", 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6618000000000001e-05 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879064+0000", 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6381000000000001e-05 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879158+0000", 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3733999999999994e-05 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879348+0000", 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019001599999999999 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879523+0000", 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017555199999999999 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885749+0000", 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062252150000000001 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895559+0000", 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009810058 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895632+0000", 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3119000000000002e-05 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895688+0000", 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5826999999999999e-05 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2277 3.24 3:25196b41:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.572509106, 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017789381, 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2277 2024-04-17T15:38:57.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940512+0000", 2024-04-17T15:38:57.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6860000000000002e-06 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942245+0000", 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001732634 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942277+0000", 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1782000000000002e-05 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942295+0000", 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8355e-05 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942385+0000", 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9679000000000007e-05 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942568+0000", 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018293300000000001 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942735+0000", 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016778600000000001 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:38:57.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.947972+0000", 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052370810000000002 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958178+0000", 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010205690999999999 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958247+0000", 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8950999999999998e-05 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958299+0000", 2024-04-17T15:38:57.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1802999999999999e-05 2024-04-17T15:38:57.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.610 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:38:57.610 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:38:57.610 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:57.610 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:38:57.612 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:38:57.613 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:57.614+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:57.712 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:57.713+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:38:57.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:38:57.816 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:38:57.817 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:38:57.817 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:57.817+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:57.833 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:38:57.834 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:38:57.850 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:38:57.852 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:38:57.868 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:38:57.869 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:38:57.890 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:38:57.891 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:38:57.911 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:38:57.911 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:38:57.913 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:57.913+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:57.933 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:57.933 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:57.934 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:38:57.934 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:38:57.948 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:38:57.957 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:38:57.958 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:38:58.014 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:58.014+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:58.081 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:58.081 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:58.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:38:58.115 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:58.113+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:58.216 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:58.218+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:58.232 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:58.232 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:58.248 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:38:58.318 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:58.317+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:58.418 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:58.418 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:58.418 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:58.418+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:58.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:38:58.520 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:58.517+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:58.602 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:58.603 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:58.617 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:38:58.620 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:58.621+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:58.721 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:58.721+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:58.744 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:58.744 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:58.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:38:58.822 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:58.821+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:58.885 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:58.886 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:58.900 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:38:58.923 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:58.921+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:59.024 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:59.025+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:59.027 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:59.027 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:59.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:38:59.126 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:59.126+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:59.168 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:59.168 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:59.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:38:59.226 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:38:59.225+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:38:59.327 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:59.326+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:59.352 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:59.353 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:59.369 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:38:59.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:38:59.452 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:38:59.453+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:38:59.528 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:38:59.530+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:38:59.532 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:59.532 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:59.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:38:59.630 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:38:59.629+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:38:59.712 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:59.712 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:59.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:38:59.730 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:59.730+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:38:59.847 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:59.847 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:59.860 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:38:59.861+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:38:59.862 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:38:59.931 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:38:59.934+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:38:59.978 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:38:59.980 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:38:59.980 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:38:59.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:00.073 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:00.073+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:00.133 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:00.133+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:00.139 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:00.151 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:00.151 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:00.151 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:00.151 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:00.156 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:00.156 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:00.167 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:00.174 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:00.174 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:00.192 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:00.192 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:00.226 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:00.235 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:00.233+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:00.246 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:00.246 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:00.267 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:00.268 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:00.288 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:00.289 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:00.304 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:00.304 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:00.304 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:00.304 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:00.304 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:00.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:00.335 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:00.338+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:00.436 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:00.437+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1195 3.b e71/18 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head v 71'1, mlcod=0'0)", 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.641692476999999, 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015153946, 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.493 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851810+0000", 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851811+0000", 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6400000000000002e-07 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854045+0000", 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339170000000002 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854070+0000", 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5125000000000001e-05 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854085+0000", 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.552e-05 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854172+0000", 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6213999999999998e-05 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.854199+0000", 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7472999999999999e-05 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866900+0000", 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012700421999999999 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.866964+0000", 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4710999999999998e-05 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2186 3.3 e76/18 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.995724+0000", 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.4977793080000001, 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016460343999999998, 2024-04-17T15:39:00.497 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.995724+0000", 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.995724+0000", 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.995724+0000", 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4200000000000002e-07 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.002950+0000", 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072265920000000004 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.002982+0000", 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1707e-05 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.002997+0000", 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4854e-05 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.003078+0000", 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1460999999999998e-05 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.003103+0000", 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4844000000000001e-05 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.012112+0000", 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090091719999999993 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.012184+0000", 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1371999999999994e-05 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2187 3.20 e76/18 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.004329+0000", 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.4891742489999995, 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01414376, 2024-04-17T15:39:00.501 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.004329+0000", 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.004329+0000", 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.004329+0000", 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3200000000000001e-07 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010745+0000", 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006415624 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010771+0000", 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6248e-05 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010786+0000", 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4901e-05 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010878+0000", 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1972999999999995e-05 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.010915+0000", 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7645999999999998e-05 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.018412+0000", 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074971719999999999 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.018472+0000", 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9864000000000001e-05 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2197 3.39 e76/18 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.120229+0000", 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.3732741930000003, 2024-04-17T15:39:00.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015148755, 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.120229+0000", 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.120229+0000", 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.120229+0000", 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.98e-07 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126678+0000", 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064495560000000004 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126704+0000", 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.525e-05 2024-04-17T15:39:00.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126713+0000", 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7839999999999998e-06 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126783+0000", 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9319000000000005e-05 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.126800+0000", 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7129000000000002e-05 2024-04-17T15:39:00.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.135298+0000", 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084984290000000001 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.135377+0000", 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9090000000000003e-05 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2198 3.3a e76/18 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:00.509 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.3707532120000003, 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019644212000000001, 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9499999999999998e-07 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129524+0000", 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067742130000000003 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129550+0000", 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5395999999999999e-05 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129565+0000", 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5064e-05 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129665+0000", 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100381 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129688+0000", 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3479999999999999e-05 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142322+0000", 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012633287999999999 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142394+0000", 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2094999999999993e-05 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2202 3.30 e76/18 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.3243903719999999, 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017043618999999999, 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169115+0000", 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0990000000000001e-06 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174068+0000", 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049531810000000001 2024-04-17T15:39:00.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174103+0000", 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4885000000000002e-05 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174119+0000", 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6263999999999999e-05 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174216+0000", 2024-04-17T15:39:00.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7578000000000007e-05 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174246+0000", 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9810000000000001e-05 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186092+0000", 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011845496 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186156+0000", 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4306000000000004e-05 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.517 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2205 3.17 3:ea2615d0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.2992494449999992, 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017729135, 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2205 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194257+0000", 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1470000000000001e-06 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196293+0000", 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020363099999999999 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196318+0000", 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5194999999999998e-05 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196331+0000", 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2977e-05 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196416+0000", 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5049000000000005e-05 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196543+0000", 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012732100000000001 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196639+0000", 2024-04-17T15:39:00.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5302000000000003e-05 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.202228+0000", 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055891480000000004 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211895+0000", 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096668139999999993 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211941+0000", 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6783999999999998e-05 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211983+0000", 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1087999999999997e-05 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2208 3.1b 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.2693013719999993, 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021369764999999999, 2024-04-17T15:39:00.523 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2208 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:00.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224204+0000", 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6259999999999999e-06 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226060+0000", 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001855766 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226089+0000", 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8806000000000002e-05 2024-04-17T15:39:00.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226103+0000", 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.483e-05 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226194+0000", 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0162999999999997e-05 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226364+0000", 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017058399999999999 2024-04-17T15:39:00.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226515+0000", 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000150493 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236552+0000", 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010037107999999999 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245450+0000", 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088980710000000005 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245517+0000", 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7325999999999999e-05 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245571+0000", 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3992000000000001e-05 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2230 3.3a e76/18 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:00.528 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.0382119339999996, 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018369284999999999, 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455293+0000", 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.841e-06 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460234+0000", 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049411330000000003 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460257+0000", 2024-04-17T15:39:00.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3159999999999998e-05 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460268+0000", 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1056000000000001e-05 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460336+0000", 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7595000000000006e-05 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460368+0000", 2024-04-17T15:39:00.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2205000000000001e-05 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473473+0000", 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013105314 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473660+0000", 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698099999999999 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.532 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2232 3.1b 3:da25f619:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.0239464900000002, 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017288061, 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2232 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469559+0000", 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.649e-06 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.471972+0000", 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002412862 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472008+0000", 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5945999999999998e-05 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472023+0000", 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5122e-05 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472113+0000", 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0183e-05 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472254+0000", 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014096900000000001 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472363+0000", 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010873499999999999 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.482529+0000", 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010166019 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486718+0000", 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041890080000000001 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486790+0000", 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1953999999999996e-05 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486844+0000", 2024-04-17T15:39:00.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4614000000000003e-05 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2234 3.17 3:eb70e137:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.0032940119999996, 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017531280999999999, 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.538 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2234 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490212+0000", 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3749999999999999e-06 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492617+0000", 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024048540000000001 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492639+0000", 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1472e-05 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492648+0000", 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9870000000000005e-06 2024-04-17T15:39:00.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492729+0000", 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1034999999999999e-05 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492870+0000", 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014136800000000001 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.493035+0000", 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016558 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.497649+0000", 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046137119999999998 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507638+0000", 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099891249999999997 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507687+0000", 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8869000000000003e-05 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507740+0000", 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2904e-05 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2240 3.1f 3:f8ad20ec:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.9400017510000005, 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018806135000000002, 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.543 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2240 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553505+0000", 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.715e-06 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556184+0000", 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026795149999999999 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556217+0000", 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2323000000000002e-05 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556231+0000", 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4662e-05 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556329+0000", 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7598999999999998e-05 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556493+0000", 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016452900000000001 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556649+0000", 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000155291 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.564664+0000", 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080152699999999997 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572214+0000", 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00754991 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572260+0000", 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6526000000000001e-05 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572307+0000", 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6795000000000002e-05 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.548 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2241 3.12 3:4bb118b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.9280197990000003, 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018446299999999999, 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2241 2024-04-17T15:39:00.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565485+0000", 2024-04-17T15:39:00.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566940+0000", 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001454718 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566971+0000", 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0550999999999999e-05 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566996+0000", 2024-04-17T15:39:00.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5537999999999998e-05 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567065+0000", 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9153999999999996e-05 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567197+0000", 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013143200000000001 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567298+0000", 2024-04-17T15:39:00.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101488 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.573358+0000", 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060601309999999999 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583838+0000", 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010479197000000001 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583890+0000", 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2117999999999998e-05 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583929+0000", 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9530000000000003e-05 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2245 3.17 3:e9b13e02:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.8902814000000001, 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018296036000000002, 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.554 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2245 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603225+0000", 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1379999999999999e-06 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604941+0000", 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001716595 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604968+0000", 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7137000000000001e-05 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604980+0000", 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1704e-05 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605056+0000", 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6265000000000002e-05 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605181+0000", 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012499399999999999 2024-04-17T15:39:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605283+0000", 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102027 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.613207+0000", 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079242050000000001 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621395+0000", 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081871159999999995 2024-04-17T15:39:00.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621463+0000", 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8354000000000003e-05 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621517+0000", 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4500999999999999e-05 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.559 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2249 3.20 e76/18 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.8403643800000005, 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021006212999999999, 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653140+0000", 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-06 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658320+0000", 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051792610000000001 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658379+0000", 2024-04-17T15:39:00.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8829999999999997e-05 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658398+0000", 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9193000000000001e-05 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658487+0000", 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9685999999999995e-05 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658514+0000", 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6818999999999999e-05 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674073+0000", 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015559078 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674145+0000", 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1360999999999997e-05 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2258 3.17 3:e8df4510:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.7530649599999997, 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017321514, 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2258 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740440+0000", 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4609999999999998e-06 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742267+0000", 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018265239999999999 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742291+0000", 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3787000000000001e-05 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742301+0000", 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0253e-05 2024-04-17T15:39:00.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742388+0000", 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7157000000000006e-05 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742592+0000", 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020355699999999999 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742772+0000", 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018084399999999999 2024-04-17T15:39:00.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.748426+0000", 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056539870000000001 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757641+0000", 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092143060000000002 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757693+0000", 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1916999999999998e-05 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757759+0000", 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6721e-05 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2260 3.23 3:c7e72049:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.762236+0000", 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.7312669930000002, 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015847752, 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.569 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2260 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762236+0000", 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762236+0000", 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762239+0000", 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9550000000000001e-06 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.763985+0000", 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017460360000000001 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764013+0000", 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8561e-05 2024-04-17T15:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764029+0000", 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5196e-05 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764102+0000", 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2980999999999998e-05 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764291+0000", 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018989699999999999 2024-04-17T15:39:00.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764414+0000", 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012263199999999999 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776332+0000", 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011918256 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777966+0000", 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001633607 2024-04-17T15:39:00.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.778030+0000", 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3812999999999994e-05 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.778084+0000", 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3817999999999999e-05 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.574 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2267 3.6 3:601e7e13:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.834685+0000", 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.6588182419999997, 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013562207999999999, 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2267 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.834685+0000", 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.834685+0000", 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.834688+0000", 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0979999999999998e-06 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836460+0000", 2024-04-17T15:39:00.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017721270000000001 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836490+0000", 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9779999999999999e-05 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836500+0000", 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0696999999999999e-05 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836582+0000", 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1744999999999997e-05 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836751+0000", 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016934900000000001 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.836917+0000", 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016564600000000001 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.844145+0000", 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072279299999999996 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848119+0000", 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039738999999999998 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848187+0000", 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7946000000000003e-05 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848247+0000", 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.999e-05 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.579 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2272 3.1f 3:fba75e94:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.888365+0000", 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.6051373949999999, 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016997089999999999, 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2272 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.580 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.888365+0000", 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.888365+0000", 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.888368+0000", 2024-04-17T15:39:00.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8169999999999999e-06 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890244+0000", 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018755989999999999 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890284+0000", 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0222999999999998e-05 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890299+0000", 2024-04-17T15:39:00.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4600000000000001e-05 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890382+0000", 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3430999999999995e-05 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890548+0000", 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000165396 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.890662+0000", 2024-04-17T15:39:00.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000114203 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.896562+0000", 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059003500000000004 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.905235+0000", 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0086729029999999992 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.905307+0000", 2024-04-17T15:39:00.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2009999999999997e-05 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.905363+0000", 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5557999999999999e-05 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2278 3.1b 3:d8a1e895:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.542419475, 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017298622, 2024-04-17T15:39:00.585 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2278 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951086+0000", 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459999999999998e-06 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952905+0000", 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001818442 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952936+0000", 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1260000000000002e-05 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952950+0000", 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3658e-05 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953031+0000", 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1593000000000003e-05 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953143+0000", 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011195400000000001 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953266+0000", 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012241500000000001 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.961279+0000", 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080132980000000003 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:00.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968256+0000", 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006977507 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968326+0000", 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9251999999999994e-05 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968382+0000", 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6297e-05 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:00.590 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:00.591 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:00.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:00.592 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:00.593+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:00.692 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:00.694+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:00.770 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:00.771 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:00.771 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:00.771 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:00.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:00.794 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:00.794+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:00.895 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:00.894+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:00.906 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:00.906 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:00.906 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:00.906 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:00.906 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:00.921 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:00.996 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:00.997+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1192 3.1a e71/18 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head v 71'1, mlcod=0'0)", 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.21744674, 2024-04-17T15:39:01.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012590545, 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832340+0000", 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.91e-07 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837330+0000", 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049904620000000002 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837357+0000", 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6974999999999998e-05 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837370+0000", 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837437+0000", 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6382000000000002e-05 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837455+0000", 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8284e-05 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844890+0000", 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074353930000000002 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844930+0000", 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9458000000000001e-05 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1592 3.3e 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.242896317, 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0089542040000000003, 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1592 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:39:01.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806892+0000", 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3989999999999998e-06 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807868+0000", 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00097551400000000003 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807890+0000", 2024-04-17T15:39:01.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2503000000000001e-05 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807900+0000", 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7550000000000006e-06 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807964+0000", 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3801999999999997e-05 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808072+0000", 2024-04-17T15:39:01.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107871 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808170+0000", 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8197999999999997e-05 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815570+0000", 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074005779999999997 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815774+0000", 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020377899999999999 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815812+0000", 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8098e-05 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815844+0000", 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1707e-05 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1902 4.27 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.176601804000001, 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055036649999999996, 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.060 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1902 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873185+0000", 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873191+0000", 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1919999999999996e-06 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873207+0000", 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5939000000000001e-05 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873221+0000", 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4566000000000001e-05 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873297+0000", 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5683e-05 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873367+0000", 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0278999999999996e-05 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873460+0000", 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3231000000000002e-05 2024-04-17T15:39:01.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.874219+0000", 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075834800000000005 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878616+0000", 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043977139999999996 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878647+0000", 2024-04-17T15:39:01.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878688+0000", 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1232000000000001e-05 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2185 3.19 3:9a84a28a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.0723585660000001, 2024-04-17T15:39:01.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014021347, 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2185 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977430+0000", 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9399999999999998e-06 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979749+0000", 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023181920000000002 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979782+0000", 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3657e-05 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979794+0000", 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1815e-05 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979891+0000", 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6688999999999995e-05 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.980098+0000", 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206763 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.980290+0000", 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019285 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.990912+0000", 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010621558 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991294+0000", 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038154900000000002 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991373+0000", 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9305e-05 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991449+0000", 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6029e-05 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.071 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2192 3.0 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.9932251890000003, 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016712945, 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2192 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056609+0000", 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8192000000000002e-05 2024-04-17T15:39:01.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058326+0000", 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017167980000000001 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058354+0000", 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8469000000000001e-05 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058368+0000", 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3567000000000001e-05 2024-04-17T15:39:01.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058448+0000", 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9943000000000004e-05 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058629+0000", 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018072100000000001 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058790+0000", 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016184000000000001 2024-04-17T15:39:01.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.069821+0000", 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011030629 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073138+0000", 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033164679999999999 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073206+0000", 2024-04-17T15:39:01.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8324999999999994e-05 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073274+0000", 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7992999999999998e-05 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.9750224519999993, 2024-04-17T15:39:01.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:01.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:39:01.081 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.9716559500000006, 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:01.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:39:01.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2228 3.32 e76/18 3:4e7df19b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_47:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:01.087 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.6201089409999998, 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010461764, 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431443+0000", 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017654840000000001 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431467+0000", 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3864999999999999e-05 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431483+0000", 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6413999999999999e-05 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431600+0000", 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117169 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431627+0000", 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6684000000000001e-05 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440072+0000", 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084452910000000006 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440139+0000", 2024-04-17T15:39:01.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6656999999999996e-05 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2229 3.19 3:997f76dc:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.6111602099999995, 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012913452000000001, 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.092 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2229 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:39:01.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438628+0000", 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1720000000000001e-06 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440848+0000", 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022202670000000002 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440869+0000", 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0557999999999999e-05 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440882+0000", 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2781e-05 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440948+0000", 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6066000000000001e-05 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.441073+0000", 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012537400000000001 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.441189+0000", 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011582999999999999 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.450838+0000", 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096493240000000008 2024-04-17T15:39:01.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451446+0000", 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060818500000000002 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451486+0000", 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9885000000000002e-05 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451539+0000", 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3010000000000002e-05 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2231 3.3e 3:7e08bf39:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.5915409740000008, 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016293021000000001, 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.098 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2231 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458262+0000", 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6534000000000001e-05 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460097+0000", 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001835298 2024-04-17T15:39:01.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460124+0000", 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7359e-05 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460140+0000", 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5241e-05 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460208+0000", 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8579999999999997e-05 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460333+0000", 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012509500000000001 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460467+0000", 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013373599999999999 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472830+0000", 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012363486 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474285+0000", 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014549669999999999 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474416+0000", 2024-04-17T15:39:01.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013019099999999999 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474538+0000", 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012253399999999999 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2233 3.25 3:a45e43c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.104 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.5703492620000006, 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012859545999999999, 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2233 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479440+0000", 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4240000000000002e-06 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481115+0000", 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001674593 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481140+0000", 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4757e-05 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481150+0000", 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.061e-05 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481230+0000", 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0129000000000005e-05 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481395+0000", 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000164418 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481541+0000", 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014615400000000001 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.489435+0000", 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078943510000000008 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492174+0000", 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027384570000000001 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492230+0000", 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5816000000000002e-05 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492296+0000", 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6836999999999997e-05 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2235 3.19 3:9b2d1060:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.5487070589999998, 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012884441, 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.110 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2235 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:39:01.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501082+0000", 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8710000000000001e-06 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503033+0000", 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001951068 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503060+0000", 2024-04-17T15:39:01.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6670999999999999e-05 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503075+0000", 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4916000000000001e-05 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503170+0000", 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5733e-05 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503327+0000", 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001562 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503493+0000", 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000166088 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513393+0000", 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099001009999999997 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513830+0000", 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043754999999999998 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513900+0000", 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9951999999999997e-05 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513964+0000", 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3291000000000001e-05 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2239 3.1a e76/18 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:39:01.115 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.501475804, 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012593248, 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548313+0000", 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4710000000000001e-06 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553543+0000", 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052302770000000002 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553577+0000", 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3538000000000003e-05 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553591+0000", 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4765e-05 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553678+0000", 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6640999999999999e-05 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553708+0000", 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0114e-05 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.560838+0000", 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071303670000000003 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.560904+0000", 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5074999999999996e-05 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2244 3.19 3:9a9a742a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.4565786159999998, 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013573603, 2024-04-17T15:39:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2244 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593211+0000", 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.207e-06 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594773+0000", 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015622489999999999 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594798+0000", 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5111999999999999e-05 2024-04-17T15:39:01.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594808+0000", 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0319999999999999e-05 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594884+0000", 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5105999999999995e-05 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.595066+0000", 2024-04-17T15:39:01.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182065 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.595223+0000", 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015709 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.599821+0000", 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045988009999999996 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606657+0000", 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006835374 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606726+0000", 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9496e-05 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606781+0000", 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4783e-05 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.3944561919999998, 2024-04-17T15:39:01.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:39:01.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.129 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2251 3.1a e76/18 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.3777245100000002, 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011149496, 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672063+0000", 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.778e-06 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676433+0000", 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043691900000000002 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676451+0000", 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187999999999999e-05 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676462+0000", 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1286e-05 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676534+0000", 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1865000000000004e-05 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676553+0000", 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8760999999999999e-05 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.683146+0000", 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0065932439999999998 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.683211+0000", 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5184000000000005e-05 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.133 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2252 3.25 3:a447a9ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.3715267190000002, 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014955945, 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2252 2024-04-17T15:39:01.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678262+0000", 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0639999999999998e-06 2024-04-17T15:39:01.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680355+0000", 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020922559999999998 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680381+0000", 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6437000000000001e-05 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680395+0000", 2024-04-17T15:39:01.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3653e-05 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680498+0000", 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103486 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680682+0000", 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018336700000000001 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680824+0000", 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014226399999999999 2024-04-17T15:39:01.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692441+0000", 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011617331 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693055+0000", 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000614092 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693133+0000", 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7996000000000003e-05 2024-04-17T15:39:01.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693215+0000", 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1998999999999999e-05 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2261 3.37 e76/45 3:ef87aca3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_80:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.2722763350000008, 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010338282000000001, 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.139 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777511+0000", 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782642+0000", 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051310230000000002 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782676+0000", 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4786000000000002e-05 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782694+0000", 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7776000000000001e-05 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782790+0000", 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5699999999999995e-05 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782826+0000", 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5836e-05 2024-04-17T15:39:01.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.787780+0000", 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049541580000000002 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.787848+0000", 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8152999999999996e-05 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.143 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2265 3.25 3:a7c7e3b2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.2366388080000004, 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012222443, 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2265 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:39:01.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813150+0000", 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814795+0000", 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001644653 2024-04-17T15:39:01.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814822+0000", 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7008999999999998e-05 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814833+0000", 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0899e-05 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814966+0000", 2024-04-17T15:39:01.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133151 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.815140+0000", 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403199999999999 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.815291+0000", 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015072100000000001 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825222+0000", 2024-04-17T15:39:01.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099317290000000003 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825268+0000", 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5850999999999999e-05 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825306+0000", 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8241000000000002e-05 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825370+0000", 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3291000000000001e-05 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.148 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2267 3.6 e76/18 3:601e7e13:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_86:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.2127524160000007, 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010876569000000001, 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837036+0000", 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2110000000000001e-06 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838535+0000", 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499043 2024-04-17T15:39:01.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838563+0000", 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.826e-05 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838578+0000", 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4776e-05 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838661+0000", 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2915000000000002e-05 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838706+0000", 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4882999999999997e-05 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.847835+0000", 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091295309999999998 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.847910+0000", 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4950000000000006e-05 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.152 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.153 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:01.154 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:01.154 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:01.153+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:01.255 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:01.253+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:01.333 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:01.333 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:01.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:01.392 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:01.393+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:01.405 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-17T15:39:01.405 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-17T15:39:01.456 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:01.457+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:01.521 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:01.522 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:01.536 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:01.580 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:01.581+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:01.658 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:01.658+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:01.707 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:01.707 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:01.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:01.707 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1594 3.2f 3:f6989893:::5305729a-6754-489e-9706-ab50dfde728d.4412.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.878726736000001, 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015262937000000001, 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1594 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827588+0000", 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6780000000000001e-06 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829147+0000", 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015589810000000001 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829171+0000", 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4267999999999999e-05 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829180+0000", 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2240000000000001e-06 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829244+0000", 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3565999999999994e-05 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829368+0000", 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123977 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829722+0000", 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035428599999999999 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.838390+0000", 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0086673889999999993 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842776+0000", 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043862700000000003 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842818+0000", 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2061999999999998e-05 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842849+0000", 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1235999999999997e-05 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2190 3.9 e76/18 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.6671547659999995, 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012233502, 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3299999999999998e-07 2024-04-17T15:39:01.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043625+0000", 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004467047 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043654+0000", 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8178e-05 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043667+0000", 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3388e-05 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043737+0000", 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9486999999999994e-05 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043755+0000", 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8209000000000001e-05 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051330+0000", 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075749349999999997 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051392+0000", 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1925000000000001e-05 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2191 3.3b e76/18 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.6536813929999994, 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017593028, 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052633+0000", 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.218e-06 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057496+0000", 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048628489999999998 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057528+0000", 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2636999999999999e-05 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057546+0000", 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7368999999999999e-05 2024-04-17T15:39:01.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057647+0000", 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101662 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057685+0000", 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7333000000000003e-05 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070062+0000", 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0123774 2024-04-17T15:39:01.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070225+0000", 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016255999999999999 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2192 3.0 e76/18 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.6474159759999996, 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014023864, 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.721 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058899+0000", 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061931+0000", 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003032145 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061958+0000", 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6344000000000001e-05 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061971+0000", 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3739e-05 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062054+0000", 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2442999999999997e-05 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062080+0000", 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5970999999999999e-05 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072852+0000", 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010772415 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072921+0000", 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.868e-05 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2194 3.0 e76/18 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:01.725 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.6256502099999999, 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017385022, 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:01.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080665+0000", 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082876+0000", 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022112590000000001 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082917+0000", 2024-04-17T15:39:01.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0142999999999998e-05 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082936+0000", 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9760000000000001e-05 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083070+0000", 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013328299999999999 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083100+0000", 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0450000000000002e-05 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.097937+0000", 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014836716 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098048+0000", 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110968 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.729 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2201 3.3d e76/18 3:bf2548c9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_20:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.5523883739999995, 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00815747, 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153925+0000", 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155682+0000", 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017575239999999999 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155706+0000", 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3890999999999999e-05 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155719+0000", 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.313e-05 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155796+0000", 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6862999999999999e-05 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155821+0000", 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162033+0000", 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006211823 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162082+0000", 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8742999999999997e-05 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.733 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2210 3.9 e76/18 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.4565013909999998, 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015862533000000002, 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249813+0000", 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.051e-06 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253690+0000", 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038778990000000002 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253719+0000", 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8643e-05 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253731+0000", 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1667e-05 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253802+0000", 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1154000000000003e-05 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253830+0000", 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8489000000000001e-05 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265608+0000", 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011777881 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265674+0000", 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5748999999999997e-05 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.4198219699999992, 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:39:01.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2216 3.3b e76/18 3:dce33251:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_35:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3935122349999993, 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014445159000000001, 2024-04-17T15:39:01.743 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:01.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7599999999999996e-07 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316913+0000", 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041116140000000004 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316938+0000", 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5439000000000002e-05 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316953+0000", 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4352000000000001e-05 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317067+0000", 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011370999999999999 2024-04-17T15:39:01.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317096+0000", 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9762000000000001e-05 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327173+0000", 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010077114 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327246+0000", 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2391999999999994e-05 2024-04-17T15:39:01.747 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2217 3.16 3:685b1a75:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3899940019999999, 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015566544, 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2217 2024-04-17T15:39:01.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316321+0000", 2024-04-17T15:39:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.888e-06 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317806+0000", 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001485295 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317826+0000", 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9772e-05 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317839+0000", 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.275e-05 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317905+0000", 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6295000000000001e-05 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318050+0000", 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014553499999999999 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:01.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318184+0000", 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013408100000000001 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327767+0000", 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095827919999999997 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331806+0000", 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040388439999999998 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331852+0000", 2024-04-17T15:39:01.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5688e-05 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331885+0000", 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3603999999999999e-05 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2220 3.9 e76/18 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3540595880000001, 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080201279999999996, 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.753 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352255+0000", 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1519999999999999e-06 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356205+0000", 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039496339999999996 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356229+0000", 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3944e-05 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356239+0000", 2024-04-17T15:39:01.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0039e-05 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356306+0000", 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7041999999999999e-05 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356330+0000", 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3434999999999998e-05 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360227+0000", 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003897064 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360273+0000", 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6817999999999998e-05 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2222 3.3b e76/18 3:de6332b5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_41:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3346955260000009, 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013173443999999999, 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.757 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371619+0000", 2024-04-17T15:39:01.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6029999999999999e-06 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375645+0000", 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040257330000000001 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375689+0000", 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3884999999999997e-05 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375704+0000", 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5792000000000001e-05 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375811+0000", 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001064 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375845+0000", 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4406999999999998e-05 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384724+0000", 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088788570000000004 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384791+0000", 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6767000000000006e-05 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.2893625839999991, 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:39:01.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:39:01.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.1947242520000003, 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.768 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:01.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:01.773 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.1752678129999996, 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:01.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:39:01.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:39:01.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:39:01.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:39:01.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.9887726019999992, 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.779 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:39:01.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2263 3.24 3:26b54de5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.9151644519999991, 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016875999999999999, 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.784 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2263 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:01.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791151+0000", 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8679999999999999e-06 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792521+0000", 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013701430000000001 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792555+0000", 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3504000000000003e-05 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792568+0000", 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792660+0000", 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1842999999999995e-05 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792856+0000", 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000196217 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.793040+0000", 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018371699999999999 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.802663+0000", 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096231790000000008 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807825+0000", 2024-04-17T15:39:01.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051621469999999997 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807940+0000", 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115178 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.808024+0000", 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4091999999999994e-05 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.789 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2268 3.3b e76/18 3:dd4f1f8c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_87:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.8576637910000002, 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0098387490000000008, 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848651+0000", 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.655e-06 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852668+0000", 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004016955 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852684+0000", 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5914e-05 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852695+0000", 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1335000000000001e-05 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852766+0000", 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0754999999999996e-05 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852785+0000", 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8887999999999999e-05 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858432+0000", 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00564702 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858488+0000", 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6227000000000002e-05 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.793 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2271 3.24 3:26dc27af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.8285355069999998, 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017910166000000002, 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.794 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2271 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877780+0000", 2024-04-17T15:39:01.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5679999999999998e-06 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879011+0000", 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001231078 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879048+0000", 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6618000000000001e-05 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879064+0000", 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6381000000000001e-05 2024-04-17T15:39:01.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879158+0000", 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3733999999999994e-05 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879348+0000", 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019001599999999999 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879523+0000", 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017555199999999999 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885749+0000", 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062252150000000001 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895559+0000", 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009810058 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895632+0000", 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3119000000000002e-05 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895688+0000", 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5826999999999999e-05 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2277 3.24 3:25196b41:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.7658033960000008, 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017789381, 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2277 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940512+0000", 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6860000000000002e-06 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942245+0000", 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001732634 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942277+0000", 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1782000000000002e-05 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:01.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942295+0000", 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8355e-05 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942385+0000", 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9679000000000007e-05 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942568+0000", 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018293300000000001 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942735+0000", 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016778600000000001 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.947972+0000", 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052370810000000002 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958178+0000", 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010205690999999999 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:01.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958247+0000", 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8950999999999998e-05 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958299+0000", 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1802999999999999e-05 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:01.804 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:01.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:01.806 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:01.806+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:01.819 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:39:01.906 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:01.906+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:01.940 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:01.940 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:01.940 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:01.940 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:01.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:02.008 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:02.010+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:02.075 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:02.075 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:02.091 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:02.140 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:02.141+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:02.209 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:02.209+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:02.214 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:02.214 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:02.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1193 3.2 3:413bc53d:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.388221139999999, 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014466954000000001, 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.215 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1193 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826589+0000", 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9910000000000001e-06 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827645+0000", 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001055627 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827669+0000", 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4635e-05 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827679+0000", 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9539999999999999e-06 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827770+0000", 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0934999999999996e-05 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827938+0000", 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016818200000000001 2024-04-17T15:39:02.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.828113+0000", 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017488700000000001 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832493+0000", 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004380264 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.840973+0000", 2024-04-17T15:39:02.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084791999999999992 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841017+0000", 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3967000000000001e-05 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841054+0000", 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7311999999999998e-05 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.220 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1195 3.b 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.365275840999999, 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017715149999999999, 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1195 2024-04-17T15:39:02.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849534+0000", 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850786+0000", 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001251172 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850811+0000", 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5386000000000001e-05 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850821+0000", 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0285999999999999e-05 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850905+0000", 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3934e-05 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851097+0000", 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019139 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851598+0000", 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00050139599999999998 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.864860+0000", 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013262451999999999 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867151+0000", 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022904520000000001 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867197+0000", 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6313999999999997e-05 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867247+0000", 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0312000000000002e-05 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2182 3.22 e75/18 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head v 75'1, mlcod=0'0)", 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.267902524, 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012030150999999999, 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946908+0000", 2024-04-17T15:39:02.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951652+0000", 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047438189999999998 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951684+0000", 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2317000000000002e-05 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951698+0000", 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.433e-05 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951794+0000", 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5482000000000005e-05 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951811+0000", 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6799999999999998e-05 2024-04-17T15:39:02.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958860+0000", 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070494169999999997 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958936+0000", 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5822999999999996e-05 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.08565143, 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:39:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:39:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.073875510000001, 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.238 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:39:02.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:39:02.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2203 3.33 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.041950857, 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018462655000000001, 2024-04-17T15:39:02.244 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2203 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172860+0000", 2024-04-17T15:39:02.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1219999999999999e-06 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175004+0000", 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021435209999999998 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175027+0000", 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2934000000000001e-05 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175040+0000", 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.332e-05 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175111+0000", 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1149000000000006e-05 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175220+0000", 2024-04-17T15:39:02.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010859 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175312+0000", 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2436999999999996e-05 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.189629+0000", 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014316194000000001 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191198+0000", 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001569778 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191265+0000", 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6231999999999999e-05 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191320+0000", 2024-04-17T15:39:02.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5377999999999997e-05 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2207 3.15 e76/18 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.9954240470000002, 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016924775999999999, 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.251 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219386+0000", 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8199999999999999e-06 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224735+0000", 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053494229999999999 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224778+0000", 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2948000000000003e-05 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224793+0000", 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224881+0000", 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8190999999999996e-05 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224914+0000", 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3095000000000001e-05 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236248+0000", 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01133339 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236309+0000", 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1333000000000004e-05 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2211 3.29 3:972307fc:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.9600931050000003, 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017874909000000001, 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2211 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.256 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254718+0000", 2024-04-17T15:39:02.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5620000000000002e-06 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256701+0000", 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019833300000000002 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256725+0000", 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4522e-05 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256739+0000", 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3393999999999999e-05 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256822+0000", 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3143e-05 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256984+0000", 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016208499999999999 2024-04-17T15:39:02.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.257103+0000", 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011872899999999999 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265295+0000", 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081918749999999995 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272468+0000", 2024-04-17T15:39:02.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071732649999999998 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272534+0000", 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5871999999999995e-05 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272590+0000", 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6131999999999997e-05 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.6321318369999993, 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.262 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:39:02.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:39:02.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:39:02.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.267 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2250 3.19 e76/18 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head v 76'5, mlcod=76'3)", 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.557146307, 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016559072000000001, 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657665+0000", 2024-04-17T15:39:02.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8119999999999999e-06 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659745+0000", 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020804650000000001 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659779+0000", 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659795+0000", 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6888000000000002e-05 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659878+0000", 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2454999999999996e-05 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659908+0000", 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0204000000000001e-05 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674164+0000", 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014255465 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674221+0000", 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7346999999999998e-05 2024-04-17T15:39:02.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2253 3.7 3:e24db805:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.5220164060000005, 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018614170999999999, 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.273 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2253 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:02.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692794+0000", 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4820000000000001e-06 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694460+0000", 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016656660000000001 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694492+0000", 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2036999999999998e-05 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694505+0000", 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3556e-05 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694627+0000", 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000121173 2024-04-17T15:39:02.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694819+0000", 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019235199999999999 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.695012+0000", 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019336000000000001 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.699362+0000", 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043500880000000002 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711319+0000", 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011956318000000001 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711368+0000", 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9407000000000003e-05 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711406+0000", 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7731999999999997e-05 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.5054878729999999, 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:39:02.279 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:39:02.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:39:02.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2259 3.22 e76/18 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head v 76'3, mlcod=75'1)", 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.4565625069999992, 2024-04-17T15:39:02.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017962353, 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758247+0000", 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.221e-06 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762255+0000", 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040082829999999996 2024-04-17T15:39:02.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762282+0000", 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.652e-05 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762293+0000", 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1392e-05 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762365+0000", 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1687000000000007e-05 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762384+0000", 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9749999999999999e-05 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776137+0000", 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013752795999999999 2024-04-17T15:39:02.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776208+0000", 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0704000000000006e-05 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2260 3.23 e76/18 3:c7e72049:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_79:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:02.290 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.450150872, 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013120143000000001, 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764658+0000", 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.92e-07 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767777+0000", 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003118689 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767801+0000", 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4383e-05 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767815+0000", 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3916e-05 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767901+0000", 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5908000000000005e-05 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767929+0000", 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8206000000000001e-05 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777717+0000", 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097883039999999994 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777777+0000", 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0044999999999999e-05 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2264 3.b 3:d1e91691:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.4134412330000004, 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013508938, 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.295 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2264 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801370+0000", 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1949999999999999e-06 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803362+0000", 2024-04-17T15:39:02.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001991643 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803394+0000", 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1885999999999999e-05 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803410+0000", 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6487999999999999e-05 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803505+0000", 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4492000000000003e-05 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803653+0000", 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000148317 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803772+0000", 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011948299999999999 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.809037+0000", 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.005264342 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814771+0000", 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057347159999999999 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814826+0000", 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4474000000000001e-05 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814876+0000", 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9901999999999998e-05 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2270 3.1e 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3483839379999996, 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019292126999999999, 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.301 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2270 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866427+0000", 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0010000000000002e-06 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868222+0000", 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001794943 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868252+0000", 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9598999999999999e-05 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868267+0000", 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4803e-05 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868363+0000", 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6558000000000006e-05 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868548+0000", 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000185248 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868719+0000", 2024-04-17T15:39:02.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017112099999999999 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.875258+0000", 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0065380389999999998 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885590+0000", 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010332884000000001 2024-04-17T15:39:02.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885659+0000", 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885716+0000", 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7311000000000001e-05 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.307 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2273 3.7 3:e2b4eed0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3151947400000008, 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019105502, 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2273 2024-04-17T15:39:02.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899616+0000", 2024-04-17T15:39:02.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901220+0000", 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016033180000000001 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901253+0000", 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2848000000000001e-05 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901268+0000", 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673999999999999e-05 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901424+0000", 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015542999999999999 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901580+0000", 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000156324 2024-04-17T15:39:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901726+0000", 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000145971 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.906593+0000", 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004866586 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918592+0000", 2024-04-17T15:39:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01199968 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918664+0000", 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1495000000000006e-05 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918719+0000", 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5071999999999997e-05 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2274 3.27 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3051759220000001, 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020003305999999998, 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.314 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2274 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909635+0000", 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3760000000000002e-06 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911097+0000", 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001462765 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911130+0000", 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2876000000000002e-05 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911148+0000", 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7337e-05 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911236+0000", 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8010000000000006e-05 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911396+0000", 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160808 2024-04-17T15:39:02.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911543+0000", 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146584 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.920092+0000", 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085487510000000003 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929554+0000", 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094618759999999993 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929594+0000", 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0136999999999999e-05 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929636+0000", 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1786000000000003e-05 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.319 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2276 3.2 3:413eb100:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.2835160059999993, 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020329113999999999, 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.320 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2276 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931295+0000", 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6189999999999998e-06 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936287+0000", 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049920559999999999 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936310+0000", 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3538000000000001e-05 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936322+0000", 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1739000000000001e-05 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936395+0000", 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2521000000000006e-05 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936512+0000", 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117872 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936622+0000", 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010926599999999999 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942455+0000", 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058337099999999998 2024-04-17T15:39:02.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951496+0000", 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090407899999999999 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951571+0000", 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4361000000000002e-05 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951621+0000", 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0642000000000001e-05 2024-04-17T15:39:02.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2282 3.38 3:1e5bbe9d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.2210755130000006, 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017690014, 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:02.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2282 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993736+0000", 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3289999999999998e-06 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995029+0000", 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001292898 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995064+0000", 2024-04-17T15:39:02.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5508e-05 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995080+0000", 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673000000000001e-05 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995183+0000", 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010299200000000001 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995325+0000", 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014212799999999999 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995421+0000", 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5630000000000004e-05 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.001610+0000", 2024-04-17T15:39:02.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0061888680000000001 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011284+0000", 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096739470000000004 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011359+0000", 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5210999999999995e-05 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:02.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011423+0000", 2024-04-17T15:39:02.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3830000000000004e-05 2024-04-17T15:39:02.332 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.332 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.332 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.332 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:02.332 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:02.332 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:02.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:02.334 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:02.335 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:39:02.336 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:02.334+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:02.434 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:02.434+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:02.474 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:02.475 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:02.475 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:02.475 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:02.489 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:02.523 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:02.524 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:02.540 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:02.540 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:02.557 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:02.558 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:02.574 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:02.579 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:02.582+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:02.592 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:02.610 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:02.630 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:02.631 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:02.636 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:02.637+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:02.651 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:02.660 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:02.660 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:02.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:02.738 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:02.737+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:02.839 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:02.837+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:02.852 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:02.852 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:02.866 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:02.940 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:02.941+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:02.996 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:02.996 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:03.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:03.055 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:03.058+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:03.128 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:03.128 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:03.142 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:03.141+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:03.143 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:03.243 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:03.242+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:03.311 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:03.311 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:03.325 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:03.344 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:03.345+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:03.446 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:03.445+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:03.493 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:03.493 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:03.508 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:03.552 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:03.554+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:03.627 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:03.628 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:03.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:03.648 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:03.645+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:03.748 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:03.749+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:03.816 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:03.816 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:03.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:03.849 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:03.849+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:03.950 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:03.949+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:03.951 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:03.951 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:03.967 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:04.050 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:04.049+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:04.096 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:04.096 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:04.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:04.151 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:04.149+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:04.242 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:04.242 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:04.252 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:04.254+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:04.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:04.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:39:04.353 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:04.354+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:04.394 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:04.395 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:04.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:04.454 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:04.454+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:04.538 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:04.538 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:04.553 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:04.554 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:04.553+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:04.655 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:04.653+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:04.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:04.672 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:04.673 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:04.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:04.780 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:04.781+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:04.857 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:04.858+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:04.863 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:04.863 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:04.872 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:04.872 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:04.878 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:04.894 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:04.895 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:04.915 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:04.915 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:04.934 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:04.934 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:04.955 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:04.955 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:04.957 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:04.958+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:04.977 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:04.978 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:04.998 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:04.999 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:05.013 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:05.013 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:05.013 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:05.013 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:05.013 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:05.022 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:05.022 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:05.028 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:05.089 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:05.089+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:05.159 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:05.158+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:1192 3.1a e71/18 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head v 71'1, mlcod=0'0)", 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.379754361, 2024-04-17T15:39:05.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012590545, 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832339+0000", 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832340+0000", 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.91e-07 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837330+0000", 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049904620000000002 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837357+0000", 2024-04-17T15:39:05.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6974999999999998e-05 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837370+0000", 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.34e-05 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837437+0000", 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6382000000000002e-05 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.837455+0000", 2024-04-17T15:39:05.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8284e-05 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844890+0000", 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074353930000000002 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.844930+0000", 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9458000000000001e-05 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1592 3.3e 3:7ed5585d:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.405203938, 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0089542040000000003, 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1592 2024-04-17T15:39:05.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806890+0000", 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.806892+0000", 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3989999999999998e-06 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807868+0000", 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00097551400000000003 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807890+0000", 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2503000000000001e-05 2024-04-17T15:39:05.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807900+0000", 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7550000000000006e-06 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.807964+0000", 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3801999999999997e-05 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808072+0000", 2024-04-17T15:39:05.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107871 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.808170+0000", 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8197999999999997e-05 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815570+0000", 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074005779999999997 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815774+0000", 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020377899999999999 2024-04-17T15:39:05.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815812+0000", 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8098e-05 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.815844+0000", 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1707e-05 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.224 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1902 4.27 4:e6ac3db2:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.338909425000001, 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055036649999999996, 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1902 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873184+0000", 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873185+0000", 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.105e-06 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873191+0000", 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1919999999999996e-06 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873207+0000", 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5939000000000001e-05 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873221+0000", 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4566000000000001e-05 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873297+0000", 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5683e-05 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873367+0000", 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0278999999999996e-05 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.873460+0000", 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3231000000000002e-05 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.874219+0000", 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00075834800000000005 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878616+0000", 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043977139999999996 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878647+0000", 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0375999999999999e-05 2024-04-17T15:39:05.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:42.878688+0000", 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1232000000000001e-05 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2185 3.19 3:9a84a28a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.234666187, 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014021347, 2024-04-17T15:39:05.230 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2185 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977428+0000", 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.977430+0000", 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9399999999999998e-06 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979749+0000", 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023181920000000002 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979782+0000", 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3657e-05 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979794+0000", 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1815e-05 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.979891+0000", 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6688999999999995e-05 2024-04-17T15:39:05.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.980098+0000", 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206763 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.980290+0000", 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019285 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.990912+0000", 2024-04-17T15:39:05.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010621558 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991294+0000", 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00038154900000000002 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991373+0000", 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9305e-05 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.991449+0000", 2024-04-17T15:39:05.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6029e-05 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2192 3.0 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.15553281, 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016712945, 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.236 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2192 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056609+0000", 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8192000000000002e-05 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058326+0000", 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017167980000000001 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058354+0000", 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8469000000000001e-05 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058368+0000", 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3567000000000001e-05 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058448+0000", 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9943000000000004e-05 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058629+0000", 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018072100000000001 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058790+0000", 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016184000000000001 2024-04-17T15:39:05.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.069821+0000", 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011030629 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073138+0000", 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033164679999999999 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073206+0000", 2024-04-17T15:39:05.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8324999999999994e-05 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073274+0000", 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7992999999999998e-05 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.137330072999999, 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.241 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:05.245 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.133963571000001, 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:05.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:39:05.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2228 3.32 e76/18 3:4e7df19b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_47:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.782416562, 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010461764, 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.251 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.429677+0000", 2024-04-17T15:39:05.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431443+0000", 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017654840000000001 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431467+0000", 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3864999999999999e-05 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431483+0000", 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6413999999999999e-05 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431600+0000", 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117169 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.431627+0000", 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6684000000000001e-05 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440072+0000", 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084452910000000006 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440139+0000", 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6656999999999996e-05 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2229 3.19 3:997f76dc:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.773467831, 2024-04-17T15:39:05.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012913452000000001, 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2229 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438626+0000", 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.438628+0000", 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1720000000000001e-06 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440848+0000", 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022202670000000002 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440869+0000", 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0557999999999999e-05 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440882+0000", 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2781e-05 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.440948+0000", 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6066000000000001e-05 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.441073+0000", 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012537400000000001 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.441189+0000", 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011582999999999999 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.450838+0000", 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096493240000000008 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451446+0000", 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00060818500000000002 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451486+0000", 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9885000000000002e-05 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.451539+0000", 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3010000000000002e-05 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2231 3.3e 3:7e08bf39:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.753848595000001, 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016293021000000001, 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.261 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2231 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458262+0000", 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6534000000000001e-05 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460097+0000", 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001835298 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460124+0000", 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7359e-05 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460140+0000", 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5241e-05 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460208+0000", 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8579999999999997e-05 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460333+0000", 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012509500000000001 2024-04-17T15:39:05.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460467+0000", 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013373599999999999 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472830+0000", 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012363486 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474285+0000", 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014549669999999999 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474416+0000", 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013019099999999999 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474538+0000", 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012253399999999999 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.266 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2233 3.25 3:a45e43c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.732656883000001, 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012859545999999999, 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2233 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479437+0000", 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.479440+0000", 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4240000000000002e-06 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481115+0000", 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001674593 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481140+0000", 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4757e-05 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481150+0000", 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.061e-05 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481230+0000", 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0129000000000005e-05 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481395+0000", 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000164418 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.481541+0000", 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014615400000000001 2024-04-17T15:39:05.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.489435+0000", 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078943510000000008 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492174+0000", 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027384570000000001 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492230+0000", 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5816000000000002e-05 2024-04-17T15:39:05.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492296+0000", 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6836999999999997e-05 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2235 3.19 3:9b2d1060:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.71101468, 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012884441, 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.272 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2235 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501079+0000", 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.501082+0000", 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8710000000000001e-06 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503033+0000", 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001951068 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503060+0000", 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6670999999999999e-05 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503075+0000", 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4916000000000001e-05 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503170+0000", 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5733e-05 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503327+0000", 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001562 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.503493+0000", 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000166088 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513393+0000", 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099001009999999997 2024-04-17T15:39:05.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513830+0000", 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00043754999999999998 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513900+0000", 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9951999999999997e-05 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513964+0000", 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3291000000000001e-05 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2239 3.1a e76/18 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.663783425, 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012593248, 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.278 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548310+0000", 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.548313+0000", 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4710000000000001e-06 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553543+0000", 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052302770000000002 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553577+0000", 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3538000000000003e-05 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553591+0000", 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4765e-05 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553678+0000", 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6640999999999999e-05 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553708+0000", 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0114e-05 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.560838+0000", 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071303670000000003 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.560904+0000", 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5074999999999996e-05 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2244 3.19 3:9a9a742a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.282 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.618886237, 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013573603, 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2244 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593208+0000", 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593211+0000", 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.207e-06 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594773+0000", 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015622489999999999 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594798+0000", 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5111999999999999e-05 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594808+0000", 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0319999999999999e-05 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.594884+0000", 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5105999999999995e-05 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.595066+0000", 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182065 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.595223+0000", 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015709 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.599821+0000", 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045988009999999996 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606657+0000", 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006835374 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606726+0000", 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9496e-05 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.606781+0000", 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4783e-05 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.556763813, 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:39:05.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:39:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2251 3.1a e76/18 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.540032131, 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011149496, 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672062+0000", 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.672063+0000", 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.778e-06 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676433+0000", 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043691900000000002 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676451+0000", 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8187999999999999e-05 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676462+0000", 2024-04-17T15:39:05.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1286e-05 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676534+0000", 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1865000000000004e-05 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.676553+0000", 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8760999999999999e-05 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.683146+0000", 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0065932439999999998 2024-04-17T15:39:05.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.683211+0000", 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5184000000000005e-05 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2252 3.25 3:a447a9ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.53383434, 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014955945, 2024-04-17T15:39:05.298 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2252 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678262+0000", 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0639999999999998e-06 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680355+0000", 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020922559999999998 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680381+0000", 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6437000000000001e-05 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680395+0000", 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3653e-05 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680498+0000", 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103486 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680682+0000", 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018336700000000001 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680824+0000", 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014226399999999999 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692441+0000", 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011617331 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693055+0000", 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000614092 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693133+0000", 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7996000000000003e-05 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693215+0000", 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1998999999999999e-05 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.303 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2261 3.37 e76/45 3:ef87aca3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_80:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.434583956000001, 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010338282000000001, 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:39:05.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777510+0000", 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777511+0000", 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5000000000000001e-07 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782642+0000", 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051310230000000002 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782676+0000", 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4786000000000002e-05 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782694+0000", 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7776000000000001e-05 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782790+0000", 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5699999999999995e-05 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.782826+0000", 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5836e-05 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.787780+0000", 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049541580000000002 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.787848+0000", 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8152999999999996e-05 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2265 3.25 3:a7c7e3b2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.398946429, 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012222443, 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.308 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2265 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813147+0000", 2024-04-17T15:39:05.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.813150+0000", 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814795+0000", 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001644653 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814822+0000", 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7008999999999998e-05 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814833+0000", 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0899e-05 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814966+0000", 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133151 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.815140+0000", 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403199999999999 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.815291+0000", 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015072100000000001 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825222+0000", 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099317290000000003 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825268+0000", 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5850999999999999e-05 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825306+0000", 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8241000000000002e-05 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.825370+0000", 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3291000000000001e-05 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2267 3.6 e76/18 3:601e7e13:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_86:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.375060037000001, 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010876569000000001, 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837034+0000", 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.837036+0000", 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2110000000000001e-06 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838535+0000", 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001499043 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838563+0000", 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.826e-05 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838578+0000", 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4776e-05 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838661+0000", 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2915000000000002e-05 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.838706+0000", 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4882999999999997e-05 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.847835+0000", 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091295309999999998 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.847910+0000", 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4950000000000006e-05 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.317 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.318 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.318 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:05.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:05.320 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:05.322+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:39:05.420 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:05.421+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:05.453 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:05.454 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:05.454 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:05.454 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:05.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:05.521 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:05.522+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:05.622 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:05.622+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:05.633 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:05.634 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:05.634 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:05.634 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:05.634 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:05.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:05.722 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:05.721+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:05.777 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:05.777 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:05.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1594 3.2f 3:f6989893:::5305729a-6754-489e-9706-ab50dfde728d.4412.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.947190291999998, 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015262937000000001, 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.778 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1594 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827588+0000", 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6780000000000001e-06 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829147+0000", 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015589810000000001 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829171+0000", 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4267999999999999e-05 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829180+0000", 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2240000000000001e-06 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829244+0000", 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3565999999999994e-05 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829368+0000", 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123977 2024-04-17T15:39:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829722+0000", 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035428599999999999 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.838390+0000", 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0086673889999999993 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842776+0000", 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043862700000000003 2024-04-17T15:39:05.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842818+0000", 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2061999999999998e-05 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842849+0000", 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1235999999999997e-05 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.783 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2190 3.9 e76/18 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.735618322000001, 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012233502, 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3299999999999998e-07 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043625+0000", 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004467047 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043654+0000", 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8178e-05 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043667+0000", 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3388e-05 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043737+0000", 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9486999999999994e-05 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043755+0000", 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8209000000000001e-05 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051330+0000", 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075749349999999997 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051392+0000", 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1925000000000001e-05 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.787 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2191 3.3b e76/18 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.722144949, 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017593028, 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052633+0000", 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.218e-06 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057496+0000", 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048628489999999998 2024-04-17T15:39:05.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057528+0000", 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2636999999999999e-05 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057546+0000", 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7368999999999999e-05 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057647+0000", 2024-04-17T15:39:05.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101662 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057685+0000", 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7333000000000003e-05 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070062+0000", 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0123774 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070225+0000", 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016255999999999999 2024-04-17T15:39:05.791 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2192 3.0 e76/18 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.715879532000001, 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014023864, 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:05.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058899+0000", 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061931+0000", 2024-04-17T15:39:05.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003032145 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061958+0000", 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6344000000000001e-05 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061971+0000", 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3739e-05 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062054+0000", 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2442999999999997e-05 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062080+0000", 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5970999999999999e-05 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072852+0000", 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010772415 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072921+0000", 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.868e-05 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2194 3.0 e76/18 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.694113765999999, 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017385022, 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080665+0000", 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082876+0000", 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022112590000000001 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082917+0000", 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0142999999999998e-05 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082936+0000", 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9760000000000001e-05 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083070+0000", 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013328299999999999 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083100+0000", 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0450000000000002e-05 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.097937+0000", 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014836716 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098048+0000", 2024-04-17T15:39:05.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110968 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2201 3.3d e76/18 3:bf2548c9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_20:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.620851930000001, 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00815747, 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153925+0000", 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155682+0000", 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017575239999999999 2024-04-17T15:39:05.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155706+0000", 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3890999999999999e-05 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155719+0000", 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.313e-05 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155796+0000", 2024-04-17T15:39:05.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6862999999999999e-05 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155821+0000", 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162033+0000", 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006211823 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162082+0000", 2024-04-17T15:39:05.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8742999999999997e-05 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2210 3.9 e76/18 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.524964947000001, 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015862533000000002, 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249813+0000", 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.051e-06 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253690+0000", 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038778990000000002 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253719+0000", 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8643e-05 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253731+0000", 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1667e-05 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253802+0000", 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1154000000000003e-05 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253830+0000", 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8489000000000001e-05 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265608+0000", 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011777881 2024-04-17T15:39:05.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265674+0000", 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5748999999999997e-05 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.488285526, 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.808 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2216 3.3b e76/18 3:dce33251:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_35:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.461975791, 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014445159000000001, 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7599999999999996e-07 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316913+0000", 2024-04-17T15:39:05.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041116140000000004 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316938+0000", 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5439000000000002e-05 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316953+0000", 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4352000000000001e-05 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317067+0000", 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011370999999999999 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317096+0000", 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9762000000000001e-05 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327173+0000", 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010077114 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327246+0000", 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2391999999999994e-05 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2217 3.16 3:685b1a75:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.458457557999999, 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015566544, 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.818 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2217 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316321+0000", 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.888e-06 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317806+0000", 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001485295 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317826+0000", 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9772e-05 2024-04-17T15:39:05.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317839+0000", 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.275e-05 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317905+0000", 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6295000000000001e-05 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318050+0000", 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014553499999999999 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318184+0000", 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013408100000000001 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327767+0000", 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095827919999999997 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331806+0000", 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040388439999999998 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331852+0000", 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5688e-05 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331885+0000", 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3603999999999999e-05 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.823 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2220 3.9 e76/18 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.422523143999999, 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080201279999999996, 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352255+0000", 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1519999999999999e-06 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356205+0000", 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039496339999999996 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356229+0000", 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3944e-05 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356239+0000", 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0039e-05 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356306+0000", 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7041999999999999e-05 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356330+0000", 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3434999999999998e-05 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360227+0000", 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003897064 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360273+0000", 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6817999999999998e-05 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.827 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2222 3.3b e76/18 3:de6332b5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_41:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.403159082, 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013173443999999999, 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371619+0000", 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6029999999999999e-06 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375645+0000", 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040257330000000001 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375689+0000", 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3884999999999997e-05 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375704+0000", 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5792000000000001e-05 2024-04-17T15:39:05.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375811+0000", 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001064 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375845+0000", 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4406999999999998e-05 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384724+0000", 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088788570000000004 2024-04-17T15:39:05.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384791+0000", 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6767000000000006e-05 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.35782614, 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.832 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:39:05.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:39:05.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:39:05.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:39:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.263187808, 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.838 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:39:05.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:39:05.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.842 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.243731369000001, 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.844 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:39:05.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:39:05.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:05.849 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.057236158, 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:39:05.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:39:05.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:39:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2263 3.24 3:26b54de5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.983628008, 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016875999999999999, 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.855 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2263 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791151+0000", 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8679999999999999e-06 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792521+0000", 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013701430000000001 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792555+0000", 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3504000000000003e-05 2024-04-17T15:39:05.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792568+0000", 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792660+0000", 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1842999999999995e-05 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792856+0000", 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000196217 2024-04-17T15:39:05.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.793040+0000", 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018371699999999999 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.802663+0000", 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096231790000000008 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807825+0000", 2024-04-17T15:39:05.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051621469999999997 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807940+0000", 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115178 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.808024+0000", 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4091999999999994e-05 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2268 3.3b e76/18 3:dd4f1f8c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_87:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.926127347, 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0098387490000000008, 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848651+0000", 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.655e-06 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852668+0000", 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004016955 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852684+0000", 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5914e-05 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852695+0000", 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1335000000000001e-05 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852766+0000", 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0754999999999996e-05 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852785+0000", 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8887999999999999e-05 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858432+0000", 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00564702 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858488+0000", 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6227000000000002e-05 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.864 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2271 3.24 3:26dc27af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.896999062999999, 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017910166000000002, 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2271 2024-04-17T15:39:05.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877780+0000", 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5679999999999998e-06 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879011+0000", 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001231078 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879048+0000", 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6618000000000001e-05 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879064+0000", 2024-04-17T15:39:05.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6381000000000001e-05 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879158+0000", 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3733999999999994e-05 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879348+0000", 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019001599999999999 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:05.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879523+0000", 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017555199999999999 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885749+0000", 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062252150000000001 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895559+0000", 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009810058 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.869 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895632+0000", 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3119000000000002e-05 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895688+0000", 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5826999999999999e-05 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2277 3.24 3:25196b41:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:05.870 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.834266952, 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017789381, 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2277 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940512+0000", 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6860000000000002e-06 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942245+0000", 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001732634 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942277+0000", 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1782000000000002e-05 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942295+0000", 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8355e-05 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942385+0000", 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9679000000000007e-05 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942568+0000", 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018293300000000001 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942735+0000", 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016778600000000001 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.947972+0000", 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052370810000000002 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958178+0000", 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010205690999999999 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958247+0000", 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8950999999999998e-05 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958299+0000", 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1802999999999999e-05 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.875 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.876 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.876 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:05.876 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:05.876 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:05.877 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:05.878 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:05.877+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:05.978 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:05.977+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:06.056 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:06.057 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:06.057 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:06.057 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:06.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:06.080 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:06.082+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:06.181 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:06.182+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:06.241 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:06.241 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:06.241 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:06.242 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:06.242 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:06.256 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:06.300 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:06.301+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:06.383 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:06.381+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1193 3.2 3:413bc53d:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.561192732999999, 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014466954000000001, 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1193 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826589+0000", 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9910000000000001e-06 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827645+0000", 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001055627 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827669+0000", 2024-04-17T15:39:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4635e-05 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827679+0000", 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9539999999999999e-06 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827770+0000", 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0934999999999996e-05 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827938+0000", 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016818200000000001 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.828113+0000", 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017488700000000001 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832493+0000", 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004380264 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.840973+0000", 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084791999999999992 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841017+0000", 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3967000000000001e-05 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841054+0000", 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7311999999999998e-05 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1195 3.b 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.538247433999999, 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017715149999999999, 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1195 2024-04-17T15:39:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849534+0000", 2024-04-17T15:39:06.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850786+0000", 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001251172 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850811+0000", 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5386000000000001e-05 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850821+0000", 2024-04-17T15:39:06.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0285999999999999e-05 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850905+0000", 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3934e-05 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851097+0000", 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019139 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:06.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851598+0000", 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00050139599999999998 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.864860+0000", 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013262451999999999 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867151+0000", 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022904520000000001 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867197+0000", 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6313999999999997e-05 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867247+0000", 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0312000000000002e-05 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2182 3.22 e75/18 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head v 75'1, mlcod=0'0)", 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.440874117, 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012030150999999999, 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946908+0000", 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951652+0000", 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047438189999999998 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951684+0000", 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2317000000000002e-05 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951698+0000", 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.433e-05 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951794+0000", 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5482000000000005e-05 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951811+0000", 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6799999999999998e-05 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958860+0000", 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070494169999999997 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958936+0000", 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5822999999999996e-05 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.404 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.258623023, 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:06.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:39:06.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:39:06.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.408 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:39:06.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:39:06.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:06.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:06.411 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.246847103, 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:06.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:39:06.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.414 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2203 3.33 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.21492245, 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018462655000000001, 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.417 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2203 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172860+0000", 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1219999999999999e-06 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175004+0000", 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021435209999999998 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175027+0000", 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2934000000000001e-05 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175040+0000", 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.332e-05 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175111+0000", 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1149000000000006e-05 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175220+0000", 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010859 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175312+0000", 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2436999999999996e-05 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.189629+0000", 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014316194000000001 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191198+0000", 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001569778 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191265+0000", 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6231999999999999e-05 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191320+0000", 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5377999999999997e-05 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.422 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2207 3.15 e76/18 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.16839564, 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016924775999999999, 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219386+0000", 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8199999999999999e-06 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224735+0000", 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053494229999999999 2024-04-17T15:39:06.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224778+0000", 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2948000000000003e-05 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224793+0000", 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224881+0000", 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8190999999999996e-05 2024-04-17T15:39:06.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224914+0000", 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3095000000000001e-05 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236248+0000", 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01133339 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236309+0000", 2024-04-17T15:39:06.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1333000000000004e-05 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2211 3.29 3:972307fc:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.133064698, 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017874909000000001, 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.427 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2211 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254718+0000", 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5620000000000002e-06 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256701+0000", 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019833300000000002 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256725+0000", 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4522e-05 2024-04-17T15:39:06.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256739+0000", 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3393999999999999e-05 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256822+0000", 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3143e-05 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256984+0000", 2024-04-17T15:39:06.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016208499999999999 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.257103+0000", 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011872899999999999 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265295+0000", 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081918749999999995 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272468+0000", 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071732649999999998 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272534+0000", 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5871999999999995e-05 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272590+0000", 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6131999999999997e-05 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.432 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.805103429999999, 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.433 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:39:06.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:39:06.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2250 3.19 e76/18 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head v 76'5, mlcod=76'3)", 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.7301179, 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016559072000000001, 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657665+0000", 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8119999999999999e-06 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659745+0000", 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020804650000000001 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659779+0000", 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659795+0000", 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6888000000000002e-05 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659878+0000", 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2454999999999996e-05 2024-04-17T15:39:06.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659908+0000", 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0204000000000001e-05 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674164+0000", 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014255465 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674221+0000", 2024-04-17T15:39:06.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7346999999999998e-05 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2253 3.7 3:e24db805:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.694987999, 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018614170999999999, 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.443 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2253 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692794+0000", 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4820000000000001e-06 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694460+0000", 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016656660000000001 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694492+0000", 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2036999999999998e-05 2024-04-17T15:39:06.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694505+0000", 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3556e-05 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694627+0000", 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000121173 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694819+0000", 2024-04-17T15:39:06.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019235199999999999 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.695012+0000", 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019336000000000001 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.699362+0000", 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043500880000000002 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711319+0000", 2024-04-17T15:39:06.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011956318000000001 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711368+0000", 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9407000000000003e-05 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711406+0000", 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7731999999999997e-05 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.678459466, 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:39:06.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2259 3.22 e76/18 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head v 76'3, mlcod=75'1)", 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.629534100000001, 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017962353, 2024-04-17T15:39:06.454 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758247+0000", 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.221e-06 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762255+0000", 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040082829999999996 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762282+0000", 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.652e-05 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762293+0000", 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1392e-05 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762365+0000", 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1687000000000007e-05 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762384+0000", 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9749999999999999e-05 2024-04-17T15:39:06.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776137+0000", 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013752795999999999 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776208+0000", 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0704000000000006e-05 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2260 3.23 e76/18 3:c7e72049:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_79:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.623122465, 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013120143000000001, 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764658+0000", 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.92e-07 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767777+0000", 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003118689 2024-04-17T15:39:06.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767801+0000", 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4383e-05 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767815+0000", 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3916e-05 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767901+0000", 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5908000000000005e-05 2024-04-17T15:39:06.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767929+0000", 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8206000000000001e-05 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777717+0000", 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097883039999999994 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777777+0000", 2024-04-17T15:39:06.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0044999999999999e-05 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2264 3.b 3:d1e91691:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.586412826, 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013508938, 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.463 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2264 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801370+0000", 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1949999999999999e-06 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803362+0000", 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001991643 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803394+0000", 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1885999999999999e-05 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803410+0000", 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6487999999999999e-05 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803505+0000", 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4492000000000003e-05 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803653+0000", 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000148317 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803772+0000", 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011948299999999999 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.809037+0000", 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.005264342 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814771+0000", 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057347159999999999 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814826+0000", 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4474000000000001e-05 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814876+0000", 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9901999999999998e-05 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2270 3.1e 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.468 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.521355530999999, 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019292126999999999, 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2270 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:06.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866427+0000", 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0010000000000002e-06 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868222+0000", 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001794943 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868252+0000", 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9598999999999999e-05 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868267+0000", 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4803e-05 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868363+0000", 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6558000000000006e-05 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868548+0000", 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000185248 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868719+0000", 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017112099999999999 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.875258+0000", 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0065380389999999998 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885590+0000", 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010332884000000001 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885659+0000", 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885716+0000", 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7311000000000001e-05 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2273 3.7 3:e2b4eed0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.488166333000001, 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019105502, 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.474 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2273 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.475 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899616+0000", 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901220+0000", 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016033180000000001 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901253+0000", 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2848000000000001e-05 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901268+0000", 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673999999999999e-05 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901424+0000", 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015542999999999999 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901580+0000", 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000156324 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901726+0000", 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000145971 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.906593+0000", 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004866586 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918592+0000", 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01199968 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918664+0000", 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1495000000000006e-05 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918719+0000", 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5071999999999997e-05 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.479 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2274 3.27 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.478147515, 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020003305999999998, 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2274 2024-04-17T15:39:06.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909635+0000", 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3760000000000002e-06 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911097+0000", 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001462765 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911130+0000", 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2876000000000002e-05 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911148+0000", 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7337e-05 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911236+0000", 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8010000000000006e-05 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911396+0000", 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160808 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911543+0000", 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146584 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.920092+0000", 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085487510000000003 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929554+0000", 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094618759999999993 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929594+0000", 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0136999999999999e-05 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929636+0000", 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1786000000000003e-05 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.485 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2276 3.2 3:413eb100:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.456487599000001, 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020329113999999999, 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2276 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931295+0000", 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6189999999999998e-06 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936287+0000", 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049920559999999999 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936310+0000", 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3538000000000001e-05 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936322+0000", 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1739000000000001e-05 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936395+0000", 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2521000000000006e-05 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936512+0000", 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117872 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936622+0000", 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010926599999999999 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942455+0000", 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058337099999999998 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951496+0000", 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090407899999999999 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951571+0000", 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4361000000000002e-05 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951621+0000", 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0642000000000001e-05 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2282 3.38 3:1e5bbe9d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.394047106, 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017690014, 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:06.491 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2282 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:06.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993736+0000", 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3289999999999998e-06 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995029+0000", 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001292898 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995064+0000", 2024-04-17T15:39:06.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5508e-05 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995080+0000", 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673000000000001e-05 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995183+0000", 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010299200000000001 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:06.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995325+0000", 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014212799999999999 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995421+0000", 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5630000000000004e-05 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.001610+0000", 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0061888680000000001 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011284+0000", 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096739470000000004 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011359+0000", 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5210999999999995e-05 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011423+0000", 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3830000000000004e-05 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:06.496 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:06.497 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:06.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:06.498 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:06.498+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:06.599 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:06.597+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:06.633 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:06.633 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:06.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:06.700 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:06.701+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:06.766 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:06.766 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:06.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:06.801 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:06.801+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:06.902 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:06.901+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:06.904 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.081006263999999, 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:39:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.926828508, 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.914492015, 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:39:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:39:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:39:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:39:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2189 3.3 3:c1edeb6a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.881851666999999, 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016969445, 2024-04-17T15:39:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2189 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021610+0000", 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9100000000000001e-06 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025660+0000", 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040499380000000003 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025706+0000", 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5914999999999997e-05 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025736+0000", 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9913999999999999e-05 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025872+0000", 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013620900000000001 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026163+0000", 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029049300000000001 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026449+0000", 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028624500000000002 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.033587+0000", 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071378650000000002 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047364709999999999 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038462+0000", 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138746 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038577+0000", 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114739 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2190 3.9 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.869189861000001, 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018014220000000001, 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2190 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034272+0000", 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-06 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040506539999999999 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038348+0000", 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5086999999999999e-05 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038382+0000", 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4816e-05 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038551+0000", 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016887799999999999 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038804+0000", 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000253088 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.039021+0000", 2024-04-17T15:39:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021690199999999999 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051114+0000", 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012092284999999999 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051953+0000", 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083926200000000002 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052131+0000", 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017803900000000001 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052283+0000", 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.833455223, 2024-04-17T15:39:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2195 3.f e76/18 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.808889089000001, 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016421760000000001, 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:06.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094572+0000", 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2400000000000002e-06 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097267+0000", 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002694686 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097306+0000", 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9428999999999998e-05 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097329+0000", 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2327000000000002e-05 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097508+0000", 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017951499999999999 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097578+0000", 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9865999999999998e-05 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110805+0000", 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013226628000000001 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110992+0000", 2024-04-17T15:39:06.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018706899999999999 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2208 3.1b e76/18 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.676564382, 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018441939000000001, 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226898+0000", 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9469999999999999e-06 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231882+0000", 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049839719999999997 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231919+0000", 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6983000000000001e-05 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231936+0000", 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7099999999999999e-05 2024-04-17T15:39:06.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232092+0000", 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000156448 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232133+0000", 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0917000000000001e-05 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245213+0000", 2024-04-17T15:39:06.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013079456 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245337+0000", 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012411599999999999 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2210 3.9 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.658877650000001, 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021814205, 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2210 2024-04-17T15:39:06.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244585+0000", 2024-04-17T15:39:06.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8199999999999998e-06 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248808+0000", 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004222689 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248846+0000", 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8062999999999998e-05 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248866+0000", 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0443000000000001e-05 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249007+0000", 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014065200000000001 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249351+0000", 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034406699999999998 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:06.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249759+0000", 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040812900000000002 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.261660+0000", 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011900834000000001 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266158+0000", 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044976039999999997 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266264+0000", 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106179 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266396+0000", 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013172499999999999 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2220 3.9 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.557261030999999, 2024-04-17T15:39:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017714483999999999, 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2220 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346202+0000", 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351067+0000", 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048656560000000003 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351104+0000", 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6860000000000003e-05 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351123+0000", 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8828999999999999e-05 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351295+0000", 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017146300000000001 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351709+0000", 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041460899999999997 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.352146+0000", 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043721299999999999 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360734+0000", 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085879530000000006 2024-04-17T15:39:06.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363590+0000", 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028559840000000002 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363764+0000", 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017367899999999999 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363913+0000", 2024-04-17T15:39:06.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148555 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2239 3.1a 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.360929819000001, 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02117043, 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2239 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542533+0000", 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1459999999999998e-06 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547455+0000", 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049219700000000003 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547505+0000", 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9094999999999997e-05 2024-04-17T15:39:06.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547533+0000", 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.813e-05 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547687+0000", 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015475600000000001 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547958+0000", 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027019000000000001 2024-04-17T15:39:06.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.548202+0000", 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244615 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.557187+0000", 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0089846390000000009 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563517+0000", 2024-04-17T15:39:06.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063303439999999999 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563622+0000", 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104652 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563700+0000", 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7892999999999994e-05 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2242 3.f e76/18 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.319417680000001, 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016600970999999999, 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584044+0000", 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.016e-06 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587806+0000", 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037613199999999999 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587849+0000", 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3189999999999998e-05 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587867+0000", 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588016+0000", 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014827800000000001 2024-04-17T15:39:06.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588060+0000", 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4523e-05 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600492+0000", 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012432145 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600642+0000", 2024-04-17T15:39:06.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149999 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2246 3.3 3:c10f4bfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.287896796, 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022677520999999999, 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.967 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2246 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615601+0000", 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8197e-05 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623411+0000", 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007810773 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623455+0000", 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3263999999999998e-05 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623474+0000", 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9366000000000001e-05 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623637+0000", 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016321200000000001 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623894+0000", 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025645799999999999 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:06.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.624163+0000", 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026971999999999999 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.636351+0000", 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012188094 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637944+0000", 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001592263 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638115+0000", 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017097799999999999 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638240+0000", 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125196 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:06.972 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.276976360000001, 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:39:06.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:39:06.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.263518449999999, 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.978 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:39:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:39:06.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:39:06.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2251 3.1a 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.236401875, 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016964861000000001, 2024-04-17T15:39:06.982 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2251 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667059+0000", 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.670968+0000", 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039089800000000003 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671001+0000", 2024-04-17T15:39:06.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2456000000000002e-05 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671015+0000", 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4432e-05 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671184+0000", 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016877799999999999 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671605+0000", 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000420846 2024-04-17T15:39:06.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.672016+0000", 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041139600000000002 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.682956+0000", 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010939285999999999 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683731+0000", 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077576999999999995 2024-04-17T15:39:06.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683903+0000", 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017203800000000001 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.684022+0000", 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011863599999999999 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2254 3.11 e76/18 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:06.987 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.195738542999999, 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019675885000000001, 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707724+0000", 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7129999999999999e-06 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711670+0000", 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039457720000000002 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711712+0000", 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.214e-05 2024-04-17T15:39:06.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711734+0000", 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2158999999999999e-05 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711887+0000", 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253900000000001 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711952+0000", 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5173999999999996e-05 2024-04-17T15:39:06.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727265+0000", 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015312622 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727396+0000", 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013176600000000001 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.991 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2256 3.24 e76/45 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.183342417, 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016800223, 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720119+0000", 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725518+0000", 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053986549999999996 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725564+0000", 2024-04-17T15:39:06.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6202999999999998e-05 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725590+0000", 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5982999999999998e-05 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725761+0000", 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017110500000000001 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725813+0000", 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1922999999999997e-05 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736772+0000", 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010959365 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736917+0000", 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014473200000000001 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:06.995 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2274 3.27 e76/18 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 13.991549217999999, 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017285802999999999, 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:06.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911912+0000", 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:06.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916353+0000", 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004441164 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916389+0000", 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5916e-05 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916408+0000", 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8539999999999999e-05 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916559+0000", 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015148200000000001 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916621+0000", 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1651999999999999e-05 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929024+0000", 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012403529999999999 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:06.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929196+0000", 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171392 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2283 3.1c e76/18 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 13.893490534, 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021912134, 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:07.000 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009971+0000", 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8899999999999999e-06 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013348+0000", 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033769429999999999 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013391+0000", 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2339999999999998e-05 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013409+0000", 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8502999999999999e-05 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013548+0000", 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138422 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013591+0000", 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.375e-05 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031701+0000", 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018109600999999999 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031881+0000", 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017968500000000001 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:07.004 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:07.006 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:07.006 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:07.005+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:07.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:07.106 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:07.106+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:07.137 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:07.137 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:07.137 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:07.137 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:07.151 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:07.204 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:07.204 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:07.207 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:07.205+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:07.222 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:07.241 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:07.242 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:07.259 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:07.260 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:07.279 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:07.280 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:07.299 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:07.299 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:07.308 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:07.309+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:07.321 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:07.321 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:07.321 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:07.322 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:07.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:07.342 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:07.342 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:07.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:39:07.410 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:07.410+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:07.463 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:07.463 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:07.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:07.510 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:07.509+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:07.612 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:07.614+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:07.649 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:07.649 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:07.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:07.712 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:07.713+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:07.813 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:07.813+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:07.827 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:07.827 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:07.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:07.914 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:07.913+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:07.967 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:07.967 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:07.981 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:08.027 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:08.030+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:08.109 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:08.110 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:08.115 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:08.113+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:08.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:08.216 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:08.217+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:08.297 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:08.298 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:08.312 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:08.359 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:08.362+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:08.375 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:39:08.436 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:08.436 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:08.440 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:08.441+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:08.451 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:08.519 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:08.517+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:08.584 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:08.584 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:08.598 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:08.640 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:08.641+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:08.720 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:08.721+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:08.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:08.821 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:08.822+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:08.923 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:08.922+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:08.957 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:08.957 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:08.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:09.023 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:09.026+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:09.094 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:09.095 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:09.109 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:09.156 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:09.157+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:09.226 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:09.225+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:09.229 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:09.229 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:09.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:09.335 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:09.333+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:09.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:09.417 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:09.417 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:09.427 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:09.429+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:09.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:09.508 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:09.526 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:09.527 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:09.529 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:09.530+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:09.545 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:09.546 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:09.562 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:09.584 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:09.584 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:09.600 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:09.600 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:09.600 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:09.600 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:09.605 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:09.605 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:09.614 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:09.626 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:09.627 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:09.630 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:09.629+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:09.648 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:09.648 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:09.730 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:09.730+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:09.743 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:09.744 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:09.744 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:09.744 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:09.744 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:09.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:09.831 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:09.830+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:09.889 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1594 3.2f 3:f6989893:::5305729a-6754-489e-9706-ab50dfde728d.4412.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.061216542, 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015262937000000001, 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.890 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1594 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827588+0000", 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6780000000000001e-06 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829147+0000", 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015589810000000001 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829171+0000", 2024-04-17T15:39:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4267999999999999e-05 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829180+0000", 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2240000000000001e-06 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829244+0000", 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3565999999999994e-05 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829368+0000", 2024-04-17T15:39:09.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123977 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829722+0000", 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035428599999999999 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.838390+0000", 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0086673889999999993 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842776+0000", 2024-04-17T15:39:09.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043862700000000003 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842818+0000", 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2061999999999998e-05 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842849+0000", 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1235999999999997e-05 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2190 3.9 e76/18 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.849644571999999, 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012233502, 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3299999999999998e-07 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043625+0000", 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004467047 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043654+0000", 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8178e-05 2024-04-17T15:39:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043667+0000", 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3388e-05 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043737+0000", 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9486999999999994e-05 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043755+0000", 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8209000000000001e-05 2024-04-17T15:39:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051330+0000", 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075749349999999997 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051392+0000", 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1925000000000001e-05 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2191 3.3b e76/18 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.836171198999999, 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017593028, 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052633+0000", 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.218e-06 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057496+0000", 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048628489999999998 2024-04-17T15:39:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057528+0000", 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2636999999999999e-05 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057546+0000", 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7368999999999999e-05 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057647+0000", 2024-04-17T15:39:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101662 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057685+0000", 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7333000000000003e-05 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070062+0000", 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0123774 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070225+0000", 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016255999999999999 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2192 3.0 e76/18 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.829905782000001, 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014023864, 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058899+0000", 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061931+0000", 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003032145 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061958+0000", 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6344000000000001e-05 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061971+0000", 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3739e-05 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062054+0000", 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2442999999999997e-05 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062080+0000", 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5970999999999999e-05 2024-04-17T15:39:09.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072852+0000", 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010772415 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072921+0000", 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.868e-05 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2194 3.0 e76/18 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.808140015999999, 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017385022, 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080665+0000", 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082876+0000", 2024-04-17T15:39:09.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022112590000000001 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082917+0000", 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0142999999999998e-05 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082936+0000", 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9760000000000001e-05 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083070+0000", 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013328299999999999 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083100+0000", 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0450000000000002e-05 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.097937+0000", 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014836716 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098048+0000", 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110968 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2201 3.3d e76/18 3:bf2548c9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_20:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.734878179999999, 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00815747, 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.914 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153925+0000", 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155682+0000", 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017575239999999999 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155706+0000", 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3890999999999999e-05 2024-04-17T15:39:09.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155719+0000", 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.313e-05 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155796+0000", 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6862999999999999e-05 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155821+0000", 2024-04-17T15:39:09.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162033+0000", 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006211823 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162082+0000", 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8742999999999997e-05 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2210 3.9 e76/18 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.638991196999999, 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015862533000000002, 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:09.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249813+0000", 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.051e-06 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253690+0000", 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038778990000000002 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253719+0000", 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8643e-05 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253731+0000", 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1667e-05 2024-04-17T15:39:09.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253802+0000", 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1154000000000003e-05 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253830+0000", 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8489000000000001e-05 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265608+0000", 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011777881 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265674+0000", 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5748999999999997e-05 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.923 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.602311776000001, 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:39:09.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:09.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2216 3.3b e76/18 3:dce33251:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_35:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.576002040999999, 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014445159000000001, 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:09.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7599999999999996e-07 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316913+0000", 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041116140000000004 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316938+0000", 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5439000000000002e-05 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316953+0000", 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4352000000000001e-05 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317067+0000", 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011370999999999999 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317096+0000", 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9762000000000001e-05 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327173+0000", 2024-04-17T15:39:09.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010077114 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327246+0000", 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2391999999999994e-05 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2217 3.16 3:685b1a75:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:09.934 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.572483808000001, 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015566544, 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2217 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:09.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316321+0000", 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.888e-06 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317806+0000", 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001485295 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317826+0000", 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9772e-05 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317839+0000", 2024-04-17T15:39:09.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.275e-05 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317905+0000", 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6295000000000001e-05 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318050+0000", 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014553499999999999 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318184+0000", 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013408100000000001 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327767+0000", 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095827919999999997 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331806+0000", 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040388439999999998 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331852+0000", 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5688e-05 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331885+0000", 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3603999999999999e-05 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.940 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2220 3.9 e76/18 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.536549394000001, 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080201279999999996, 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352255+0000", 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1519999999999999e-06 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356205+0000", 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039496339999999996 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356229+0000", 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3944e-05 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356239+0000", 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0039e-05 2024-04-17T15:39:09.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356306+0000", 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7041999999999999e-05 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356330+0000", 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3434999999999998e-05 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360227+0000", 2024-04-17T15:39:09.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003897064 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360273+0000", 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6817999999999998e-05 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2222 3.3b e76/18 3:de6332b5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_41:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.517185332, 2024-04-17T15:39:09.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013173443999999999, 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:09.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371619+0000", 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6029999999999999e-06 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375645+0000", 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040257330000000001 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375689+0000", 2024-04-17T15:39:09.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3884999999999997e-05 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375704+0000", 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5792000000000001e-05 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375811+0000", 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001064 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375845+0000", 2024-04-17T15:39:09.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4406999999999998e-05 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384724+0000", 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088788570000000004 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384791+0000", 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6767000000000006e-05 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.471852389999999, 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:39:09.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:39:09.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:39:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:09.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:09.955 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.377214058, 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:09.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:39:09.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.357757619000001, 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.961 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:09.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.966 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.171262408, 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2263 3.24 3:26b54de5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.097654257999999, 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016875999999999999, 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2263 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791151+0000", 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8679999999999999e-06 2024-04-17T15:39:09.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792521+0000", 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013701430000000001 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792555+0000", 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3504000000000003e-05 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792568+0000", 2024-04-17T15:39:09.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792660+0000", 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1842999999999995e-05 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792856+0000", 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000196217 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:09.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.793040+0000", 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018371699999999999 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.802663+0000", 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096231790000000008 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807825+0000", 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051621469999999997 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807940+0000", 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115178 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.808024+0000", 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4091999999999994e-05 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2268 3.3b e76/18 3:dd4f1f8c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_87:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.040153597, 2024-04-17T15:39:09.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0098387490000000008, 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848651+0000", 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.655e-06 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852668+0000", 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004016955 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852684+0000", 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5914e-05 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852695+0000", 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1335000000000001e-05 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852766+0000", 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0754999999999996e-05 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852785+0000", 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8887999999999999e-05 2024-04-17T15:39:09.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858432+0000", 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00564702 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858488+0000", 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6227000000000002e-05 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2271 3.24 3:26dc27af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.011025313000001, 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017910166000000002, 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2271 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.983 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877780+0000", 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5679999999999998e-06 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879011+0000", 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001231078 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879048+0000", 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6618000000000001e-05 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879064+0000", 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6381000000000001e-05 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879158+0000", 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3733999999999994e-05 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879348+0000", 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019001599999999999 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879523+0000", 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017555199999999999 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885749+0000", 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062252150000000001 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895559+0000", 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009810058 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895632+0000", 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3119000000000002e-05 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895688+0000", 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5826999999999999e-05 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2277 3.24 3:25196b41:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:09.988 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 16.948293201999999, 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017789381, 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2277 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940512+0000", 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6860000000000002e-06 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942245+0000", 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001732634 2024-04-17T15:39:09.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942277+0000", 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1782000000000002e-05 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942295+0000", 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8355e-05 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942385+0000", 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9679000000000007e-05 2024-04-17T15:39:09.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942568+0000", 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018293300000000001 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942735+0000", 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016778600000000001 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.947972+0000", 2024-04-17T15:39:09.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052370810000000002 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958178+0000", 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010205690999999999 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958247+0000", 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8950999999999998e-05 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:09.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958299+0000", 2024-04-17T15:39:09.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1802999999999999e-05 2024-04-17T15:39:09.994 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.994 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.994 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.994 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:09.994 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:09.994 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:09.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:09.996 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:09.993+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:10.096 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:10.097+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:10.174 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:10.175 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:10.191 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:10.236 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:10.237+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:10.298 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:10.298+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:10.371 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:10.371 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:10.386 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:10.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:39:10.437 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:10.437+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:10.501 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:10.502+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:10.517 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:10.517 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:10.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:10.517 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1193 3.2 3:413bc53d:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.691434982000001, 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014466954000000001, 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1193 2024-04-17T15:39:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826589+0000", 2024-04-17T15:39:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9910000000000001e-06 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827645+0000", 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001055627 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827669+0000", 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4635e-05 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827679+0000", 2024-04-17T15:39:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9539999999999999e-06 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827770+0000", 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0934999999999996e-05 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827938+0000", 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016818200000000001 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.828113+0000", 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017488700000000001 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832493+0000", 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004380264 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.840973+0000", 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084791999999999992 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841017+0000", 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3967000000000001e-05 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841054+0000", 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7311999999999998e-05 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1195 3.b 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.668489683000001, 2024-04-17T15:39:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017715149999999999, 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1195 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849534+0000", 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850786+0000", 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001251172 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850811+0000", 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5386000000000001e-05 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850821+0000", 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0285999999999999e-05 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850905+0000", 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3934e-05 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851097+0000", 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019139 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851598+0000", 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00050139599999999998 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.864860+0000", 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013262451999999999 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867151+0000", 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022904520000000001 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867197+0000", 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6313999999999997e-05 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867247+0000", 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0312000000000002e-05 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2182 3.22 e75/18 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head v 75'1, mlcod=0'0)", 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.571116365999998, 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012030150999999999, 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946908+0000", 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951652+0000", 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047438189999999998 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951684+0000", 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2317000000000002e-05 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951698+0000", 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.433e-05 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951794+0000", 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5482000000000005e-05 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951811+0000", 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6799999999999998e-05 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958860+0000", 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070494169999999997 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958936+0000", 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5822999999999996e-05 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.388865272, 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:39:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:39:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.377089351999999, 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:39:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2203 3.33 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.345164699000001, 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018462655000000001, 2024-04-17T15:39:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2203 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172860+0000", 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1219999999999999e-06 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175004+0000", 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021435209999999998 2024-04-17T15:39:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175027+0000", 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2934000000000001e-05 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175040+0000", 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.332e-05 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175111+0000", 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1149000000000006e-05 2024-04-17T15:39:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175220+0000", 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010859 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175312+0000", 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2436999999999996e-05 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.189629+0000", 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014316194000000001 2024-04-17T15:39:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191198+0000", 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001569778 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191265+0000", 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6231999999999999e-05 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191320+0000", 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5377999999999997e-05 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2207 3.15 e76/18 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.298637888999998, 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016924775999999999, 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219386+0000", 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8199999999999999e-06 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224735+0000", 2024-04-17T15:39:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053494229999999999 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224778+0000", 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2948000000000003e-05 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224793+0000", 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224881+0000", 2024-04-17T15:39:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8190999999999996e-05 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224914+0000", 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3095000000000001e-05 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236248+0000", 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01133339 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236309+0000", 2024-04-17T15:39:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1333000000000004e-05 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2211 3.29 3:972307fc:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.263306947, 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017874909000000001, 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2211 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254718+0000", 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5620000000000002e-06 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256701+0000", 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019833300000000002 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256725+0000", 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4522e-05 2024-04-17T15:39:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256739+0000", 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3393999999999999e-05 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256822+0000", 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3143e-05 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256984+0000", 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016208499999999999 2024-04-17T15:39:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.257103+0000", 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011872899999999999 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265295+0000", 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081918749999999995 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272468+0000", 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071732649999999998 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272534+0000", 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5871999999999995e-05 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272590+0000", 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6131999999999997e-05 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.935345679000001, 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:39:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:39:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2250 3.19 e76/18 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head v 76'5, mlcod=76'3)", 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.860360149000002, 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016559072000000001, 2024-04-17T15:39:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657665+0000", 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8119999999999999e-06 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659745+0000", 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020804650000000001 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659779+0000", 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659795+0000", 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6888000000000002e-05 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659878+0000", 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2454999999999996e-05 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659908+0000", 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0204000000000001e-05 2024-04-17T15:39:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674164+0000", 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014255465 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674221+0000", 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7346999999999998e-05 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2253 3.7 3:e24db805:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.825230248, 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018614170999999999, 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2253 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692794+0000", 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4820000000000001e-06 2024-04-17T15:39:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694460+0000", 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016656660000000001 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694492+0000", 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2036999999999998e-05 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694505+0000", 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3556e-05 2024-04-17T15:39:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694627+0000", 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000121173 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694819+0000", 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019235199999999999 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.695012+0000", 2024-04-17T15:39:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019336000000000001 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.699362+0000", 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043500880000000002 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711319+0000", 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011956318000000001 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711368+0000", 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9407000000000003e-05 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711406+0000", 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7731999999999997e-05 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.808701715000002, 2024-04-17T15:39:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:39:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:39:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2259 3.22 e76/18 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head v 76'3, mlcod=75'1)", 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.759776348999999, 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017962353, 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758247+0000", 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.221e-06 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762255+0000", 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040082829999999996 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762282+0000", 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.652e-05 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762293+0000", 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1392e-05 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762365+0000", 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1687000000000007e-05 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762384+0000", 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9749999999999999e-05 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776137+0000", 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013752795999999999 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776208+0000", 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0704000000000006e-05 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2260 3.23 e76/18 3:c7e72049:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_79:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.753364714, 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013120143000000001, 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764658+0000", 2024-04-17T15:39:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.92e-07 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767777+0000", 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003118689 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767801+0000", 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4383e-05 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767815+0000", 2024-04-17T15:39:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3916e-05 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767901+0000", 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5908000000000005e-05 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767929+0000", 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8206000000000001e-05 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777717+0000", 2024-04-17T15:39:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097883039999999994 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777777+0000", 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0044999999999999e-05 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2264 3.b 3:d1e91691:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.716655074999998, 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013508938, 2024-04-17T15:39:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2264 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801370+0000", 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1949999999999999e-06 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803362+0000", 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001991643 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803394+0000", 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1885999999999999e-05 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803410+0000", 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6487999999999999e-05 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803505+0000", 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4492000000000003e-05 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803653+0000", 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000148317 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803772+0000", 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011948299999999999 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.809037+0000", 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.005264342 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814771+0000", 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057347159999999999 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814826+0000", 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4474000000000001e-05 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814876+0000", 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9901999999999998e-05 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2270 3.1e 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.651597779999999, 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019292126999999999, 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2270 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866427+0000", 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0010000000000002e-06 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868222+0000", 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001794943 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868252+0000", 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9598999999999999e-05 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868267+0000", 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4803e-05 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868363+0000", 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6558000000000006e-05 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868548+0000", 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000185248 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868719+0000", 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017112099999999999 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.875258+0000", 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0065380389999999998 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885590+0000", 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010332884000000001 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885659+0000", 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885716+0000", 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7311000000000001e-05 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2273 3.7 3:e2b4eed0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.618408582000001, 2024-04-17T15:39:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019105502, 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2273 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899616+0000", 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901220+0000", 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016033180000000001 2024-04-17T15:39:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901253+0000", 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2848000000000001e-05 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901268+0000", 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673999999999999e-05 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901424+0000", 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015542999999999999 2024-04-17T15:39:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901580+0000", 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000156324 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901726+0000", 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000145971 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.906593+0000", 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004866586 2024-04-17T15:39:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918592+0000", 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01199968 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918664+0000", 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1495000000000006e-05 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918719+0000", 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5071999999999997e-05 2024-04-17T15:39:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2274 3.27 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.608389764000002, 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020003305999999998, 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2274 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909635+0000", 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3760000000000002e-06 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911097+0000", 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001462765 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911130+0000", 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2876000000000002e-05 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911148+0000", 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7337e-05 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911236+0000", 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8010000000000006e-05 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911396+0000", 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160808 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911543+0000", 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146584 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.920092+0000", 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085487510000000003 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929554+0000", 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094618759999999993 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929594+0000", 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0136999999999999e-05 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929636+0000", 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1786000000000003e-05 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2276 3.2 3:413eb100:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.586729848000001, 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020329113999999999, 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2276 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931295+0000", 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6189999999999998e-06 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936287+0000", 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049920559999999999 2024-04-17T15:39:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936310+0000", 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3538000000000001e-05 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936322+0000", 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1739000000000001e-05 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936395+0000", 2024-04-17T15:39:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2521000000000006e-05 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936512+0000", 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117872 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936622+0000", 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010926599999999999 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942455+0000", 2024-04-17T15:39:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058337099999999998 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951496+0000", 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090407899999999999 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951571+0000", 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4361000000000002e-05 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951621+0000", 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0642000000000001e-05 2024-04-17T15:39:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2282 3.38 3:1e5bbe9d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.524289355000001, 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017690014, 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2282 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993736+0000", 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3289999999999998e-06 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995029+0000", 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001292898 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995064+0000", 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5508e-05 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995080+0000", 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673000000000001e-05 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995183+0000", 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010299200000000001 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995325+0000", 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014212799999999999 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995421+0000", 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5630000000000004e-05 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.001610+0000", 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0061888680000000001 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011284+0000", 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096739470000000004 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011359+0000", 2024-04-17T15:39:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5210999999999995e-05 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011423+0000", 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3830000000000004e-05 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:10.622 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:10.624 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:10.624 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:10.625+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:10.724 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:10.725+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:10.758 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:10.758 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:10.758 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:10.758 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:10.772 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:10.824 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:10.825+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:10.892 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:10.893 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:10.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:10.925 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:10.925+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:11.027 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:11.025+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.211829508999998, 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:39:11.036 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:39:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:39:11.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:39:11.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.057651752999998, 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:39:11.042 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:39:11.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.045315259999999, 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:39:11.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:39:11.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2189 3.3 3:c1edeb6a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:11.052 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.012674912000001, 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016969445, 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2189 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021610+0000", 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9100000000000001e-06 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025660+0000", 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040499380000000003 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025706+0000", 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5914999999999997e-05 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025736+0000", 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9913999999999999e-05 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025872+0000", 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013620900000000001 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026163+0000", 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029049300000000001 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026449+0000", 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028624500000000002 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.033587+0000", 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071378650000000002 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047364709999999999 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038462+0000", 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138746 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038577+0000", 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114739 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2190 3.9 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.000013106000001, 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018014220000000001, 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2190 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034272+0000", 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-06 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040506539999999999 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038348+0000", 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5086999999999999e-05 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038382+0000", 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4816e-05 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038551+0000", 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016887799999999999 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038804+0000", 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000253088 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.039021+0000", 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021690199999999999 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051114+0000", 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012092284999999999 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051953+0000", 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083926200000000002 2024-04-17T15:39:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052131+0000", 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017803900000000001 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052283+0000", 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.964278468, 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:39:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:39:11.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2195 3.f e76/18 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.939712333999999, 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016421760000000001, 2024-04-17T15:39:11.069 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094572+0000", 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2400000000000002e-06 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097267+0000", 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002694686 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097306+0000", 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9428999999999998e-05 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097329+0000", 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2327000000000002e-05 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097508+0000", 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017951499999999999 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097578+0000", 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9865999999999998e-05 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110805+0000", 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013226628000000001 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110992+0000", 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018706899999999999 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2208 3.1b e76/18 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:11.073 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.807387627000001, 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018441939000000001, 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:11.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226898+0000", 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9469999999999999e-06 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231882+0000", 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049839719999999997 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231919+0000", 2024-04-17T15:39:11.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6983000000000001e-05 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231936+0000", 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7099999999999999e-05 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232092+0000", 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000156448 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232133+0000", 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0917000000000001e-05 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245213+0000", 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013079456 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245337+0000", 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012411599999999999 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2210 3.9 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.789700894999999, 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021814205, 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2210 2024-04-17T15:39:11.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244585+0000", 2024-04-17T15:39:11.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8199999999999998e-06 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248808+0000", 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004222689 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248846+0000", 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8062999999999998e-05 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248866+0000", 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0443000000000001e-05 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249007+0000", 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014065200000000001 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249351+0000", 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034406699999999998 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249759+0000", 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040812900000000002 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.261660+0000", 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011900834000000001 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266158+0000", 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044976039999999997 2024-04-17T15:39:11.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266264+0000", 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106179 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266396+0000", 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013172499999999999 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.083 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2220 3.9 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.688084276000001, 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017714483999999999, 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2220 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346202+0000", 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351067+0000", 2024-04-17T15:39:11.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048656560000000003 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351104+0000", 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6860000000000003e-05 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351123+0000", 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8828999999999999e-05 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351295+0000", 2024-04-17T15:39:11.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017146300000000001 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351709+0000", 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041460899999999997 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.352146+0000", 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043721299999999999 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360734+0000", 2024-04-17T15:39:11.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085879530000000006 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363590+0000", 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028559840000000002 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363764+0000", 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017367899999999999 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363913+0000", 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148555 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2239 3.1a 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.491753064000001, 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02117043, 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.089 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2239 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:11.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542533+0000", 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1459999999999998e-06 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547455+0000", 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049219700000000003 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547505+0000", 2024-04-17T15:39:11.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9094999999999997e-05 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547533+0000", 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.813e-05 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547687+0000", 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015475600000000001 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547958+0000", 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027019000000000001 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.548202+0000", 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244615 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.557187+0000", 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0089846390000000009 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563517+0000", 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063303439999999999 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563622+0000", 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104652 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563700+0000", 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7892999999999994e-05 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2242 3.f e76/18 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:11.094 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.450240924999999, 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016600970999999999, 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:11.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584044+0000", 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.016e-06 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587806+0000", 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037613199999999999 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587849+0000", 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3189999999999998e-05 2024-04-17T15:39:11.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587867+0000", 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588016+0000", 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014827800000000001 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588060+0000", 2024-04-17T15:39:11.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4523e-05 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600492+0000", 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012432145 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600642+0000", 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149999 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2246 3.3 3:c10f4bfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.418720041, 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022677520999999999, 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2246 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615601+0000", 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8197e-05 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623411+0000", 2024-04-17T15:39:11.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007810773 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623455+0000", 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3263999999999998e-05 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623474+0000", 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9366000000000001e-05 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623637+0000", 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016321200000000001 2024-04-17T15:39:11.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623894+0000", 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025645799999999999 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.624163+0000", 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026971999999999999 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.636351+0000", 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012188094 2024-04-17T15:39:11.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637944+0000", 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001592263 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638115+0000", 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017097799999999999 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638240+0000", 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125196 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.103 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.407799605000001, 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:39:11.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:39:11.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:39:11.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:39:11.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:39:11.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:39:11.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.111 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.394341695000001, 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:11.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:39:11.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2251 3.1a 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.367225120000001, 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016964861000000001, 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2251 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667059+0000", 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.670968+0000", 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039089800000000003 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671001+0000", 2024-04-17T15:39:11.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2456000000000002e-05 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671015+0000", 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4432e-05 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671184+0000", 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016877799999999999 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671605+0000", 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000420846 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.672016+0000", 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041139600000000002 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.682956+0000", 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010939285999999999 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683731+0000", 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077576999999999995 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683903+0000", 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017203800000000001 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.684022+0000", 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011863599999999999 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2254 3.11 e76/18 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.326561787999999, 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019675885000000001, 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707724+0000", 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7129999999999999e-06 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711670+0000", 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039457720000000002 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711712+0000", 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.214e-05 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711734+0000", 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2158999999999999e-05 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711887+0000", 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253900000000001 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711952+0000", 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5173999999999996e-05 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727265+0000", 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015312622 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727396+0000", 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013176600000000001 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2256 3.24 e76/45 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.314165662000001, 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016800223, 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.126 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720119+0000", 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:39:11.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725518+0000", 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053986549999999996 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725564+0000", 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6202999999999998e-05 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725590+0000", 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5982999999999998e-05 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725761+0000", 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017110500000000001 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725813+0000", 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1922999999999997e-05 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736772+0000", 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010959365 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736917+0000", 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014473200000000001 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2274 3.27 e76/18 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:11.130 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.122372463000001, 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017285802999999999, 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911912+0000", 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916353+0000", 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004441164 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916389+0000", 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5916e-05 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916408+0000", 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8539999999999999e-05 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916559+0000", 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015148200000000001 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916621+0000", 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1651999999999999e-05 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929024+0000", 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012403529999999999 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929196+0000", 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171392 2024-04-17T15:39:11.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2283 3.1c e76/18 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.024313779, 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021912134, 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009971+0000", 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8899999999999999e-06 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013348+0000", 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033769429999999999 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013391+0000", 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2339999999999998e-05 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013409+0000", 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8502999999999999e-05 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013548+0000", 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138422 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013591+0000", 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.375e-05 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031701+0000", 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018109600999999999 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031881+0000", 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017968500000000001 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.139 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:11.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:11.141 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:11.142+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:11.242 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:11.241+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:11.316 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:11.316 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:11.316 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:11.317 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:11.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:11.343 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:11.341+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:11.387 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:39:11.456 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:11.457+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:11.457 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:11.457 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:11.457 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:11.457 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:11.457 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:11.473 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:11.544 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:11.545+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:11.590 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:11.591 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:11.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:11.591 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:11.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.591 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2182 3.22 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:11.591 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:11.591 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.650808506000001, 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020945306, 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2182 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:11.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940490+0000", 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946030+0000", 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055396229999999996 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946069+0000", 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9919999999999997e-05 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946095+0000", 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5769999999999999e-05 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946290+0000", 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019428800000000001 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946583+0000", 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029335100000000002 2024-04-17T15:39:11.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946819+0000", 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023653699999999999 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960915+0000", 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014095721 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961184+0000", 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026861799999999998 2024-04-17T15:39:11.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961321+0000", 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013719200000000001 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961432+0000", 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111146 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.597 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2183 3.35 e75/18 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head v 75'2, mlcod=0'0)", 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.629507746000002, 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019360209, 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961789+0000", 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.513e-06 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964955+0000", 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031659840000000002 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964994+0000", 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8957e-05 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965011+0000", 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6653000000000001e-05 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965297+0000", 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028633100000000002 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965364+0000", 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6768999999999997e-05 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981015+0000", 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015651457000000001 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981148+0000", 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132545 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.601 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2188 3.c 3:316225b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.580235133999999, 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018633493000000001, 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2188 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.602 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011064+0000", 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8870000000000002e-06 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015212+0000", 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041482259999999996 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015252+0000", 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9836000000000003e-05 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015271+0000", 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8980000000000001e-05 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015408+0000", 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013688900000000001 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015665+0000", 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256968 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015903+0000", 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.028073+0000", 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012170728 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029386+0000", 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001312725 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029539+0000", 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015330899999999999 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029694+0000", 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015431099999999999 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.607 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2198 3.3a 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.474247061, 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026029244, 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2198 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.608 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117051+0000", 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9059999999999998e-06 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121284+0000", 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042323589999999998 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121335+0000", 2024-04-17T15:39:11.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1643e-05 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121362+0000", 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6650000000000001e-05 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121586+0000", 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223928 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122021+0000", 2024-04-17T15:39:11.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043530199999999999 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122505+0000", 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048423599999999998 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.134629+0000", 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012124118 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142907+0000", 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082773959999999994 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142998+0000", 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0828999999999994e-05 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143077+0000", 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9876999999999994e-05 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2202 3.30 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.427546464999999, 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023532595999999999, 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2202 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.614 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163753+0000", 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9700000000000001e-06 2024-04-17T15:39:11.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168372+0000", 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004618942 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168415+0000", 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3272000000000002e-05 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168433+0000", 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8196999999999999e-05 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168572+0000", 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013865500000000001 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168828+0000", 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256328 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.169055+0000", 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000226331 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.176874+0000", 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078199310000000005 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.186974+0000", 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010100012 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187144+0000", 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016979899999999999 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187281+0000", 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013715900000000001 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2204 3.1c 3:3aa83ff5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.405641065000001, 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019530355999999999, 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.620 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2204 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185657+0000", 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2569999999999999e-06 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188693+0000", 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003035163 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188721+0000", 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8002999999999999e-05 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188736+0000", 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5829999999999999e-05 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188856+0000", 2024-04-17T15:39:11.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119376 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189095+0000", 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023956100000000001 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189320+0000", 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000224121 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.198523+0000", 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092036619999999996 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.204907+0000", 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063834520000000004 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205027+0000", 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050200000000001 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205185+0000", 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157429 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2206 3.2a 3:554687e0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.386150238999999, 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029258256, 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.626 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2206 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205148+0000", 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6900000000000001e-06 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211713+0000", 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065654110000000002 2024-04-17T15:39:11.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211744+0000", 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1232999999999997e-05 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211761+0000", 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6994e-05 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211928+0000", 2024-04-17T15:39:11.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166195 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212314+0000", 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000385993 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212704+0000", 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039051 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.223772+0000", 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067521 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234062+0000", 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010289918 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234240+0000", 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000178302 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234403+0000", 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016348900000000001 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2212 3.28 3:1630d003:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.325309322999999, 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019714803999999999, 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.632 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2212 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266001+0000", 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5427e-05 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272057+0000", 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060554090000000003 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272098+0000", 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.155e-05 2024-04-17T15:39:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272117+0000", 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9127000000000002e-05 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272317+0000", 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019985099999999999 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272712+0000", 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039508000000000002 2024-04-17T15:39:11.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.273099+0000", 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038697299999999998 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.284174+0000", 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011074218 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285528+0000", 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013542840000000001 2024-04-17T15:39:11.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285623+0000", 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5563000000000006e-05 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285701+0000", 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7322000000000003e-05 2024-04-17T15:39:11.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2225 3.36 e76/18 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.190231792999999, 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020106353, 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.638 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401067+0000", 2024-04-17T15:39:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2200000000000001e-06 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404215+0000", 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031480280000000002 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404253+0000", 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8303999999999998e-05 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404277+0000", 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4428999999999999e-05 2024-04-17T15:39:11.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404428+0000", 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150402 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404496+0000", 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8120000000000005e-05 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421035+0000", 2024-04-17T15:39:11.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016538517999999999 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421170+0000", 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135332 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2226 3.28 3:152ad80f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.186033776999999, 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018476241000000001, 2024-04-17T15:39:11.642 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2226 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405265+0000", 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3069999999999998e-06 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409520+0000", 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042551409999999996 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409566+0000", 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5596000000000002e-05 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409592+0000", 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6186999999999998e-05 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409755+0000", 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000163435 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.410051+0000", 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000296221 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.410294+0000", 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000242704 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.418835+0000", 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085410869999999993 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423420+0000", 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004584996 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423609+0000", 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018851499999999999 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423738+0000", 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129052 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.650 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2230 3.3a 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.142319511, 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025252924, 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2230 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.651 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448979+0000", 2024-04-17T15:39:11.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454011+0000", 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050315719999999998 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454055+0000", 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4382999999999998e-05 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454075+0000", 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0046000000000001e-05 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454276+0000", 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020055800000000001 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454721+0000", 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044527599999999998 2024-04-17T15:39:11.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.455157+0000", 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043578999999999997 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.465942+0000", 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010784936 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474050+0000", 2024-04-17T15:39:11.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081079250000000002 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474144+0000", 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4479000000000001e-05 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474229+0000", 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4486000000000004e-05 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2237 3.2a 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.068611449999999, 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028581945000000001, 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2237 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522688+0000", 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5260000000000004e-06 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526833+0000", 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004144427 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526875+0000", 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1715999999999998e-05 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526894+0000", 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9307e-05 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527045+0000", 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151201 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527303+0000", 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025805199999999999 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527546+0000", 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024263099999999999 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.543539+0000", 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015993657000000001 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550954+0000", 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074142239999999996 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551129+0000", 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017543100000000001 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551266+0000", 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136773 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2243 3.2 e76/18 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.005127653999999, 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019774896, 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586171+0000", 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2430000000000001e-06 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592943+0000", 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067716190000000004 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592982+0000", 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9133e-05 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593000+0000", 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.872e-05 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593167+0000", 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016682200000000001 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593212+0000", 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5262999999999997e-05 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605840+0000", 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012627714 2024-04-17T15:39:11.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605943+0000", 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102382 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2248 3.1c 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.956394642999999, 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028561188000000001, 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2248 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:11.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634905+0000", 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6530000000000002e-06 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638983+0000", 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040774130000000002 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639023+0000", 2024-04-17T15:39:11.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0703e-05 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639048+0000", 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4437e-05 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639211+0000", 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016346500000000001 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639455+0000", 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243324 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639679+0000", 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223935 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661540+0000", 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021861068000000001 2024-04-17T15:39:11.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663140+0000", 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016003860000000001 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663326+0000", 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018592500000000001 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663462+0000", 2024-04-17T15:39:11.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013587899999999999 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2259 3.22 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.837874749000001, 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023533335999999998, 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.672 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2259 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753424+0000", 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5669999999999999e-06 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757463+0000", 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040386470000000002 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757507+0000", 2024-04-17T15:39:11.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4393e-05 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757537+0000", 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9473000000000001e-05 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757736+0000", 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019940800000000001 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757980+0000", 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244398 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.758213+0000", 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023253799999999999 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.766682+0000", 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084694950000000005 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776706+0000", 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010023676 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776825+0000", 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118396 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776954+0000", 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129345 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.677 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2275 3.3c 3:3dedeaf1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.668371110999999, 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019151476000000001, 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2275 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922928+0000", 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6940000000000001e-06 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926921+0000", 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039930369999999996 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926965+0000", 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4397000000000002e-05 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926985+0000", 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9488999999999999e-05 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927169+0000", 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018456500000000001 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927447+0000", 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027765100000000002 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927707+0000", 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026028800000000001 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.936871+0000", 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091640409999999995 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.941911+0000", 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050392379999999997 2024-04-17T15:39:11.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942004+0000", 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3763000000000003e-05 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942076+0000", 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1313e-05 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.683 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2283 3.1c 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.587088984000001, 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028433096000000001, 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2283 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:11.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004210+0000", 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2770000000000001e-06 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008596+0000", 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043866770000000003 2024-04-17T15:39:11.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008636+0000", 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9767000000000001e-05 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008655+0000", 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9083e-05 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008831+0000", 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017611100000000001 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009255+0000", 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042393699999999999 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009704+0000", 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044862299999999999 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.029616+0000", 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019912474999999999 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032482+0000", 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028657439999999999 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032575+0000", 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3146000000000006e-05 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032639+0000", 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4256000000000003e-05 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2287 3.1c 3:3a30054e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.546825070000001, 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020107487, 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2287 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044473+0000", 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048619+0000", 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041462959999999998 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048657+0000", 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7911999999999999e-05 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048681+0000", 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3873999999999999e-05 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048815+0000", 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000133869 2024-04-17T15:39:11.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049079+0000", 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026408099999999999 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049312+0000", 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023292399999999999 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.062430+0000", 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013118747 2024-04-17T15:39:11.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064257+0000", 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268959999999999 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064443+0000", 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018521499999999999 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064578+0000", 2024-04-17T15:39:11.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013511600000000001 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2289 3.36 e76/18 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.520235987, 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022085479000000002, 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071062+0000", 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2290000000000002e-06 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074727+0000", 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036655809999999998 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074765+0000", 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7778999999999999e-05 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074782+0000", 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246999999999999e-05 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074948+0000", 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016588900000000001 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075033+0000", 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4602000000000001e-05 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093017+0000", 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017984473000000001 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093145+0000", 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012767900000000001 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2290 3.5 3:a1064484:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.515370331, 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023102762999999998, 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:11.699 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2290 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075928+0000", 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080045+0000", 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041169969999999998 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080083+0000", 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7196000000000001e-05 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080109+0000", 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6373e-05 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080259+0000", 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015042899999999999 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080519+0000", 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025933100000000001 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080748+0000", 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022913100000000001 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.095782+0000", 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015033902 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098708+0000", 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029261339999999999 2024-04-17T15:39:11.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098890+0000", 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000182222 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.099028+0000", 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137575 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:11.704 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:11.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:11.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:11.707 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:11.706+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:11.807 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:11.806+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:11.872 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:11.877 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:11.878 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:11.878 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:11.878 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:11.889 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:11.893 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:11.905 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:11.905 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:11.907 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:11.905+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:11.922 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:11.922 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:11.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:11.943 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:11.961 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:11.961 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:11.979 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:11.979 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:11.998 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:11.998 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:12.009 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:12.009+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:12.062 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:12.062 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:12.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:12.110 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:12.109+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:12.197 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:12.197 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:12.211 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:12.210+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:12.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:12.311 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:12.314+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:12.382 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:12.383 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:12.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:12.412 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:12.413+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:12.514 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:12.514+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:12.567 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:12.567 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:12.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:12.624 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:12.626+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:12.716 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:12.717+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:12.750 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:12.750 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:12.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:12.817 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:12.818+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:12.900 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:12.900 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:12.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:12.960 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:12.961+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:13.019 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:13.018+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:13.042 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:13.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:13.120 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:13.122+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:13.221 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:13.221+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:13.221 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:13.222 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:13.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:13.324 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:13.325+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:13.401 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:13.401 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:13.413 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:39:13.417 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:13.460 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:13.461+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:13.523 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:13.521+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:13.575 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:13.576 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:13.589 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:13.636 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:13.637+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:13.725 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:13.726+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:13.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:39:13.852 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:13.853+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:13.878 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:13.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:13.932 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:13.933+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:14.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:14.028 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:14.030+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:14.048 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:14.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:14.152 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:14.153+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:14.164 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:14.164 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:14.181 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:14.181 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:14.197 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:14.197 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:14.214 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:14.214 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:14.229 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:14.229+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:14.233 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1594 3.2f 3:f6989893:::5305729a-6754-489e-9706-ab50dfde728d.4412.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.406515018999997, 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015262937000000001, 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1594 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827586+0000", 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.827588+0000", 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6780000000000001e-06 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829147+0000", 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015589810000000001 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829171+0000", 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4267999999999999e-05 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829180+0000", 2024-04-17T15:39:14.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2240000000000001e-06 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829244+0000", 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3565999999999994e-05 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829368+0000", 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123977 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.829722+0000", 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00035428599999999999 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.838390+0000", 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0086673889999999993 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842776+0000", 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043862700000000003 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842818+0000", 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2061999999999998e-05 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:41.842849+0000", 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1235999999999997e-05 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2190 3.9 e76/18 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.194943048999999, 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012233502, 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.239 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.039158+0000", 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3299999999999998e-07 2024-04-17T15:39:14.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043625+0000", 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004467047 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043654+0000", 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8178e-05 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043667+0000", 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3388e-05 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043737+0000", 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9486999999999994e-05 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.043755+0000", 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8209000000000001e-05 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051330+0000", 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075749349999999997 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.051392+0000", 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1925000000000001e-05 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2191 3.3b e76/18 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.181469675999999, 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017593028, 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.243 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052631+0000", 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.052633+0000", 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.218e-06 2024-04-17T15:39:14.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057496+0000", 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0048628489999999998 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057528+0000", 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2636999999999999e-05 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057546+0000", 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7368999999999999e-05 2024-04-17T15:39:14.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057647+0000", 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101662 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.057685+0000", 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7333000000000003e-05 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070062+0000", 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0123774 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.070225+0000", 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016255999999999999 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2192 3.0 e76/18 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:14.247 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.175204259000001, 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014023864, 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058897+0000", 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058899+0000", 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061931+0000", 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003032145 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061958+0000", 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6344000000000001e-05 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.061971+0000", 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3739e-05 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062054+0000", 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2442999999999997e-05 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.062080+0000", 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5970999999999999e-05 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072852+0000", 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010772415 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.072921+0000", 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.868e-05 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2194 3.0 e76/18 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.153438492999999, 2024-04-17T15:39:14.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017385022, 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080663+0000", 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080665+0000", 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082876+0000", 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022112590000000001 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082917+0000", 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0142999999999998e-05 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.082936+0000", 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9760000000000001e-05 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083070+0000", 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013328299999999999 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.083100+0000", 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0450000000000002e-05 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.097937+0000", 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014836716 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098048+0000", 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110968 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2201 3.3d e76/18 3:bf2548c9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_20:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.080176656999999, 2024-04-17T15:39:14.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00815747, 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153924+0000", 2024-04-17T15:39:14.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.153925+0000", 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9999999999999999e-07 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155682+0000", 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017575239999999999 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155706+0000", 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3890999999999999e-05 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155719+0000", 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.313e-05 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155796+0000", 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6862999999999999e-05 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.155821+0000", 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5296e-05 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162033+0000", 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006211823 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.162082+0000", 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8742999999999997e-05 2024-04-17T15:39:14.259 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2210 3.9 e76/18 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.984289673999999, 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015862533000000002, 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249811+0000", 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.249813+0000", 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.051e-06 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253690+0000", 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038778990000000002 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253719+0000", 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8643e-05 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253731+0000", 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1667e-05 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253802+0000", 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1154000000000003e-05 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.253830+0000", 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8489000000000001e-05 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265608+0000", 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011777881 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265674+0000", 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5748999999999997e-05 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.947610253000001, 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.264 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:14.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:39:14.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2216 3.3b e76/18 3:dce33251:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_35:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.921300517999999, 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014445159000000001, 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312801+0000", 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7599999999999996e-07 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316913+0000", 2024-04-17T15:39:14.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041116140000000004 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316938+0000", 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5439000000000002e-05 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316953+0000", 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4352000000000001e-05 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317067+0000", 2024-04-17T15:39:14.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011370999999999999 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317096+0000", 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9762000000000001e-05 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327173+0000", 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010077114 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327246+0000", 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2391999999999994e-05 2024-04-17T15:39:14.273 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2217 3.16 3:685b1a75:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.917782285000001, 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015566544, 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.274 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2217 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316319+0000", 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.316321+0000", 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.888e-06 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317806+0000", 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001485295 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317826+0000", 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9772e-05 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317839+0000", 2024-04-17T15:39:14.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.275e-05 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.317905+0000", 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6295000000000001e-05 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318050+0000", 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014553499999999999 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.318184+0000", 2024-04-17T15:39:14.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013408100000000001 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.327767+0000", 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095827919999999997 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331806+0000", 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040388439999999998 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331852+0000", 2024-04-17T15:39:14.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5688e-05 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.331885+0000", 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3603999999999999e-05 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2220 3.9 e76/18 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.881847871000002, 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080201279999999996, 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352253+0000", 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.352255+0000", 2024-04-17T15:39:14.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1519999999999999e-06 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356205+0000", 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0039496339999999996 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356229+0000", 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3944e-05 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356239+0000", 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0039e-05 2024-04-17T15:39:14.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356306+0000", 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7041999999999999e-05 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.356330+0000", 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3434999999999998e-05 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360227+0000", 2024-04-17T15:39:14.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003897064 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.360273+0000", 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6817999999999998e-05 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2222 3.3b e76/18 3:de6332b5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_41:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.862483809, 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013173443999999999, 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.283 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371617+0000", 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.371619+0000", 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6029999999999999e-06 2024-04-17T15:39:14.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375645+0000", 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040257330000000001 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375689+0000", 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3884999999999997e-05 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375704+0000", 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5792000000000001e-05 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375811+0000", 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0001064 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.375845+0000", 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4406999999999998e-05 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384724+0000", 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088788570000000004 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.384791+0000", 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6767000000000006e-05 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.817150866999999, 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.287 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:39:14.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:39:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:39:14.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:39:14.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.722512535, 2024-04-17T15:39:14.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:39:14.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:39:14.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:39:14.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:39:14.297 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.703056096000001, 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.298 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.516560885000001, 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.304 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:39:14.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:39:14.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2263 3.24 3:26b54de5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.442952734999999, 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016875999999999999, 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2263 2024-04-17T15:39:14.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791148+0000", 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.791151+0000", 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8679999999999999e-06 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792521+0000", 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013701430000000001 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792555+0000", 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3504000000000003e-05 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792568+0000", 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3112000000000001e-05 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792660+0000", 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1842999999999995e-05 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.792856+0000", 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000196217 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.793040+0000", 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018371699999999999 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.802663+0000", 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096231790000000008 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807825+0000", 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051621469999999997 2024-04-17T15:39:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.807940+0000", 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115178 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.808024+0000", 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4091999999999994e-05 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2268 3.3b e76/18 3:dd4f1f8c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_87:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.385452074, 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0098387490000000008, 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848649+0000", 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.848651+0000", 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.655e-06 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852668+0000", 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004016955 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852684+0000", 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5914e-05 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852695+0000", 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1335000000000001e-05 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852766+0000", 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0754999999999996e-05 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.852785+0000", 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8887999999999999e-05 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858432+0000", 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00564702 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.858488+0000", 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6227000000000002e-05 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2271 3.24 3:26dc27af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.356323790000001, 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017910166000000002, 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2271 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877777+0000", 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.877780+0000", 2024-04-17T15:39:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5679999999999998e-06 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879011+0000", 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001231078 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879048+0000", 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6618000000000001e-05 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879064+0000", 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6381000000000001e-05 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879158+0000", 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.3733999999999994e-05 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879348+0000", 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019001599999999999 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.879523+0000", 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017555199999999999 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885749+0000", 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062252150000000001 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895559+0000", 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009810058 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895632+0000", 2024-04-17T15:39:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3119000000000002e-05 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.895688+0000", 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5826999999999999e-05 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2277 3.24 3:25196b41:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.293591678999999, 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017789381, 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2277 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940509+0000", 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.940512+0000", 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6860000000000002e-06 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942245+0000", 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001732634 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942277+0000", 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1782000000000002e-05 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942295+0000", 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8355e-05 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942385+0000", 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9679000000000007e-05 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942568+0000", 2024-04-17T15:39:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018293300000000001 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942735+0000", 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016778600000000001 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.947972+0000", 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052370810000000002 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958178+0000", 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010205690999999999 2024-04-17T15:39:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958247+0000", 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8950999999999998e-05 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.958299+0000", 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1802999999999999e-05 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:14.331 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:14.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:14.334 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:14.335 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:14.336 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:14.334+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:14.433 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:14.434+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:14.503 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:14.517 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:14.564 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:14.565+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:14.635 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:14.633+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:14.635 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:14.636 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:14.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:14.736 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:14.738+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:14.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1193 3.2 3:413bc53d:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.998784145999998, 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014466954000000001, 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1193 2024-04-17T15:39:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826589+0000", 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9910000000000001e-06 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827645+0000", 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001055627 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827669+0000", 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4635e-05 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827679+0000", 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9539999999999999e-06 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827770+0000", 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0934999999999996e-05 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827938+0000", 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016818200000000001 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.828113+0000", 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017488700000000001 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832493+0000", 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004380264 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.840973+0000", 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084791999999999992 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841017+0000", 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3967000000000001e-05 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841054+0000", 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7311999999999998e-05 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1195 3.b 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:14.832 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.975838846999999, 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017715149999999999, 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1195 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849534+0000", 2024-04-17T15:39:14.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850786+0000", 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001251172 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850811+0000", 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5386000000000001e-05 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850821+0000", 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0285999999999999e-05 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850905+0000", 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3934e-05 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851097+0000", 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019139 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851598+0000", 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00050139599999999998 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.864860+0000", 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013262451999999999 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867151+0000", 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022904520000000001 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.837 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867197+0000", 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6313999999999997e-05 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867247+0000", 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0312000000000002e-05 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.838 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2182 3.22 e75/18 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head v 75'1, mlcod=0'0)", 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.87846553, 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012030150999999999, 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:14.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946908+0000", 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951652+0000", 2024-04-17T15:39:14.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047438189999999998 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951684+0000", 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2317000000000002e-05 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951698+0000", 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.433e-05 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951794+0000", 2024-04-17T15:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5482000000000005e-05 2024-04-17T15:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.842 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951811+0000", 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6799999999999998e-05 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958860+0000", 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070494169999999997 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958936+0000", 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5822999999999996e-05 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.843 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.696214435999998, 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:39:14.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:14.849 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.684438516, 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:39:14.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:39:14.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:39:14.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2203 3.33 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.652513862999999, 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018462655000000001, 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.855 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2203 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:14.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172860+0000", 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1219999999999999e-06 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175004+0000", 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021435209999999998 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175027+0000", 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2934000000000001e-05 2024-04-17T15:39:14.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175040+0000", 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.332e-05 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175111+0000", 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1149000000000006e-05 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175220+0000", 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010859 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175312+0000", 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2436999999999996e-05 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.189629+0000", 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014316194000000001 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191198+0000", 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001569778 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191265+0000", 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6231999999999999e-05 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191320+0000", 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5377999999999997e-05 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2207 3.15 e76/18 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.605987053, 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016924775999999999, 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219386+0000", 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8199999999999999e-06 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224735+0000", 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053494229999999999 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224778+0000", 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2948000000000003e-05 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224793+0000", 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224881+0000", 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8190999999999996e-05 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224914+0000", 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3095000000000001e-05 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236248+0000", 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01133339 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236309+0000", 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1333000000000004e-05 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2211 3.29 3:972307fc:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.570656111000002, 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017874909000000001, 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2211 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254718+0000", 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5620000000000002e-06 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256701+0000", 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019833300000000002 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256725+0000", 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4522e-05 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256739+0000", 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3393999999999999e-05 2024-04-17T15:39:14.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256822+0000", 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3143e-05 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256984+0000", 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016208499999999999 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.257103+0000", 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011872899999999999 2024-04-17T15:39:14.868 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265295+0000", 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081918749999999995 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272468+0000", 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071732649999999998 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272534+0000", 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5871999999999995e-05 2024-04-17T15:39:14.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272590+0000", 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6131999999999997e-05 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.242694842999999, 2024-04-17T15:39:14.870 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.871 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.872 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.874 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:39:14.875 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2250 3.19 e76/18 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head v 76'5, mlcod=76'3)", 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.167709313, 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016559072000000001, 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.876 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657665+0000", 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8119999999999999e-06 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.877 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659745+0000", 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020804650000000001 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659779+0000", 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659795+0000", 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6888000000000002e-05 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659878+0000", 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2454999999999996e-05 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659908+0000", 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0204000000000001e-05 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674164+0000", 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014255465 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.879 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674221+0000", 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7346999999999998e-05 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2253 3.7 3:e24db805:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.132579411999998, 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018614170999999999, 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.880 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2253 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:14.881 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692794+0000", 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4820000000000001e-06 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694460+0000", 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016656660000000001 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694492+0000", 2024-04-17T15:39:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2036999999999998e-05 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694505+0000", 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3556e-05 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694627+0000", 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000121173 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694819+0000", 2024-04-17T15:39:14.883 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019235199999999999 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.695012+0000", 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019336000000000001 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.699362+0000", 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043500880000000002 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711319+0000", 2024-04-17T15:39:14.884 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011956318000000001 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711368+0000", 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9407000000000003e-05 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711406+0000", 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7731999999999997e-05 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.885 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.116050878999999, 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2259 3.22 e76/18 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head v 76'3, mlcod=75'1)", 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.067125513000001, 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017962353, 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.891 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758247+0000", 2024-04-17T15:39:14.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.221e-06 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762255+0000", 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040082829999999996 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762282+0000", 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.652e-05 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762293+0000", 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1392e-05 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762365+0000", 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1687000000000007e-05 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762384+0000", 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9749999999999999e-05 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776137+0000", 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013752795999999999 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776208+0000", 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0704000000000006e-05 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2260 3.23 e76/18 3:c7e72049:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_79:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:14.895 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.060713878000001, 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013120143000000001, 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:14.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764658+0000", 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.92e-07 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767777+0000", 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003118689 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767801+0000", 2024-04-17T15:39:14.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4383e-05 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767815+0000", 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3916e-05 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767901+0000", 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5908000000000005e-05 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767929+0000", 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8206000000000001e-05 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777717+0000", 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097883039999999994 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777777+0000", 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0044999999999999e-05 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2264 3.b 3:d1e91691:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.024004239, 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013508938, 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2264 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.900 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801370+0000", 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1949999999999999e-06 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803362+0000", 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001991643 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803394+0000", 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1885999999999999e-05 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803410+0000", 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6487999999999999e-05 2024-04-17T15:39:14.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803505+0000", 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4492000000000003e-05 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803653+0000", 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000148317 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803772+0000", 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011948299999999999 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.809037+0000", 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.005264342 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814771+0000", 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057347159999999999 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814826+0000", 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4474000000000001e-05 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814876+0000", 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9901999999999998e-05 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2270 3.1e 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.958946944000001, 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019292126999999999, 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.905 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2270 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866427+0000", 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0010000000000002e-06 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868222+0000", 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001794943 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868252+0000", 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9598999999999999e-05 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868267+0000", 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4803e-05 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868363+0000", 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6558000000000006e-05 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868548+0000", 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000185248 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868719+0000", 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017112099999999999 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.875258+0000", 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0065380389999999998 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885590+0000", 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010332884000000001 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885659+0000", 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885716+0000", 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7311000000000001e-05 2024-04-17T15:39:14.910 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2273 3.7 3:e2b4eed0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.925757745999999, 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019105502, 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.911 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2273 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899616+0000", 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901220+0000", 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016033180000000001 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901253+0000", 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2848000000000001e-05 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901268+0000", 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673999999999999e-05 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901424+0000", 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015542999999999999 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901580+0000", 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000156324 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901726+0000", 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000145971 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.906593+0000", 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004866586 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918592+0000", 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01199968 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918664+0000", 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1495000000000006e-05 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918719+0000", 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5071999999999997e-05 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2274 3.27 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.916 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.915738928, 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020003305999999998, 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2274 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:14.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909635+0000", 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3760000000000002e-06 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911097+0000", 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001462765 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911130+0000", 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2876000000000002e-05 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911148+0000", 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7337e-05 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911236+0000", 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8010000000000006e-05 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911396+0000", 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160808 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911543+0000", 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146584 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.920092+0000", 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085487510000000003 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929554+0000", 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094618759999999993 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929594+0000", 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0136999999999999e-05 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929636+0000", 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1786000000000003e-05 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2276 3.2 3:413eb100:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.894079011999999, 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020329113999999999, 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.922 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2276 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:14.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931295+0000", 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6189999999999998e-06 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936287+0000", 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049920559999999999 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936310+0000", 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3538000000000001e-05 2024-04-17T15:39:14.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936322+0000", 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1739000000000001e-05 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936395+0000", 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2521000000000006e-05 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936512+0000", 2024-04-17T15:39:14.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117872 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936622+0000", 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010926599999999999 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942455+0000", 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058337099999999998 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951496+0000", 2024-04-17T15:39:14.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090407899999999999 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951571+0000", 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4361000000000002e-05 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951621+0000", 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0642000000000001e-05 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2282 3.38 3:1e5bbe9d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.831638518999998, 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017690014, 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2282 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:14.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993736+0000", 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3289999999999998e-06 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995029+0000", 2024-04-17T15:39:14.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001292898 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995064+0000", 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5508e-05 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995080+0000", 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673000000000001e-05 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995183+0000", 2024-04-17T15:39:14.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010299200000000001 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995325+0000", 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014212799999999999 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995421+0000", 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5630000000000004e-05 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.001610+0000", 2024-04-17T15:39:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0061888680000000001 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011284+0000", 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096739470000000004 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011359+0000", 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5210999999999995e-05 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011423+0000", 2024-04-17T15:39:14.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3830000000000004e-05 2024-04-17T15:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:14.933 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:14.934 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:14.935 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:14.934+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:15.035 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:15.033+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:15.069 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:15.069 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:15.069 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:15.069 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:15.084 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:15.137 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:15.137+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:200+0 records in 2024-04-17T15:39:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:200+0 records out 2024-04-17T15:39:15.158 INFO:tasks.workunit.client.0.smithi044.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 19.8374 s, 106 MB/s 2024-04-17T15:39:15.203 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:15.204 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:15.204 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:15.204 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:15.204 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:15.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:15.267 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:15.270+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:15.329 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_39_15 2024-04-17T15:39:15.338 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:15.337+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.530351132, 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:39:15.354 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:39:15.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.376173376000001, 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.360 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:39:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:39:15.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:39:15.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.363836883000001, 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:39:15.364 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:39:15.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:39:15.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.369 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2189 3.3 3:c1edeb6a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.331196535, 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016969445, 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.370 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2189 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021610+0000", 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9100000000000001e-06 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025660+0000", 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040499380000000003 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025706+0000", 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5914999999999997e-05 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025736+0000", 2024-04-17T15:39:15.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9913999999999999e-05 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025872+0000", 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013620900000000001 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026163+0000", 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029049300000000001 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026449+0000", 2024-04-17T15:39:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028624500000000002 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.033587+0000", 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071378650000000002 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047364709999999999 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038462+0000", 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138746 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038577+0000", 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114739 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2190 3.9 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.318534729, 2024-04-17T15:39:15.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018014220000000001, 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2190 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034272+0000", 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-06 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040506539999999999 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038348+0000", 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5086999999999999e-05 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038382+0000", 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4816e-05 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038551+0000", 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016887799999999999 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038804+0000", 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000253088 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.039021+0000", 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021690199999999999 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051114+0000", 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012092284999999999 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051953+0000", 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083926200000000002 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052131+0000", 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017803900000000001 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052283+0000", 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:39:15.380 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.282800090999999, 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.381 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2195 3.f e76/18 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:15.386 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.258233957000002, 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016421760000000001, 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:15.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094572+0000", 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2400000000000002e-06 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097267+0000", 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002694686 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097306+0000", 2024-04-17T15:39:15.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9428999999999998e-05 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097329+0000", 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2327000000000002e-05 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097508+0000", 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017951499999999999 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097578+0000", 2024-04-17T15:39:15.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9865999999999998e-05 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110805+0000", 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013226628000000001 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110992+0000", 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018706899999999999 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2208 3.1b e76/18 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.125909249999999, 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018441939000000001, 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226898+0000", 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9469999999999999e-06 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231882+0000", 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049839719999999997 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231919+0000", 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6983000000000001e-05 2024-04-17T15:39:15.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231936+0000", 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7099999999999999e-05 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232092+0000", 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000156448 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232133+0000", 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0917000000000001e-05 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245213+0000", 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013079456 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245337+0000", 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012411599999999999 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2210 3.9 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.394 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.108222518000002, 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021814205, 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2210 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:15.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244585+0000", 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8199999999999998e-06 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248808+0000", 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004222689 2024-04-17T15:39:15.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248846+0000", 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8062999999999998e-05 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248866+0000", 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0443000000000001e-05 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249007+0000", 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014065200000000001 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249351+0000", 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034406699999999998 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249759+0000", 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040812900000000002 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.261660+0000", 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011900834000000001 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266158+0000", 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044976039999999997 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266264+0000", 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106179 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266396+0000", 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013172499999999999 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2220 3.9 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.006605899, 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017714483999999999, 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.400 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2220 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346202+0000", 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351067+0000", 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048656560000000003 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351104+0000", 2024-04-17T15:39:15.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6860000000000003e-05 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351123+0000", 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8828999999999999e-05 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351295+0000", 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017146300000000001 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351709+0000", 2024-04-17T15:39:15.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041460899999999997 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.352146+0000", 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043721299999999999 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360734+0000", 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085879530000000006 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363590+0000", 2024-04-17T15:39:15.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028559840000000002 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363764+0000", 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017367899999999999 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363913+0000", 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148555 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.405 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2239 3.1a 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.810274687, 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02117043, 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2239 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542533+0000", 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1459999999999998e-06 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547455+0000", 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049219700000000003 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547505+0000", 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9094999999999997e-05 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547533+0000", 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.813e-05 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547687+0000", 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015475600000000001 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547958+0000", 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027019000000000001 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.548202+0000", 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244615 2024-04-17T15:39:15.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.557187+0000", 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0089846390000000009 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563517+0000", 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063303439999999999 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563622+0000", 2024-04-17T15:39:15.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104652 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563700+0000", 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7892999999999994e-05 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2242 3.f e76/18 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.768762548000002, 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016600970999999999, 2024-04-17T15:39:15.411 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584044+0000", 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.016e-06 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587806+0000", 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037613199999999999 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587849+0000", 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3189999999999998e-05 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587867+0000", 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588016+0000", 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014827800000000001 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588060+0000", 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4523e-05 2024-04-17T15:39:15.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600492+0000", 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012432145 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600642+0000", 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149999 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2246 3.3 3:c10f4bfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.737241663999999, 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022677520999999999, 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2246 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615601+0000", 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8197e-05 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623411+0000", 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007810773 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623455+0000", 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3263999999999998e-05 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623474+0000", 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9366000000000001e-05 2024-04-17T15:39:15.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623637+0000", 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016321200000000001 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623894+0000", 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025645799999999999 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.624163+0000", 2024-04-17T15:39:15.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026971999999999999 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.636351+0000", 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012188094 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637944+0000", 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001592263 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638115+0000", 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017097799999999999 2024-04-17T15:39:15.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638240+0000", 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125196 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.726321228, 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.421 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.712863318, 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:39:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:39:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2251 3.1a 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.685746742999999, 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016964861000000001, 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2251 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667059+0000", 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.670968+0000", 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039089800000000003 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671001+0000", 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2456000000000002e-05 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671015+0000", 2024-04-17T15:39:15.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4432e-05 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671184+0000", 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016877799999999999 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671605+0000", 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000420846 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.672016+0000", 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041139600000000002 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.682956+0000", 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010939285999999999 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683731+0000", 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077576999999999995 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683903+0000", 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017203800000000001 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.684022+0000", 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011863599999999999 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2254 3.11 e76/18 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:15.436 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.645083411000002, 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019675885000000001, 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707724+0000", 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7129999999999999e-06 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711670+0000", 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039457720000000002 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711712+0000", 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.214e-05 2024-04-17T15:39:15.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711734+0000", 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2158999999999999e-05 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711887+0000", 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253900000000001 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711952+0000", 2024-04-17T15:39:15.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5173999999999996e-05 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727265+0000", 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015312622 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727396+0000", 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013176600000000001 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2256 3.24 e76/45 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.632687284999999, 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016800223, 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720119+0000", 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725518+0000", 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053986549999999996 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725564+0000", 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6202999999999998e-05 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725590+0000", 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5982999999999998e-05 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725761+0000", 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017110500000000001 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725813+0000", 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1922999999999997e-05 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736772+0000", 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010959365 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736917+0000", 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014473200000000001 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2274 3.27 e76/18 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.440894086, 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017285802999999999, 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911912+0000", 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916353+0000", 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004441164 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916389+0000", 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5916e-05 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916408+0000", 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8539999999999999e-05 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916559+0000", 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015148200000000001 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916621+0000", 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1651999999999999e-05 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929024+0000", 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012403529999999999 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929196+0000", 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171392 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.448 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2283 3.1c e76/18 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.342835401999999, 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021912134, 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009971+0000", 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8899999999999999e-06 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013348+0000", 2024-04-17T15:39:15.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033769429999999999 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013391+0000", 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2339999999999998e-05 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013409+0000", 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8502999999999999e-05 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013548+0000", 2024-04-17T15:39:15.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138422 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013591+0000", 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.375e-05 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031701+0000", 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018109600999999999 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031881+0000", 2024-04-17T15:39:15.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017968500000000001 2024-04-17T15:39:15.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.453 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.453 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.453 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:15.454 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:15.455 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:15.453+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:15.556 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:15.553+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:15.591 INFO:tasks.workunit.client.0.smithi044.stdout:bucket quota max size set for the given user: buck_2024_03_17_15_39_15 2024-04-17T15:39:15.633 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:15.633 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:15.648 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:15.656 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:15.657+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:15.757 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:15.758+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:15.777 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:15.777 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:15.777 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:15.777 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:15.777 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:15.792 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:15.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:39:15.859 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:15.857+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:15.960 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:15.962+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:15.963 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2182 3.22 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.021898585999999, 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020945306, 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2182 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940490+0000", 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946030+0000", 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055396229999999996 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946069+0000", 2024-04-17T15:39:15.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9919999999999997e-05 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946095+0000", 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5769999999999999e-05 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946290+0000", 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019428800000000001 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946583+0000", 2024-04-17T15:39:15.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029335100000000002 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946819+0000", 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023653699999999999 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960915+0000", 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014095721 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961184+0000", 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026861799999999998 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961321+0000", 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013719200000000001 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961432+0000", 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111146 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2183 3.35 e75/18 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head v 75'2, mlcod=0'0)", 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:15.969 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.000597826, 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019360209, 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961789+0000", 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.513e-06 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964955+0000", 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031659840000000002 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964994+0000", 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8957e-05 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965011+0000", 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6653000000000001e-05 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965297+0000", 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028633100000000002 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965364+0000", 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6768999999999997e-05 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981015+0000", 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015651457000000001 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981148+0000", 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132545 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2188 3.c 3:316225b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:15.973 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.951325214000001, 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018633493000000001, 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2188 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011064+0000", 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8870000000000002e-06 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015212+0000", 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041482259999999996 2024-04-17T15:39:15.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015252+0000", 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9836000000000003e-05 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015271+0000", 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8980000000000001e-05 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015408+0000", 2024-04-17T15:39:15.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013688900000000001 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015665+0000", 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256968 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015903+0000", 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.028073+0000", 2024-04-17T15:39:15.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012170728 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029386+0000", 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001312725 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029539+0000", 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015330899999999999 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029694+0000", 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015431099999999999 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2198 3.3a 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.845337141000002, 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026029244, 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.979 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2198 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117051+0000", 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9059999999999998e-06 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121284+0000", 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042323589999999998 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121335+0000", 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1643e-05 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121362+0000", 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6650000000000001e-05 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121586+0000", 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223928 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122021+0000", 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043530199999999999 2024-04-17T15:39:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122505+0000", 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048423599999999998 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.134629+0000", 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012124118 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142907+0000", 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082773959999999994 2024-04-17T15:39:15.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142998+0000", 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0828999999999994e-05 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143077+0000", 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9876999999999994e-05 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2202 3.30 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.984 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.798636545000001, 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023532595999999999, 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2202 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:15.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163753+0000", 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9700000000000001e-06 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168372+0000", 2024-04-17T15:39:15.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004618942 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168415+0000", 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3272000000000002e-05 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168433+0000", 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8196999999999999e-05 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168572+0000", 2024-04-17T15:39:15.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013865500000000001 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168828+0000", 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256328 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.169055+0000", 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000226331 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.176874+0000", 2024-04-17T15:39:15.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078199310000000005 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.186974+0000", 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010100012 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187144+0000", 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016979899999999999 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187281+0000", 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013715900000000001 2024-04-17T15:39:15.989 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2204 3.1c 3:3aa83ff5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.776731144999999, 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019530355999999999, 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.990 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2204 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185657+0000", 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2569999999999999e-06 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188693+0000", 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003035163 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188721+0000", 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8002999999999999e-05 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188736+0000", 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5829999999999999e-05 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188856+0000", 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119376 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189095+0000", 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023956100000000001 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189320+0000", 2024-04-17T15:39:15.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000224121 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.198523+0000", 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092036619999999996 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.204907+0000", 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063834520000000004 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205027+0000", 2024-04-17T15:39:15.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050200000000001 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205185+0000", 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157429 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2206 3.2a 3:554687e0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.757240319000001, 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029258256, 2024-04-17T15:39:15.995 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2206 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205148+0000", 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6900000000000001e-06 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211713+0000", 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065654110000000002 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211744+0000", 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1232999999999997e-05 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211761+0000", 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6994e-05 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211928+0000", 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166195 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212314+0000", 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000385993 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212704+0000", 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039051 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.223772+0000", 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067521 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:15.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234062+0000", 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010289918 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234240+0000", 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000178302 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234403+0000", 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016348900000000001 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2212 3.28 3:1630d003:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.696399403000001, 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019714803999999999, 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2212 2024-04-17T15:39:16.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266001+0000", 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5427e-05 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272057+0000", 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060554090000000003 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272098+0000", 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.155e-05 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272117+0000", 2024-04-17T15:39:16.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9127000000000002e-05 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272317+0000", 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019985099999999999 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272712+0000", 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039508000000000002 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.273099+0000", 2024-04-17T15:39:16.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038697299999999998 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.284174+0000", 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011074218 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285528+0000", 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013542840000000001 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285623+0000", 2024-04-17T15:39:16.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5563000000000006e-05 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285701+0000", 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7322000000000003e-05 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2225 3.36 e76/18 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.561321873000001, 2024-04-17T15:39:16.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020106353, 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401067+0000", 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2200000000000001e-06 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404215+0000", 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031480280000000002 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404253+0000", 2024-04-17T15:39:16.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8303999999999998e-05 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404277+0000", 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4428999999999999e-05 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404428+0000", 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150402 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404496+0000", 2024-04-17T15:39:16.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8120000000000005e-05 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421035+0000", 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016538517999999999 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421170+0000", 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135332 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2226 3.28 3:152ad80f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.557123857000001, 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018476241000000001, 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2226 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405265+0000", 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3069999999999998e-06 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409520+0000", 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042551409999999996 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409566+0000", 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5596000000000002e-05 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409592+0000", 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6186999999999998e-05 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409755+0000", 2024-04-17T15:39:16.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000163435 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.410051+0000", 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000296221 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.410294+0000", 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000242704 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.418835+0000", 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085410869999999993 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423420+0000", 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004584996 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423609+0000", 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018851499999999999 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423738+0000", 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129052 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2230 3.3a 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.513409590999998, 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025252924, 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.016 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2230 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448979+0000", 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454011+0000", 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050315719999999998 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454055+0000", 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4382999999999998e-05 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454075+0000", 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0046000000000001e-05 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454276+0000", 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020055800000000001 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454721+0000", 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044527599999999998 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:16.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.455157+0000", 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043578999999999997 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.465942+0000", 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010784936 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474050+0000", 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081079250000000002 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474144+0000", 2024-04-17T15:39:16.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4479000000000001e-05 2024-04-17T15:39:16.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474229+0000", 2024-04-17T15:39:16.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4486000000000004e-05 2024-04-17T15:39:16.021 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.021 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2237 3.2a 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.439701530000001, 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028581945000000001, 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.022 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2237 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522688+0000", 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5260000000000004e-06 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526833+0000", 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004144427 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526875+0000", 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1715999999999998e-05 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526894+0000", 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9307e-05 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527045+0000", 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151201 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527303+0000", 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025805199999999999 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527546+0000", 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024263099999999999 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.543539+0000", 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015993657000000001 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550954+0000", 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074142239999999996 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551129+0000", 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017543100000000001 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551266+0000", 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136773 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.027 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2243 3.2 e76/18 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.376217734000001, 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019774896, 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586171+0000", 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2430000000000001e-06 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592943+0000", 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067716190000000004 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592982+0000", 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9133e-05 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593000+0000", 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.872e-05 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593167+0000", 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016682200000000001 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593212+0000", 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5262999999999997e-05 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605840+0000", 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012627714 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605943+0000", 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102382 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2248 3.1c 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.327484723000001, 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028561188000000001, 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2248 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634905+0000", 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6530000000000002e-06 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638983+0000", 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040774130000000002 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639023+0000", 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0703e-05 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639048+0000", 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4437e-05 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639211+0000", 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016346500000000001 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639455+0000", 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243324 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639679+0000", 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223935 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661540+0000", 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021861068000000001 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663140+0000", 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016003860000000001 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663326+0000", 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018592500000000001 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663462+0000", 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013587899999999999 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2259 3.22 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.208964828999999, 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023533335999999998, 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.037 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2259 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:16.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753424+0000", 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5669999999999999e-06 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757463+0000", 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040386470000000002 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757507+0000", 2024-04-17T15:39:16.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4393e-05 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757537+0000", 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9473000000000001e-05 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757736+0000", 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019940800000000001 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757980+0000", 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244398 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.758213+0000", 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023253799999999999 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.766682+0000", 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084694950000000005 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776706+0000", 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010023676 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776825+0000", 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118396 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776954+0000", 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129345 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2275 3.3c 3:3dedeaf1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.039461191000001, 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019151476000000001, 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2275 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922928+0000", 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6940000000000001e-06 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926921+0000", 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039930369999999996 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926965+0000", 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4397000000000002e-05 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926985+0000", 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9488999999999999e-05 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927169+0000", 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018456500000000001 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927447+0000", 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027765100000000002 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927707+0000", 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026028800000000001 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.936871+0000", 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091640409999999995 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.941911+0000", 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050392379999999997 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942004+0000", 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3763000000000003e-05 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942076+0000", 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1313e-05 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2283 3.1c 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.958179063999999, 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028433096000000001, 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2283 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004210+0000", 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2770000000000001e-06 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008596+0000", 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043866770000000003 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008636+0000", 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9767000000000001e-05 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008655+0000", 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9083e-05 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008831+0000", 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017611100000000001 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009255+0000", 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042393699999999999 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009704+0000", 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044862299999999999 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.029616+0000", 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019912474999999999 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032482+0000", 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028657439999999999 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032575+0000", 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3146000000000006e-05 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032639+0000", 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4256000000000003e-05 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2287 3.1c 3:3a30054e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.053 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.917915149999999, 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020107487, 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2287 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:16.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044473+0000", 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048619+0000", 2024-04-17T15:39:16.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041462959999999998 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048657+0000", 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7911999999999999e-05 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048681+0000", 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3873999999999999e-05 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048815+0000", 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000133869 2024-04-17T15:39:16.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049079+0000", 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026408099999999999 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049312+0000", 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023292399999999999 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.062430+0000", 2024-04-17T15:39:16.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013118747 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064257+0000", 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268959999999999 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064443+0000", 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018521499999999999 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064578+0000", 2024-04-17T15:39:16.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013511600000000001 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2289 3.36 e76/18 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.891326067000001, 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022085479000000002, 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071062+0000", 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2290000000000002e-06 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074727+0000", 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036655809999999998 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074765+0000", 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7778999999999999e-05 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074782+0000", 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246999999999999e-05 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074948+0000", 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016588900000000001 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075033+0000", 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4602000000000001e-05 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093017+0000", 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017984473000000001 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093145+0000", 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012767900000000001 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2290 3.5 3:a1064484:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.886460411000002, 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023102762999999998, 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.063 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2290 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075928+0000", 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080045+0000", 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041169969999999998 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080083+0000", 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7196000000000001e-05 2024-04-17T15:39:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080109+0000", 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6373e-05 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080259+0000", 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015042899999999999 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080519+0000", 2024-04-17T15:39:16.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025933100000000001 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080748+0000", 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022913100000000001 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.095782+0000", 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015033902 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098708+0000", 2024-04-17T15:39:16.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029261339999999999 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098890+0000", 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000182222 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.099028+0000", 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137575 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.068 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.069 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:16.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:16.070 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:16.070+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:16.170 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:16.169+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:16.189 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:39:16.248 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:16.248 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:16.248 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:16.248 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:16.263 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:16.311 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:16.314+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:16.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:16.380 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:16.381+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:16.390 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:16.390 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:16.390 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:16.390 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:16.391 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:16.406 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:16.473 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:16.473+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:16.481 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:16.482 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:16.497 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:16.498 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:16.528 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:16.555 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:16.555 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 134.32004647900001, 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.573 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5049.0:14 5.2 5:40000000::::head [pgnls start_epoch 71] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.271873069999998, 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065939630000000004, 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.580 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5049", 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2262844792", 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 14 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:16.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298292+0000", 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3700000000000002e-06 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298304+0000", 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1946999999999999e-05 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298324+0000", 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9959e-05 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298344+0000", 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0420000000000001e-05 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298487+0000", 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014289500000000001 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298497+0000", 2024-04-17T15:39:16.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.008e-05 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304538+0000", 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060409690000000002 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304605+0000", 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6632999999999997e-05 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304884+0000", 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027869 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 34.766704224999998, 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.585 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1807 4.20 4:07124e4f:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.902389321999998, 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066949260000000003, 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1807 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.591 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667776+0000", 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.43e-06 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667809+0000", 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3052999999999997e-05 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667846+0000", 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7478999999999998e-05 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667868+0000", 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1933000000000002e-05 2024-04-17T15:39:16.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.668039+0000", 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017102600000000001 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.668368+0000", 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032887999999999998 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.669608+0000", 2024-04-17T15:39:16.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001240306 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.671529+0000", 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019204929999999999 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674159+0000", 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026297159999999998 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674339+0000", 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018073500000000001 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674468+0000", 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128875 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2183 3.35 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:16.597 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.617069756999999, 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028592128000000001, 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2183 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953097+0000", 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2139999999999998e-06 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960326+0000", 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072287250000000001 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960458+0000", 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013165599999999999 2024-04-17T15:39:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960485+0000", 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7455999999999999e-05 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960672+0000", 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961101+0000", 2024-04-17T15:39:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042912000000000001 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961545+0000", 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044391599999999998 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.980369+0000", 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018824257 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981505+0000", 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011363339999999999 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981610+0000", 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104249 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981685+0000", 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5369000000000003e-05 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2187 3.20 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.571078315000001, 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020078048000000001, 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2187 2024-04-17T15:39:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999089+0000", 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6369999999999998e-06 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003407+0000", 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043177679999999996 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003446+0000", 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666999999999998e-05 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003473+0000", 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-05 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003668+0000", 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019524399999999999 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003925+0000", 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025612500000000001 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.004147+0000", 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222704 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014024+0000", 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098762980000000004 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.018985+0000", 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049610729999999999 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019082+0000", 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7758999999999997e-05 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019162+0000", 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0003e-05 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2200 3.1e e76/18 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.426304018, 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019523622000000001, 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2600000000000002e-07 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148444+0000", 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045848859999999998 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148482+0000", 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7975999999999997e-05 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148503+0000", 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0713e-05 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148684+0000", 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018094899999999999 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148752+0000", 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8325999999999996e-05 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163218+0000", 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014465660999999999 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163382+0000", 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016448499999999999 2024-04-17T15:39:16.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2203 3.33 e76/18 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.394488573, 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015459875999999999, 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.614 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175677+0000", 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1499999999999999e-06 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179688+0000", 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040107040000000004 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179724+0000", 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6165999999999999e-05 2024-04-17T15:39:16.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179742+0000", 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7669999999999999e-05 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179879+0000", 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137386 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179922+0000", 2024-04-17T15:39:16.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2472999999999998e-05 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.190989+0000", 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067367999999999 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.191134+0000", 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014495900000000001 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2209 3.36 3:6e4caeb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.335881176000001, 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028046186000000001, 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2209 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.619 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234287+0000", 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5160000000000002e-06 2024-04-17T15:39:16.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241867+0000", 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075797390000000003 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241907+0000", 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0401999999999997e-05 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241926+0000", 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9179999999999999e-05 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242060+0000", 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013408300000000001 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242320+0000", 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025917699999999998 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242624+0000", 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000304574 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.255662+0000", 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013038131 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262099+0000", 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064368660000000003 2024-04-17T15:39:16.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262247+0000", 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148202 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262328+0000", 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0315999999999995e-05 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2221 3.2c 3:3579995b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.214686385, 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022481615, 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2221 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355480+0000", 2024-04-17T15:39:16.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.58e-06 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360595+0000", 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051151290000000004 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360643+0000", 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8313999999999999e-05 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360667+0000", 2024-04-17T15:39:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4125e-05 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360807+0000", 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013905999999999999 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361054+0000", 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024716799999999998 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361268+0000", 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000214768 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.372233+0000", 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010965044 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377661+0000", 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054271830000000004 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377836+0000", 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017558100000000001 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377958+0000", 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121663 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2225 3.36 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.174029956999998, 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025820422999999999, 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2225 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396136+0000", 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2339999999999999e-06 2024-04-17T15:39:16.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400026+0000", 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038900950000000001 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400069+0000", 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2979999999999998e-05 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400093+0000", 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3896e-05 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400243+0000", 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015054599999999999 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400526+0000", 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000283007 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400800+0000", 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027318399999999999 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.411636+0000", 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01083604 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421617+0000", 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099808669999999992 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421810+0000", 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000193155 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421953+0000", 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014341899999999999 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2238 3.2e e76/18 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.036595555000002, 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017854851000000001, 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533568+0000", 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538745+0000", 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051771400000000002 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538791+0000", 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6196000000000003e-05 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538816+0000", 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5179999999999999e-05 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.539011+0000", 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019481500000000001 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.539076+0000", 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4735999999999998e-05 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551279+0000", 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012203208 2024-04-17T15:39:16.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551422+0000", 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143072 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2247 3.34 e76/18 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.938787896000001, 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030485694000000001, 2024-04-17T15:39:16.644 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631378+0000", 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0429999999999999e-06 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637843+0000", 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064650599999999999 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637892+0000", 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8899000000000001e-05 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637915+0000", 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2903000000000001e-05 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638070+0000", 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155289 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638133+0000", 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2955999999999998e-05 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661702+0000", 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023568782999999999 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661860+0000", 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015876099999999999 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2249 3.20 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.925188794, 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02987182, 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2249 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644979+0000", 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652360+0000", 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073812269999999998 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652401+0000", 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1316999999999998e-05 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652421+0000", 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9687e-05 2024-04-17T15:39:16.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652563+0000", 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014209499999999999 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652811+0000", 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024760400000000001 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.653043+0000", 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231998 2024-04-17T15:39:16.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667188+0000", 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014145342 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674671+0000", 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074827380000000001 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674769+0000", 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7838999999999996e-05 2024-04-17T15:39:16.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674846+0000", 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7072999999999999e-05 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2262 3.26 3:6636822f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.787827319000002, 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020197527, 2024-04-17T15:39:16.654 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2262 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782340+0000", 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3370000000000001e-06 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786395+0000", 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040552740000000002 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786450+0000", 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4846999999999999e-05 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786478+0000", 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.811e-05 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786621+0000", 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142798 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786898+0000", 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027743800000000002 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.787136+0000", 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.797168+0000", 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010032350000000001 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802156+0000", 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049883000000000002 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802329+0000", 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017284099999999999 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802533+0000", 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020359800000000001 2024-04-17T15:39:16.659 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2266 3.a 3:523a9b7a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.743425301999999, 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020319462, 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.660 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2266 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826740+0000", 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-06 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830715+0000", 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039743479999999999 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830753+0000", 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8192999999999998e-05 2024-04-17T15:39:16.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830771+0000", 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8139999999999999e-05 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830972+0000", 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201595 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831209+0000", 2024-04-17T15:39:16.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023676799999999999 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831439+0000", 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022980799999999999 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.845969+0000", 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014529553000000001 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846744+0000", 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077553300000000002 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846916+0000", 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171695 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.847057+0000", 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141049 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2269 3.a 3:53ae1501:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.714292458999999, 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019009920999999999, 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2269 2024-04-17T15:39:16.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855873+0000", 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8430000000000001e-06 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859856+0000", 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039826690000000003 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859893+0000", 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6974999999999998e-05 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859910+0000", 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6926999999999999e-05 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860041+0000", 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013170900000000001 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860311+0000", 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027012800000000001 2024-04-17T15:39:16.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860565+0000", 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025331699999999997 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873793+0000", 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013228439 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874705+0000", 2024-04-17T15:39:16.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00091167799999999997 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874800+0000", 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5032999999999996e-05 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874880+0000", 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0203000000000004e-05 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2270 3.1e e76/18 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.701076434000001, 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016422573999999999, 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869088+0000", 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9939999999999999e-06 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873478+0000", 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043902009999999998 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873514+0000", 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5525999999999998e-05 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873539+0000", 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5007e-05 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873713+0000", 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173585 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873773+0000", 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0166e-05 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.885357+0000", 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011583776 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.885509+0000", 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015231899999999999 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2289 3.36 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.505193014, 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028794229000000001, 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.676 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2289 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064974+0000", 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5800000000000002e-06 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069897+0000", 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049227460000000004 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069939+0000", 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2376999999999998e-05 2024-04-17T15:39:16.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069964+0000", 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5015999999999999e-05 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070150+0000", 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018596500000000001 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070583+0000", 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043244600000000001 2024-04-17T15:39:16.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070838+0000", 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000255491 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093151+0000", 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022312304000000002 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093505+0000", 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035477600000000001 2024-04-17T15:39:16.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093610+0000", 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010493300000000001 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093764+0000", 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153595 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.681 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2293 3.a 3:53332383:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.463567188999999, 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021728066000000001, 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2293 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106598+0000", 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7599999999999998e-06 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110394+0000", 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037959489999999999 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110433+0000", 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9289000000000003e-05 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110459+0000", 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.51e-05 2024-04-17T15:39:16.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110594+0000", 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013532299999999999 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110866+0000", 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027189100000000002 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.111110+0000", 2024-04-17T15:39:16.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024460999999999998 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.127108+0000", 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015997838 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128143+0000", 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001034791 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128245+0000", 2024-04-17T15:39:16.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101859 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128324+0000", 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8656e-05 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:16.687 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:16.688 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:16.689 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:16.689 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:16.690 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:16.690 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:16.690 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:16.690+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:16.691 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:16.691 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:16.692 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:16.790 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:16.789+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:16.862 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:16.863 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:16.877 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:16.923 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:16.926+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:17.004 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:17.004 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:17.005 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:17.006+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:17.018 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:17.106 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:17.106+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:17.179 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:17.179 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:17.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:17.240 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:17.241+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:17.307 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:17.306+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:17.316 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:17.329 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:17.408 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:17.410+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:17.492 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:17.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:17.508 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:17.510+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:17.609 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:17.610+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:17.624 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:17.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:17.710 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:17.710+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:17.765 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:17.766 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:17.779 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:17.824 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:17.825+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:17.908 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:17.909 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:17.911 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:17.909+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:17.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:18.013 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:18.014+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:18.090 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:18.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:18.113 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:18.114+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:18.209 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:39:18.214 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:18.214+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:18.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:18.324 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:18.325+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:18.411 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:18.416 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:18.418+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:18.425 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:18.518 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:18.518+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:18.580 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:18.595 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:18.640 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:18.641+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:18.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:18.710 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:18.720 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:18.722+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:18.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:18.821 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:18.822+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:18.830 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:18.830 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:18.847 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:18.865 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:18.865 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:18.886 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:18.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:18.902 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:18.902 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:18.921 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:18.921+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:18.922 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:18.922 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:18.943 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:18.963 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1193 3.2 3:413bc53d:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.185961634000002, 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014466954000000001, 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.012 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1193 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826587+0000", 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.826589+0000", 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9910000000000001e-06 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827645+0000", 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001055627 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827669+0000", 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4635e-05 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827679+0000", 2024-04-17T15:39:19.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9539999999999999e-06 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827770+0000", 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0934999999999996e-05 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.827938+0000", 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016818200000000001 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.828113+0000", 2024-04-17T15:39:19.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017488700000000001 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.832493+0000", 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004380264 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.840973+0000", 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084791999999999992 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841017+0000", 2024-04-17T15:39:19.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3967000000000001e-05 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.841054+0000", 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7311999999999998e-05 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:1195 3.b 3:d3ca1669:::5305729a-6754-489e-9706-ab50dfde728d.4412.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.163016335000002, 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017715149999999999, 2024-04-17T15:39:19.017 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 1195 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849532+0000", 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.849534+0000", 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0559999999999999e-06 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850786+0000", 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001251172 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850811+0000", 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5386000000000001e-05 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850821+0000", 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0285999999999999e-05 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.850905+0000", 2024-04-17T15:39:19.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3934e-05 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851097+0000", 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019139 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.851598+0000", 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00050139599999999998 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.864860+0000", 2024-04-17T15:39:19.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013262451999999999 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867151+0000", 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022904520000000001 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867197+0000", 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6313999999999997e-05 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:38.867247+0000", 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0312000000000002e-05 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2182 3.22 e75/18 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head v 75'1, mlcod=0'0)", 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.065643017999999, 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012030150999999999, 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946906+0000", 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.946908+0000", 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1629999999999999e-06 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951652+0000", 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0047438189999999998 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951684+0000", 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2317000000000002e-05 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951698+0000", 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.433e-05 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951794+0000", 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5482000000000005e-05 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.951811+0000", 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6799999999999998e-05 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958860+0000", 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070494169999999997 2024-04-17T15:39:19.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:51.958936+0000", 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5822999999999996e-05 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.883391924000001, 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.027 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.871616004, 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.033 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:39:19.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:39:19.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:39:19.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2203 3.33 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.839691350999999, 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018462655000000001, 2024-04-17T15:39:19.038 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2203 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172857+0000", 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.172860+0000", 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1219999999999999e-06 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175004+0000", 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021435209999999998 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175027+0000", 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2934000000000001e-05 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175040+0000", 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.332e-05 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175111+0000", 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1149000000000006e-05 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175220+0000", 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010859 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.175312+0000", 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2436999999999996e-05 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.189629+0000", 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014316194000000001 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191198+0000", 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001569778 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191265+0000", 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6231999999999999e-05 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.191320+0000", 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5377999999999997e-05 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2207 3.15 e76/18 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.793164540999999, 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016924775999999999, 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219384+0000", 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.219386+0000", 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8199999999999999e-06 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224735+0000", 2024-04-17T15:39:19.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053494229999999999 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224778+0000", 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2948000000000003e-05 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224793+0000", 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4576000000000001e-05 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224881+0000", 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8190999999999996e-05 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224914+0000", 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3095000000000001e-05 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236248+0000", 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01133339 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236309+0000", 2024-04-17T15:39:19.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1333000000000004e-05 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2211 3.29 3:972307fc:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.757833599000001, 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017874909000000001, 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.048 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2211 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254715+0000", 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.254718+0000", 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5620000000000002e-06 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256701+0000", 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019833300000000002 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256725+0000", 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4522e-05 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256739+0000", 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3393999999999999e-05 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256822+0000", 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3143e-05 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.256984+0000", 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016208499999999999 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:19.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.257103+0000", 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011872899999999999 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.265295+0000", 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081918749999999995 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272468+0000", 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071732649999999998 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272534+0000", 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5871999999999995e-05 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.272590+0000", 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6131999999999997e-05 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.429872330999999, 2024-04-17T15:39:19.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.058 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2250 3.19 e76/18 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head v 76'5, mlcod=76'3)", 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.354886800999999, 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016559072000000001, 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:19.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657662+0000", 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657665+0000", 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8119999999999999e-06 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659745+0000", 2024-04-17T15:39:19.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020804650000000001 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659779+0000", 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659795+0000", 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6888000000000002e-05 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659878+0000", 2024-04-17T15:39:19.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2454999999999996e-05 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.659908+0000", 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0204000000000001e-05 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674164+0000", 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014255465 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674221+0000", 2024-04-17T15:39:19.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7346999999999998e-05 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2253 3.7 3:e24db805:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.319756900000002, 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018614170999999999, 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.063 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2253 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692792+0000", 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692794+0000", 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4820000000000001e-06 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694460+0000", 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016656660000000001 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694492+0000", 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2036999999999998e-05 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694505+0000", 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3556e-05 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694627+0000", 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000121173 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.694819+0000", 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019235199999999999 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:19.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.695012+0000", 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019336000000000001 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.699362+0000", 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043500880000000002 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711319+0000", 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011956318000000001 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711368+0000", 2024-04-17T15:39:19.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9407000000000003e-05 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711406+0000", 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7731999999999997e-05 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.303228366999999, 2024-04-17T15:39:19.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.073 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2259 3.22 e76/18 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head v 76'3, mlcod=75'1)", 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.254303001, 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017962353, 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758246+0000", 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.758247+0000", 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.221e-06 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762255+0000", 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040082829999999996 2024-04-17T15:39:19.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762282+0000", 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.652e-05 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762293+0000", 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1392e-05 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762365+0000", 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1687000000000007e-05 2024-04-17T15:39:19.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.762384+0000", 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9749999999999999e-05 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776137+0000", 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013752795999999999 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.776208+0000", 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0704000000000006e-05 2024-04-17T15:39:19.077 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2260 3.23 e76/18 3:c7e72049:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_79:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.247891366000001, 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013120143000000001, 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764657+0000", 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.764658+0000", 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.92e-07 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767777+0000", 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003118689 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767801+0000", 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4383e-05 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767815+0000", 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3916e-05 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767901+0000", 2024-04-17T15:39:19.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5908000000000005e-05 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.767929+0000", 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8206000000000001e-05 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777717+0000", 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097883039999999994 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.777777+0000", 2024-04-17T15:39:19.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0044999999999999e-05 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2264 3.b 3:d1e91691:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.211181727, 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013508938, 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2264 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801367+0000", 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.801370+0000", 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1949999999999999e-06 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803362+0000", 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001991643 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803394+0000", 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1885999999999999e-05 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803410+0000", 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6487999999999999e-05 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803505+0000", 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4492000000000003e-05 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803653+0000", 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000148317 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.803772+0000", 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011948299999999999 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.809037+0000", 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.005264342 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814771+0000", 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057347159999999999 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814826+0000", 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4474000000000001e-05 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.814876+0000", 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9901999999999998e-05 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.087 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2270 3.1e 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.146124432000001, 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019292126999999999, 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2270 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:19.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866424+0000", 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.866427+0000", 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0010000000000002e-06 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868222+0000", 2024-04-17T15:39:19.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001794943 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868252+0000", 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9598999999999999e-05 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868267+0000", 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4803e-05 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868363+0000", 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6558000000000006e-05 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868548+0000", 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000185248 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.868719+0000", 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017112099999999999 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.875258+0000", 2024-04-17T15:39:19.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0065380389999999998 2024-04-17T15:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885590+0000", 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010332884000000001 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885659+0000", 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.885716+0000", 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7311000000000001e-05 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.094 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2273 3.7 3:e2b4eed0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.112935233999998, 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019105502, 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2273 2024-04-17T15:39:19.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899613+0000", 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.899616+0000", 2024-04-17T15:39:19.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901220+0000", 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016033180000000001 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901253+0000", 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2848000000000001e-05 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901268+0000", 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673999999999999e-05 2024-04-17T15:39:19.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901424+0000", 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015542999999999999 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901580+0000", 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000156324 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.901726+0000", 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000145971 2024-04-17T15:39:19.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.906593+0000", 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004866586 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918592+0000", 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01199968 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918664+0000", 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1495000000000006e-05 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.918719+0000", 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5071999999999997e-05 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2274 3.27 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.102916415999999, 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020003305999999998, 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2274 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909632+0000", 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.909635+0000", 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3760000000000002e-06 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911097+0000", 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001462765 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911130+0000", 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2876000000000002e-05 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911148+0000", 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7337e-05 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911236+0000", 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8010000000000006e-05 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911396+0000", 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160808 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.911543+0000", 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000146584 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.920092+0000", 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085487510000000003 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929554+0000", 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094618759999999993 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929594+0000", 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0136999999999999e-05 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.929636+0000", 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1786000000000003e-05 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2276 3.2 3:413eb100:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.105 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.081256499999999, 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020329113999999999, 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2276 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931295+0000", 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6189999999999998e-06 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936287+0000", 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049920559999999999 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936310+0000", 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3538000000000001e-05 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936322+0000", 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1739000000000001e-05 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936395+0000", 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2521000000000006e-05 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936512+0000", 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117872 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936622+0000", 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010926599999999999 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942455+0000", 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058337099999999998 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951496+0000", 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090407899999999999 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951571+0000", 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4361000000000002e-05 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951621+0000", 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0642000000000001e-05 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2282 3.38 3:1e5bbe9d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.018816007000002, 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017690014, 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:19.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2282 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993733+0000", 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:19.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.993736+0000", 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3289999999999998e-06 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995029+0000", 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001292898 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995064+0000", 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5508e-05 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995080+0000", 2024-04-17T15:39:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5673000000000001e-05 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995183+0000", 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010299200000000001 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995325+0000", 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014212799999999999 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.995421+0000", 2024-04-17T15:39:19.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5630000000000004e-05 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.001610+0000", 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0061888680000000001 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011284+0000", 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096739470000000004 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011359+0000", 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5210999999999995e-05 2024-04-17T15:39:19.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:53.011423+0000", 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3830000000000004e-05 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:19.116 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:19.118 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:19.118 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:19.117+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:19.219 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:19.222+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:19.256 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:19.256 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:19.256 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:19.256 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:19.270 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:39:19.355 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:19.358+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:19.421 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:19.422+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:19.438 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:19.438 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:19.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:19.539 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:19.542+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:19.623 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:19.621+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:19.625 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:19.625 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:19.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.801925076000003, 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.626 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:19.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.647747320000001, 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:39:19.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.635410827000001, 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.636 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:39:19.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:39:19.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:39:19.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2189 3.3 3:c1edeb6a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.602770479, 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016969445, 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.642 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2189 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021610+0000", 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9100000000000001e-06 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025660+0000", 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040499380000000003 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025706+0000", 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5914999999999997e-05 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025736+0000", 2024-04-17T15:39:19.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9913999999999999e-05 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025872+0000", 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013620900000000001 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026163+0000", 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029049300000000001 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026449+0000", 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028624500000000002 2024-04-17T15:39:19.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.033587+0000", 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071378650000000002 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047364709999999999 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038462+0000", 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138746 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038577+0000", 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114739 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2190 3.9 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:19.647 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.590108673, 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018014220000000001, 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2190 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034272+0000", 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-06 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040506539999999999 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038348+0000", 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5086999999999999e-05 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038382+0000", 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4816e-05 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038551+0000", 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016887799999999999 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038804+0000", 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000253088 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.039021+0000", 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021690199999999999 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051114+0000", 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012092284999999999 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051953+0000", 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083926200000000002 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052131+0000", 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017803900000000001 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052283+0000", 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:39:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.554374034999999, 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:39:19.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2195 3.f e76/18 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.529807901000002, 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016421760000000001, 2024-04-17T15:39:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094572+0000", 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2400000000000002e-06 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097267+0000", 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002694686 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097306+0000", 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9428999999999998e-05 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097329+0000", 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2327000000000002e-05 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097508+0000", 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017951499999999999 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097578+0000", 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9865999999999998e-05 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110805+0000", 2024-04-17T15:39:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013226628000000001 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110992+0000", 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018706899999999999 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2208 3.1b e76/18 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.397483193999999, 2024-04-17T15:39:19.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018441939000000001, 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:19.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226898+0000", 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9469999999999999e-06 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231882+0000", 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049839719999999997 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231919+0000", 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6983000000000001e-05 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231936+0000", 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7099999999999999e-05 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232092+0000", 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000156448 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232133+0000", 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0917000000000001e-05 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245213+0000", 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013079456 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245337+0000", 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012411599999999999 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.666 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2210 3.9 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.379796462000002, 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021814205, 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2210 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.667 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244585+0000", 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8199999999999998e-06 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248808+0000", 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004222689 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248846+0000", 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8062999999999998e-05 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248866+0000", 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0443000000000001e-05 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249007+0000", 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014065200000000001 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249351+0000", 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034406699999999998 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249759+0000", 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040812900000000002 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.261660+0000", 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011900834000000001 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266158+0000", 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044976039999999997 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266264+0000", 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106179 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266396+0000", 2024-04-17T15:39:19.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013172499999999999 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2220 3.9 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.278179843, 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017714483999999999, 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2220 2024-04-17T15:39:19.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346202+0000", 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351067+0000", 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048656560000000003 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351104+0000", 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6860000000000003e-05 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351123+0000", 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8828999999999999e-05 2024-04-17T15:39:19.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351295+0000", 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017146300000000001 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351709+0000", 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041460899999999997 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.352146+0000", 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043721299999999999 2024-04-17T15:39:19.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360734+0000", 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085879530000000006 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363590+0000", 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028559840000000002 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363764+0000", 2024-04-17T15:39:19.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017367899999999999 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363913+0000", 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148555 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2239 3.1a 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.081848631, 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02117043, 2024-04-17T15:39:19.677 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2239 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542533+0000", 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1459999999999998e-06 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547455+0000", 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049219700000000003 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547505+0000", 2024-04-17T15:39:19.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9094999999999997e-05 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547533+0000", 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.813e-05 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547687+0000", 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015475600000000001 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547958+0000", 2024-04-17T15:39:19.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027019000000000001 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.548202+0000", 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244615 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.557187+0000", 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0089846390000000009 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563517+0000", 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063303439999999999 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563622+0000", 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104652 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563700+0000", 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7892999999999994e-05 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.682 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2242 3.f e76/18 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.040336492000002, 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016600970999999999, 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584044+0000", 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.016e-06 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587806+0000", 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037613199999999999 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587849+0000", 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3189999999999998e-05 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587867+0000", 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588016+0000", 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014827800000000001 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588060+0000", 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4523e-05 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600492+0000", 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012432145 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600642+0000", 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149999 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.686 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2246 3.3 3:c10f4bfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.008815607999999, 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022677520999999999, 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.687 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2246 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615601+0000", 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8197e-05 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623411+0000", 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007810773 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623455+0000", 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3263999999999998e-05 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623474+0000", 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9366000000000001e-05 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623637+0000", 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016321200000000001 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623894+0000", 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025645799999999999 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.624163+0000", 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026971999999999999 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.636351+0000", 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012188094 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637944+0000", 2024-04-17T15:39:19.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001592263 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638115+0000", 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017097799999999999 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638240+0000", 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125196 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.997895172, 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.693 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:39:19.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:39:19.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.984437262, 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:39:19.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:39:19.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2251 3.1a 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.957320686999999, 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016964861000000001, 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2251 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667059+0000", 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.670968+0000", 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039089800000000003 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671001+0000", 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2456000000000002e-05 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671015+0000", 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4432e-05 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671184+0000", 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016877799999999999 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671605+0000", 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000420846 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.672016+0000", 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041139600000000002 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.682956+0000", 2024-04-17T15:39:19.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010939285999999999 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683731+0000", 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077576999999999995 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683903+0000", 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017203800000000001 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.684022+0000", 2024-04-17T15:39:19.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011863599999999999 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2254 3.11 e76/18 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.916657355000002, 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019675885000000001, 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707724+0000", 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7129999999999999e-06 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711670+0000", 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039457720000000002 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711712+0000", 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.214e-05 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711734+0000", 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2158999999999999e-05 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711887+0000", 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253900000000001 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711952+0000", 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5173999999999996e-05 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727265+0000", 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015312622 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727396+0000", 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013176600000000001 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.714 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2256 3.24 e76/45 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.904261228999999, 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016800223, 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:19.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720119+0000", 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725518+0000", 2024-04-17T15:39:19.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053986549999999996 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725564+0000", 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6202999999999998e-05 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725590+0000", 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5982999999999998e-05 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725761+0000", 2024-04-17T15:39:19.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017110500000000001 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725813+0000", 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1922999999999997e-05 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736772+0000", 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010959365 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736917+0000", 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014473200000000001 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2274 3.27 e76/18 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.71246803, 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017285802999999999, 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911912+0000", 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916353+0000", 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004441164 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916389+0000", 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5916e-05 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916408+0000", 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8539999999999999e-05 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916559+0000", 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015148200000000001 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916621+0000", 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1651999999999999e-05 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929024+0000", 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012403529999999999 2024-04-17T15:39:19.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929196+0000", 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171392 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2283 3.1c e76/18 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.614409345999999, 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021912134, 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:19.723 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:19.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009971+0000", 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8899999999999999e-06 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013348+0000", 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033769429999999999 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013391+0000", 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2339999999999998e-05 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:19.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013409+0000", 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8502999999999999e-05 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013548+0000", 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138422 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013591+0000", 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.375e-05 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031701+0000", 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018109600999999999 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031881+0000", 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017968500000000001 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:19.727 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:19.728 INFO:tasks.workunit.client.0.smithi044.stdout:quota enabled for the bucket: buck_2024_03_17_15_39_15 2024-04-17T15:39:19.728 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 2Gb. 2024-04-17T15:39:19.728 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:39:19.728 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-04-17T15:39:19.729 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:39:19.729 INFO:tasks.workunit.client.0.smithi044.stdout:delete objects successful 2024-04-17T15:39:19.730 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:19.730 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:19.730+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:19.829 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:19.830+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:19.904 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:19.905 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:19.919 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:19.930 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:19.929+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:20.031 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:20.029+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:20.092 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:20.092 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:20.092 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:20.092 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:20.092 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:20.106 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:20.132 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:20.133+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2182 3.22 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.292137375999999, 2024-04-17T15:39:20.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020945306, 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2182 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940490+0000", 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946030+0000", 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055396229999999996 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946069+0000", 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9919999999999997e-05 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946095+0000", 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5769999999999999e-05 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946290+0000", 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019428800000000001 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946583+0000", 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029335100000000002 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946819+0000", 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023653699999999999 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960915+0000", 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014095721 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961184+0000", 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026861799999999998 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961321+0000", 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013719200000000001 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961432+0000", 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111146 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.240 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2183 3.35 e75/18 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head v 75'2, mlcod=0'0)", 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.270836616, 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019360209, 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.241 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.242 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:20.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:20.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961789+0000", 2024-04-17T15:39:20.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.513e-06 2024-04-17T15:39:20.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964955+0000", 2024-04-17T15:39:20.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031659840000000002 2024-04-17T15:39:20.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964994+0000", 2024-04-17T15:39:20.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8957e-05 2024-04-17T15:39:20.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965011+0000", 2024-04-17T15:39:20.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6653000000000001e-05 2024-04-17T15:39:20.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965297+0000", 2024-04-17T15:39:20.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028633100000000002 2024-04-17T15:39:20.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965364+0000", 2024-04-17T15:39:20.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6768999999999997e-05 2024-04-17T15:39:20.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981015+0000", 2024-04-17T15:39:20.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015651457000000001 2024-04-17T15:39:20.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981148+0000", 2024-04-17T15:39:20.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132545 2024-04-17T15:39:20.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.249 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.250 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2188 3.c 3:316225b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.250 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:20.250 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.221564004000001, 2024-04-17T15:39:20.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018633493000000001, 2024-04-17T15:39:20.251 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.251 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.251 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.251 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.251 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.251 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.251 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2188 2024-04-17T15:39:20.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.252 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:20.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:20.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011064+0000", 2024-04-17T15:39:20.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8870000000000002e-06 2024-04-17T15:39:20.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015212+0000", 2024-04-17T15:39:20.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041482259999999996 2024-04-17T15:39:20.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015252+0000", 2024-04-17T15:39:20.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9836000000000003e-05 2024-04-17T15:39:20.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015271+0000", 2024-04-17T15:39:20.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8980000000000001e-05 2024-04-17T15:39:20.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015408+0000", 2024-04-17T15:39:20.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013688900000000001 2024-04-17T15:39:20.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015665+0000", 2024-04-17T15:39:20.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256968 2024-04-17T15:39:20.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:20.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015903+0000", 2024-04-17T15:39:20.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:20.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.028073+0000", 2024-04-17T15:39:20.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012170728 2024-04-17T15:39:20.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029386+0000", 2024-04-17T15:39:20.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001312725 2024-04-17T15:39:20.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029539+0000", 2024-04-17T15:39:20.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015330899999999999 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029694+0000", 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015431099999999999 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.263 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2198 3.3a 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.263 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:20.263 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.115575930999999, 2024-04-17T15:39:20.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026029244, 2024-04-17T15:39:20.263 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.263 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.263 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2198 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:20.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:20.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117051+0000", 2024-04-17T15:39:20.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9059999999999998e-06 2024-04-17T15:39:20.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121284+0000", 2024-04-17T15:39:20.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042323589999999998 2024-04-17T15:39:20.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121335+0000", 2024-04-17T15:39:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1643e-05 2024-04-17T15:39:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121362+0000", 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6650000000000001e-05 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121586+0000", 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223928 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122021+0000", 2024-04-17T15:39:20.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043530199999999999 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122505+0000", 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048423599999999998 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.134629+0000", 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012124118 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142907+0000", 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082773959999999994 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142998+0000", 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0828999999999994e-05 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143077+0000", 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9876999999999994e-05 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.270 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2202 3.30 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.068875335000001, 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023532595999999999, 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2202 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.271 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163753+0000", 2024-04-17T15:39:20.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9700000000000001e-06 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168372+0000", 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004618942 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168415+0000", 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3272000000000002e-05 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168433+0000", 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8196999999999999e-05 2024-04-17T15:39:20.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168572+0000", 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013865500000000001 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168828+0000", 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256328 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.169055+0000", 2024-04-17T15:39:20.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000226331 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.176874+0000", 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078199310000000005 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.186974+0000", 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010100012 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187144+0000", 2024-04-17T15:39:20.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016979899999999999 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187281+0000", 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013715900000000001 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2204 3.1c 3:3aa83ff5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:20.276 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.046969935, 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019530355999999999, 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2204 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185657+0000", 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2569999999999999e-06 2024-04-17T15:39:20.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188693+0000", 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003035163 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188721+0000", 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8002999999999999e-05 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188736+0000", 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5829999999999999e-05 2024-04-17T15:39:20.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188856+0000", 2024-04-17T15:39:20.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119376 2024-04-17T15:39:20.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189095+0000", 2024-04-17T15:39:20.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023956100000000001 2024-04-17T15:39:20.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:20.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189320+0000", 2024-04-17T15:39:20.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000224121 2024-04-17T15:39:20.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.198523+0000", 2024-04-17T15:39:20.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092036619999999996 2024-04-17T15:39:20.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.204907+0000", 2024-04-17T15:39:20.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063834520000000004 2024-04-17T15:39:20.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205027+0000", 2024-04-17T15:39:20.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050200000000001 2024-04-17T15:39:20.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205185+0000", 2024-04-17T15:39:20.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157429 2024-04-17T15:39:20.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.284 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.285 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2206 3.2a 3:554687e0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.285 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:20.285 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.027479109000002, 2024-04-17T15:39:20.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029258256, 2024-04-17T15:39:20.285 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2206 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:20.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:20.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205148+0000", 2024-04-17T15:39:20.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6900000000000001e-06 2024-04-17T15:39:20.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211713+0000", 2024-04-17T15:39:20.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065654110000000002 2024-04-17T15:39:20.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211744+0000", 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1232999999999997e-05 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211761+0000", 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6994e-05 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211928+0000", 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166195 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212314+0000", 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000385993 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212704+0000", 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039051 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.223772+0000", 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067521 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234062+0000", 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010289918 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234240+0000", 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000178302 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234403+0000", 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016348900000000001 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2212 3.28 3:1630d003:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.966638193000001, 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019714803999999999, 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.293 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2212 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266001+0000", 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5427e-05 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272057+0000", 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060554090000000003 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272098+0000", 2024-04-17T15:39:20.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.155e-05 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272117+0000", 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9127000000000002e-05 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272317+0000", 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019985099999999999 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272712+0000", 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039508000000000002 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.273099+0000", 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038697299999999998 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.284174+0000", 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011074218 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285528+0000", 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013542840000000001 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285623+0000", 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5563000000000006e-05 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285701+0000", 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7322000000000003e-05 2024-04-17T15:39:20.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2225 3.36 e76/18 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.831560663000001, 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020106353, 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:20.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401067+0000", 2024-04-17T15:39:20.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2200000000000001e-06 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404215+0000", 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031480280000000002 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404253+0000", 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8303999999999998e-05 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404277+0000", 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4428999999999999e-05 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404428+0000", 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150402 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404496+0000", 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8120000000000005e-05 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421035+0000", 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016538517999999999 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421170+0000", 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135332 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.303 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2226 3.28 3:152ad80f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.827362647000001, 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018476241000000001, 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2226 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405265+0000", 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3069999999999998e-06 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409520+0000", 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042551409999999996 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409566+0000", 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5596000000000002e-05 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409592+0000", 2024-04-17T15:39:20.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6186999999999998e-05 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409755+0000", 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000163435 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.410051+0000", 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000296221 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.410294+0000", 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000242704 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.418835+0000", 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085410869999999993 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423420+0000", 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004584996 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423609+0000", 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018851499999999999 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423738+0000", 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129052 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2230 3.3a 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.783648380999999, 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025252924, 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.310 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2230 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448979+0000", 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454011+0000", 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050315719999999998 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454055+0000", 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4382999999999998e-05 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454075+0000", 2024-04-17T15:39:20.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0046000000000001e-05 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454276+0000", 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020055800000000001 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454721+0000", 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044527599999999998 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.455157+0000", 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043578999999999997 2024-04-17T15:39:20.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.465942+0000", 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010784936 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474050+0000", 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081079250000000002 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474144+0000", 2024-04-17T15:39:20.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4479000000000001e-05 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474229+0000", 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4486000000000004e-05 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2237 3.2a 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.709940320000001, 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028581945000000001, 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.315 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2237 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522688+0000", 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5260000000000004e-06 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526833+0000", 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004144427 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526875+0000", 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1715999999999998e-05 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526894+0000", 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9307e-05 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527045+0000", 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151201 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527303+0000", 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025805199999999999 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527546+0000", 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024263099999999999 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.543539+0000", 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015993657000000001 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550954+0000", 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074142239999999996 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551129+0000", 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017543100000000001 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551266+0000", 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136773 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2243 3.2 e76/18 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.646456524000001, 2024-04-17T15:39:20.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019774896, 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586171+0000", 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2430000000000001e-06 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592943+0000", 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067716190000000004 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592982+0000", 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9133e-05 2024-04-17T15:39:20.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593000+0000", 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.872e-05 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593167+0000", 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016682200000000001 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593212+0000", 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5262999999999997e-05 2024-04-17T15:39:20.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605840+0000", 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012627714 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605943+0000", 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102382 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2248 3.1c 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.597723512999998, 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028561188000000001, 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2248 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634905+0000", 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6530000000000002e-06 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638983+0000", 2024-04-17T15:39:20.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040774130000000002 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639023+0000", 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0703e-05 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639048+0000", 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4437e-05 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639211+0000", 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016346500000000001 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639455+0000", 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243324 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639679+0000", 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223935 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661540+0000", 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021861068000000001 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663140+0000", 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016003860000000001 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663326+0000", 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018592500000000001 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663462+0000", 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013587899999999999 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2259 3.22 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.479203619, 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023533335999999998, 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.332 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2259 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:20.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753424+0000", 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5669999999999999e-06 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757463+0000", 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040386470000000002 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757507+0000", 2024-04-17T15:39:20.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4393e-05 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757537+0000", 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9473000000000001e-05 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757736+0000", 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019940800000000001 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757980+0000", 2024-04-17T15:39:20.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244398 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.758213+0000", 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023253799999999999 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.766682+0000", 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084694950000000005 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776706+0000", 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010023676 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776825+0000", 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118396 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776954+0000", 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129345 2024-04-17T15:39:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2275 3.3c 3:3dedeaf1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.309699981000001, 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019151476000000001, 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.338 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2275 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:20.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922928+0000", 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6940000000000001e-06 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926921+0000", 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039930369999999996 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926965+0000", 2024-04-17T15:39:20.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4397000000000002e-05 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926985+0000", 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9488999999999999e-05 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927169+0000", 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018456500000000001 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927447+0000", 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027765100000000002 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927707+0000", 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026028800000000001 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.936871+0000", 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091640409999999995 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.941911+0000", 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050392379999999997 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942004+0000", 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3763000000000003e-05 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942076+0000", 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1313e-05 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.343 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2283 3.1c 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.228417854, 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028433096000000001, 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2283 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.344 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004210+0000", 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2770000000000001e-06 2024-04-17T15:39:20.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008596+0000", 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043866770000000003 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008636+0000", 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9767000000000001e-05 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008655+0000", 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9083e-05 2024-04-17T15:39:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008831+0000", 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017611100000000001 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009255+0000", 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042393699999999999 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:20.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009704+0000", 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044862299999999999 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.029616+0000", 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019912474999999999 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032482+0000", 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028657439999999999 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032575+0000", 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3146000000000006e-05 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032639+0000", 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4256000000000003e-05 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2287 3.1c 3:3a30054e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.188153939999999, 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020107487, 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2287 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.350 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044473+0000", 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:39:20.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048619+0000", 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041462959999999998 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048657+0000", 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7911999999999999e-05 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048681+0000", 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3873999999999999e-05 2024-04-17T15:39:20.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048815+0000", 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000133869 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049079+0000", 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026408099999999999 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049312+0000", 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023292399999999999 2024-04-17T15:39:20.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.062430+0000", 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013118747 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064257+0000", 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268959999999999 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064443+0000", 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018521499999999999 2024-04-17T15:39:20.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064578+0000", 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013511600000000001 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2289 3.36 e76/18 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.161564856999998, 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022085479000000002, 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071062+0000", 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2290000000000002e-06 2024-04-17T15:39:20.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074727+0000", 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036655809999999998 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074765+0000", 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7778999999999999e-05 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074782+0000", 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246999999999999e-05 2024-04-17T15:39:20.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074948+0000", 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016588900000000001 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075033+0000", 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4602000000000001e-05 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093017+0000", 2024-04-17T15:39:20.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017984473000000001 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093145+0000", 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012767900000000001 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2290 3.5 3:a1064484:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.156699200999999, 2024-04-17T15:39:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023102762999999998, 2024-04-17T15:39:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.360 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2290 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.362 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:20.234+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075928+0000", 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080045+0000", 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041169969999999998 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080083+0000", 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7196000000000001e-05 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080109+0000", 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6373e-05 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080259+0000", 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015042899999999999 2024-04-17T15:39:20.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080519+0000", 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025933100000000001 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080748+0000", 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022913100000000001 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.095782+0000", 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015033902 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098708+0000", 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029261339999999999 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098890+0000", 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000182222 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.099028+0000", 2024-04-17T15:39:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137575 2024-04-17T15:39:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.368 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.368 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:20.368 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:20.370 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:20.369+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:20.470 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:20.470+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:20.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:20.599 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:20.602+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:20.672 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:20.674+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:20.728 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:20.728 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:20.728 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:20.728 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:20.728 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:20.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:20.773 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:20.773+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:20.874 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:20.873+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 138.66468669099999, 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:39:20.916 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:39:20.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:39:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:39:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:39:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5049.0:14 5.2 5:40000000::::head [pgnls start_epoch 71] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.616513282, 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065939630000000004, 2024-04-17T15:39:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5049", 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2262844792", 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 14 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298292+0000", 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3700000000000002e-06 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298304+0000", 2024-04-17T15:39:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1946999999999999e-05 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298324+0000", 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9959e-05 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298344+0000", 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0420000000000001e-05 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298487+0000", 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014289500000000001 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298497+0000", 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.008e-05 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304538+0000", 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060409690000000002 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304605+0000", 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6632999999999997e-05 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304884+0000", 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027869 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.111344437, 2024-04-17T15:39:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:39:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1807 4.20 4:07124e4f:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.247029533999999, 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066949260000000003, 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1807 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667776+0000", 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.43e-06 2024-04-17T15:39:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667809+0000", 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3052999999999997e-05 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667846+0000", 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7478999999999998e-05 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667868+0000", 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1933000000000002e-05 2024-04-17T15:39:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.668039+0000", 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017102600000000001 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.668368+0000", 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032887999999999998 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.669608+0000", 2024-04-17T15:39:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001240306 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.671529+0000", 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019204929999999999 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674159+0000", 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026297159999999998 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674339+0000", 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018073500000000001 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674468+0000", 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128875 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2183 3.35 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.961709969000001, 2024-04-17T15:39:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028592128000000001, 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2183 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953097+0000", 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2139999999999998e-06 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960326+0000", 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072287250000000001 2024-04-17T15:39:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960458+0000", 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013165599999999999 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960485+0000", 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7455999999999999e-05 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960672+0000", 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:39:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961101+0000", 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042912000000000001 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961545+0000", 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044391599999999998 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.980369+0000", 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018824257 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981505+0000", 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011363339999999999 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981610+0000", 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104249 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981685+0000", 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5369000000000003e-05 2024-04-17T15:39:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2187 3.20 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.915718526999999, 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020078048000000001, 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2187 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999089+0000", 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6369999999999998e-06 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003407+0000", 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043177679999999996 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003446+0000", 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666999999999998e-05 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003473+0000", 2024-04-17T15:39:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-05 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003668+0000", 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019524399999999999 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003925+0000", 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025612500000000001 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.004147+0000", 2024-04-17T15:39:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222704 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014024+0000", 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098762980000000004 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.018985+0000", 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049610729999999999 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019082+0000", 2024-04-17T15:39:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7758999999999997e-05 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019162+0000", 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0003e-05 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2200 3.1e e76/18 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.770944230000001, 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019523622000000001, 2024-04-17T15:39:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2600000000000002e-07 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148444+0000", 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045848859999999998 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148482+0000", 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7975999999999997e-05 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148503+0000", 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0713e-05 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148684+0000", 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018094899999999999 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148752+0000", 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8325999999999996e-05 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163218+0000", 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014465660999999999 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163382+0000", 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016448499999999999 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2203 3.33 e76/18 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.739128784999998, 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015459875999999999, 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175677+0000", 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1499999999999999e-06 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179688+0000", 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040107040000000004 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179724+0000", 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6165999999999999e-05 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179742+0000", 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7669999999999999e-05 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179879+0000", 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137386 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179922+0000", 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2472999999999998e-05 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.190989+0000", 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067367999999999 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.191134+0000", 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014495900000000001 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2209 3.36 3:6e4caeb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.680521387999999, 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028046186000000001, 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2209 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234287+0000", 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5160000000000002e-06 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241867+0000", 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075797390000000003 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241907+0000", 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0401999999999997e-05 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241926+0000", 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9179999999999999e-05 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242060+0000", 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013408300000000001 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242320+0000", 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025917699999999998 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242624+0000", 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000304574 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.255662+0000", 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013038131 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262099+0000", 2024-04-17T15:39:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064368660000000003 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262247+0000", 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148202 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262328+0000", 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0315999999999995e-05 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2221 3.2c 3:3579995b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.559326596999998, 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022481615, 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2221 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355480+0000", 2024-04-17T15:39:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.58e-06 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360595+0000", 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051151290000000004 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360643+0000", 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8313999999999999e-05 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360667+0000", 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4125e-05 2024-04-17T15:39:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360807+0000", 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013905999999999999 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361054+0000", 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024716799999999998 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361268+0000", 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000214768 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.372233+0000", 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010965044 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377661+0000", 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054271830000000004 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377836+0000", 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017558100000000001 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377958+0000", 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121663 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2225 3.36 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.518670169, 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025820422999999999, 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2225 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396136+0000", 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2339999999999999e-06 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400026+0000", 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038900950000000001 2024-04-17T15:39:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400069+0000", 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2979999999999998e-05 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400093+0000", 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3896e-05 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400243+0000", 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015054599999999999 2024-04-17T15:39:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400526+0000", 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000283007 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400800+0000", 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027318399999999999 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.411636+0000", 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01083604 2024-04-17T15:39:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421617+0000", 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099808669999999992 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421810+0000", 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000193155 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421953+0000", 2024-04-17T15:39:20.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014341899999999999 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2238 3.2e e76/18 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.381235767, 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017854851000000001, 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533568+0000", 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538745+0000", 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051771400000000002 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538791+0000", 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6196000000000003e-05 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538816+0000", 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5179999999999999e-05 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.539011+0000", 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019481500000000001 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.539076+0000", 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4735999999999998e-05 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551279+0000", 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012203208 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551422+0000", 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143072 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2247 3.34 e76/18 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.283428107999999, 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030485694000000001, 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.982 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631378+0000", 2024-04-17T15:39:20.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0429999999999999e-06 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637843+0000", 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064650599999999999 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637892+0000", 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8899000000000001e-05 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637915+0000", 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2903000000000001e-05 2024-04-17T15:39:20.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638070+0000", 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155289 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638133+0000", 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2955999999999998e-05 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661702+0000", 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023568782999999999 2024-04-17T15:39:20.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661860+0000", 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015876099999999999 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2249 3.20 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.269829005999998, 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02987182, 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2249 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644979+0000", 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652360+0000", 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073812269999999998 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652401+0000", 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1316999999999998e-05 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652421+0000", 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9687e-05 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652563+0000", 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014209499999999999 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652811+0000", 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024760400000000001 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.653043+0000", 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231998 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667188+0000", 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014145342 2024-04-17T15:39:20.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674671+0000", 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074827380000000001 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674769+0000", 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7838999999999996e-05 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674846+0000", 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7072999999999999e-05 2024-04-17T15:39:20.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2262 3.26 3:6636822f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.132467531, 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020197527, 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.992 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2262 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782340+0000", 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3370000000000001e-06 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786395+0000", 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040552740000000002 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786450+0000", 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4846999999999999e-05 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786478+0000", 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.811e-05 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786621+0000", 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142798 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786898+0000", 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027743800000000002 2024-04-17T15:39:20.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.787136+0000", 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.797168+0000", 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010032350000000001 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802156+0000", 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049883000000000002 2024-04-17T15:39:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802329+0000", 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017284099999999999 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802533+0000", 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020359800000000001 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2266 3.a 3:523a9b7a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.088065514, 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020319462, 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2266 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:20.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826740+0000", 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-06 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:20.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830715+0000", 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039743479999999999 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830753+0000", 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8192999999999998e-05 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830771+0000", 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8139999999999999e-05 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:21.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830972+0000", 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201595 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831209+0000", 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023676799999999999 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831439+0000", 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022980799999999999 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:21.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.845969+0000", 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014529553000000001 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846744+0000", 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077553300000000002 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846916+0000", 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171695 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.847057+0000", 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141049 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2269 3.a 3:53ae1501:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.058932671000001, 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019009920999999999, 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:21.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2269 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855873+0000", 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8430000000000001e-06 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859856+0000", 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039826690000000003 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859893+0000", 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6974999999999998e-05 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859910+0000", 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6926999999999999e-05 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860041+0000", 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013170900000000001 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860311+0000", 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027012800000000001 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860565+0000", 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025331699999999997 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873793+0000", 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013228439 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874705+0000", 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00091167799999999997 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874800+0000", 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5032999999999996e-05 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874880+0000", 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0203000000000004e-05 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2270 3.1e e76/18 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:21.008 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.045716645999999, 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016422573999999999, 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:21.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869088+0000", 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9939999999999999e-06 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873478+0000", 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043902009999999998 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873514+0000", 2024-04-17T15:39:21.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5525999999999998e-05 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873539+0000", 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5007e-05 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873713+0000", 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173585 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:21.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873773+0000", 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0166e-05 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.885357+0000", 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011583776 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.885509+0000", 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015231899999999999 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2289 3.36 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.849833226000001, 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028794229000000001, 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2289 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064974+0000", 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5800000000000002e-06 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069897+0000", 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049227460000000004 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069939+0000", 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2376999999999998e-05 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069964+0000", 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5015999999999999e-05 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070150+0000", 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018596500000000001 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070583+0000", 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043244600000000001 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070838+0000", 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000255491 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093151+0000", 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022312304000000002 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093505+0000", 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035477600000000001 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093610+0000", 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010493300000000001 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093764+0000", 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153595 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2293 3.a 3:53332383:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.808207401000001, 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021728066000000001, 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:21.018 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2293 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:21.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106598+0000", 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7599999999999998e-06 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110394+0000", 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037959489999999999 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110433+0000", 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9289000000000003e-05 2024-04-17T15:39:21.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110459+0000", 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.51e-05 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110594+0000", 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013532299999999999 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110866+0000", 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027189100000000002 2024-04-17T15:39:21.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.111110+0000", 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024460999999999998 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.127108+0000", 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015997838 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:21.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128143+0000", 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001034791 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128245+0000", 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101859 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128324+0000", 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8656e-05 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:21.023 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:21.024 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:21.024 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:21.025 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:21.026 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:21.025+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:21.126 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:21.125+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:21.157 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:21.157 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:21.157 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:21.172 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:21.188 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:21.204 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:21.204 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:21.221 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:21.221 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:21.226 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:21.226+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:21.237 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:21.238 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:21.255 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:21.256 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:21.276 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:21.276 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:21.293 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:21.294 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:21.294 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:21.297 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:21.297 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:21.308 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:21.316 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:21.327 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:21.325+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:21.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:39:21.428 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:21.429+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:21.474 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:21.474 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:21.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:21.530 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:21.530+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:21.614 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:21.628 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:21.630 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:21.630+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:21.731 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:21.734+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:21.758 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:21.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:21.832 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:21.834+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:21.894 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:21.894 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:21.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:21.934 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:21.934+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:22.034 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:22.035 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:22.035 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:22.033+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:22.049 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:22.140 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:22.141+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:22.218 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:22.219 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:22.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:22.276 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:22.277+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:22.338 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:22.338+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:39:22.395 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:22.395 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:22.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:22.452 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:22.453+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:22.540 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:22.542+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:22.575 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:22.575 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:22.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:22.640 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:22.641+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:22.713 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:22.713 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:22.727 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:22.741 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:22.742+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:22.843 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:22.842+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:22.879 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:22.879 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:22.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:22.944 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:22.946+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:23.015 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:23.015 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:23.028 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:23.045 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:23.046+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:23.146 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:23.146+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:23.154 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:23.155 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:23.169 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:23.247 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:23.245+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:23.290 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:23.291 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:23.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:23.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:23.351 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:23.354+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:23.444 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:23.444 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:23.449 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:23.449+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:23.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:23.503 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:23.503 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:23.520 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:23.520 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:23.538 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:23.550 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:23.550+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:23.556 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:23.557 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:23.577 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:23.597 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:23.618 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:23.618 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:23.626 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:23.626 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:23.626 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:23.626 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:23.626 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:23.638 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:23.639 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:23.641 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:23.650 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:23.649+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:23.752 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:23.753+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:23.815 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:23.815 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.992112697000003, 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:39:23.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:39:23.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:39:23.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.837934941, 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:23.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:39:23.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.825598448000001, 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.827 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:39:23.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:39:23.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:39:23.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2189 3.3 3:c1edeb6a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.7929581, 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016969445, 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2189 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021610+0000", 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9100000000000001e-06 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025660+0000", 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040499380000000003 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025706+0000", 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5914999999999997e-05 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025736+0000", 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9913999999999999e-05 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025872+0000", 2024-04-17T15:39:23.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013620900000000001 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026163+0000", 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029049300000000001 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026449+0000", 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028624500000000002 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.033587+0000", 2024-04-17T15:39:23.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071378650000000002 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047364709999999999 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038462+0000", 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138746 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038577+0000", 2024-04-17T15:39:23.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114739 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2190 3.9 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.780296293999999, 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018014220000000001, 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2190 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034272+0000", 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-06 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040506539999999999 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038348+0000", 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5086999999999999e-05 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038382+0000", 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4816e-05 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038551+0000", 2024-04-17T15:39:23.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016887799999999999 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038804+0000", 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000253088 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.039021+0000", 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021690199999999999 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051114+0000", 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012092284999999999 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051953+0000", 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083926200000000002 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052131+0000", 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017803900000000001 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052283+0000", 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.744561655999998, 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:39:23.844 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:39:23.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:39:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2195 3.f e76/18 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.719995522000001, 2024-04-17T15:39:23.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016421760000000001, 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:23.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094572+0000", 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2400000000000002e-06 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097267+0000", 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002694686 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097306+0000", 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9428999999999998e-05 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097329+0000", 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2327000000000002e-05 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097508+0000", 2024-04-17T15:39:23.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017951499999999999 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097578+0000", 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9865999999999998e-05 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110805+0000", 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013226628000000001 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110992+0000", 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018706899999999999 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2208 3.1b e76/18 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.587670814999999, 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018441939000000001, 2024-04-17T15:39:23.855 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:23.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226898+0000", 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9469999999999999e-06 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231882+0000", 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049839719999999997 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231919+0000", 2024-04-17T15:39:23.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6983000000000001e-05 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231936+0000", 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7099999999999999e-05 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232092+0000", 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000156448 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232133+0000", 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0917000000000001e-05 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245213+0000", 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013079456 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245337+0000", 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012411599999999999 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2210 3.9 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.569984083000001, 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021814205, 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.860 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2210 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244585+0000", 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8199999999999998e-06 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248808+0000", 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004222689 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248846+0000", 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8062999999999998e-05 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248866+0000", 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0443000000000001e-05 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249007+0000", 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014065200000000001 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249351+0000", 2024-04-17T15:39:23.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034406699999999998 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249759+0000", 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040812900000000002 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.261660+0000", 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011900834000000001 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266158+0000", 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044976039999999997 2024-04-17T15:39:23.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266264+0000", 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106179 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266396+0000", 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013172499999999999 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2220 3.9 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.468367464, 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017714483999999999, 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2220 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346202+0000", 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-04-17T15:39:23.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351067+0000", 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048656560000000003 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351104+0000", 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6860000000000003e-05 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351123+0000", 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8828999999999999e-05 2024-04-17T15:39:23.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351295+0000", 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017146300000000001 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351709+0000", 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041460899999999997 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.352146+0000", 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043721299999999999 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360734+0000", 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085879530000000006 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363590+0000", 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028559840000000002 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363764+0000", 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017367899999999999 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363913+0000", 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148555 2024-04-17T15:39:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2239 3.1a 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.272036251999999, 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02117043, 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.872 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2239 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542533+0000", 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1459999999999998e-06 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547455+0000", 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049219700000000003 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547505+0000", 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9094999999999997e-05 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547533+0000", 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.813e-05 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547687+0000", 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015475600000000001 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547958+0000", 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027019000000000001 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.548202+0000", 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244615 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.557187+0000", 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0089846390000000009 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563517+0000", 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063303439999999999 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563622+0000", 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104652 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563700+0000", 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7892999999999994e-05 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2242 3.f e76/18 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.230524113000001, 2024-04-17T15:39:23.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016600970999999999, 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584044+0000", 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.016e-06 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587806+0000", 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037613199999999999 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587849+0000", 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3189999999999998e-05 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587867+0000", 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588016+0000", 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014827800000000001 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588060+0000", 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4523e-05 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600492+0000", 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012432145 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600642+0000", 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149999 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2246 3.3 3:c10f4bfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.199003228999999, 2024-04-17T15:39:23.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022677520999999999, 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2246 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:23.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615601+0000", 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8197e-05 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623411+0000", 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007810773 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623455+0000", 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3263999999999998e-05 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623474+0000", 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9366000000000001e-05 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623637+0000", 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016321200000000001 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623894+0000", 2024-04-17T15:39:23.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025645799999999999 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.624163+0000", 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026971999999999999 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.636351+0000", 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012188094 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637944+0000", 2024-04-17T15:39:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001592263 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638115+0000", 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017097799999999999 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638240+0000", 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125196 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.188082793, 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:39:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:39:23.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.174624883, 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.895 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:39:23.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.899 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2251 3.1a 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.147508307999999, 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016964861000000001, 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2251 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667059+0000", 2024-04-17T15:39:23.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-04-17T15:39:23.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.670968+0000", 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039089800000000003 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671001+0000", 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2456000000000002e-05 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671015+0000", 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4432e-05 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671184+0000", 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016877799999999999 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671605+0000", 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000420846 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:23.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.672016+0000", 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041139600000000002 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.682956+0000", 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010939285999999999 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683731+0000", 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077576999999999995 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683903+0000", 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017203800000000001 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.684022+0000", 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011863599999999999 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2254 3.11 e76/18 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:23.906 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.106844976000001, 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019675885000000001, 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707724+0000", 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7129999999999999e-06 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711670+0000", 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039457720000000002 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711712+0000", 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.214e-05 2024-04-17T15:39:23.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711734+0000", 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2158999999999999e-05 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711887+0000", 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253900000000001 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711952+0000", 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5173999999999996e-05 2024-04-17T15:39:23.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727265+0000", 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015312622 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727396+0000", 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013176600000000001 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2256 3.24 e76/45 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.094448849999999, 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016800223, 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720119+0000", 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725518+0000", 2024-04-17T15:39:23.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053986549999999996 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725564+0000", 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6202999999999998e-05 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725590+0000", 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5982999999999998e-05 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725761+0000", 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017110500000000001 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725813+0000", 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1922999999999997e-05 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736772+0000", 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010959365 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736917+0000", 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014473200000000001 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2274 3.27 e76/18 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.902655651, 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017285802999999999, 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911912+0000", 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916353+0000", 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004441164 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916389+0000", 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5916e-05 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916408+0000", 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8539999999999999e-05 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916559+0000", 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015148200000000001 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916621+0000", 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1651999999999999e-05 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929024+0000", 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012403529999999999 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929196+0000", 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171392 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2283 3.1c e76/18 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:23.919 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.804596966999998, 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021912134, 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:23.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009971+0000", 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8899999999999999e-06 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013348+0000", 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033769429999999999 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013391+0000", 2024-04-17T15:39:23.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2339999999999998e-05 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013409+0000", 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8502999999999999e-05 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013548+0000", 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138422 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:23.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013591+0000", 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.375e-05 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031701+0000", 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018109600999999999 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031881+0000", 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017968500000000001 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:23.924 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:23.924 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:23.925 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:23.926 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:23.926+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:24.026 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:24.026+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:24.098 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:24.099 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:24.099 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:24.099 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:24.113 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:24.156 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:24.158+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:24.228 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:24.229+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:24.274 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:24.274 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:24.274 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:24.274 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:24.274 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:24.289 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:24.335 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:24.338+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:24.402 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2182 3.22 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.471171116000001, 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020945306, 2024-04-17T15:39:24.413 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2182 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940490+0000", 2024-04-17T15:39:24.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946030+0000", 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055396229999999996 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946069+0000", 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9919999999999997e-05 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946095+0000", 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5769999999999999e-05 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946290+0000", 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019428800000000001 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946583+0000", 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029335100000000002 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946819+0000", 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023653699999999999 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960915+0000", 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014095721 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961184+0000", 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026861799999999998 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961321+0000", 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013719200000000001 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961432+0000", 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111146 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.419 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2183 3.35 e75/18 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head v 75'2, mlcod=0'0)", 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.449870355999998, 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019360209, 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961789+0000", 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.513e-06 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964955+0000", 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031659840000000002 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964994+0000", 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8957e-05 2024-04-17T15:39:24.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965011+0000", 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6653000000000001e-05 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965297+0000", 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028633100000000002 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965364+0000", 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6768999999999997e-05 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981015+0000", 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015651457000000001 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981148+0000", 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132545 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2188 3.c 3:316225b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.400597744000002, 2024-04-17T15:39:24.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018633493000000001, 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2188 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011064+0000", 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8870000000000002e-06 2024-04-17T15:39:24.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015212+0000", 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041482259999999996 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015252+0000", 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9836000000000003e-05 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015271+0000", 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8980000000000001e-05 2024-04-17T15:39:24.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015408+0000", 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013688900000000001 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015665+0000", 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256968 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015903+0000", 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:24.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.028073+0000", 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012170728 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029386+0000", 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001312725 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029539+0000", 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015330899999999999 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029694+0000", 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015431099999999999 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2198 3.3a 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.294609671000003, 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026029244, 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2198 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117051+0000", 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9059999999999998e-06 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121284+0000", 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042323589999999998 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121335+0000", 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1643e-05 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121362+0000", 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6650000000000001e-05 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121586+0000", 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223928 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122021+0000", 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043530199999999999 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122505+0000", 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048423599999999998 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.134629+0000", 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012124118 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142907+0000", 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082773959999999994 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142998+0000", 2024-04-17T15:39:24.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0828999999999994e-05 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143077+0000", 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9876999999999994e-05 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2202 3.30 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.436 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.247909075000003, 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023532595999999999, 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2202 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:24.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163753+0000", 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9700000000000001e-06 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168372+0000", 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004618942 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168415+0000", 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3272000000000002e-05 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168433+0000", 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8196999999999999e-05 2024-04-17T15:39:24.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168572+0000", 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013865500000000001 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168828+0000", 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256328 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.169055+0000", 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000226331 2024-04-17T15:39:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.176874+0000", 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078199310000000005 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.186974+0000", 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010100012 2024-04-17T15:39:24.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187144+0000", 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016979899999999999 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187281+0000", 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013715900000000001 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2204 3.1c 3:3aa83ff5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.226003675000001, 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019530355999999999, 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.443 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2204 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185657+0000", 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2569999999999999e-06 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188693+0000", 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003035163 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188721+0000", 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8002999999999999e-05 2024-04-17T15:39:24.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188736+0000", 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5829999999999999e-05 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188856+0000", 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119376 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189095+0000", 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023956100000000001 2024-04-17T15:39:24.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189320+0000", 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000224121 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.198523+0000", 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092036619999999996 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.204907+0000", 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063834520000000004 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205027+0000", 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050200000000001 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205185+0000", 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157429 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.448 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2206 3.2a 3:554687e0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.206512848999999, 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029258256, 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2206 2024-04-17T15:39:24.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205148+0000", 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6900000000000001e-06 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211713+0000", 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065654110000000002 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211744+0000", 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1232999999999997e-05 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211761+0000", 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6994e-05 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211928+0000", 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166195 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212314+0000", 2024-04-17T15:39:24.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000385993 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212704+0000", 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039051 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.223772+0000", 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067521 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234062+0000", 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010289918 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234240+0000", 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000178302 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234403+0000", 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016348900000000001 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2212 3.28 3:1630d003:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.145671933000003, 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019714803999999999, 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2212 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266001+0000", 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5427e-05 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272057+0000", 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060554090000000003 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272098+0000", 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.155e-05 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272117+0000", 2024-04-17T15:39:24.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9127000000000002e-05 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272317+0000", 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019985099999999999 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272712+0000", 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039508000000000002 2024-04-17T15:39:24.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.273099+0000", 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038697299999999998 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.284174+0000", 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011074218 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285528+0000", 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013542840000000001 2024-04-17T15:39:24.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285623+0000", 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5563000000000006e-05 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285701+0000", 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7322000000000003e-05 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2225 3.36 e76/18 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.010594402999999, 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020106353, 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401067+0000", 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2200000000000001e-06 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404215+0000", 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031480280000000002 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404253+0000", 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8303999999999998e-05 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404277+0000", 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4428999999999999e-05 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404428+0000", 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150402 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404496+0000", 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8120000000000005e-05 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421035+0000", 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016538517999999999 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421170+0000", 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135332 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2226 3.28 3:152ad80f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.006396387000002, 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018476241000000001, 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.465 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2226 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405262+0000", 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.405265+0000", 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3069999999999998e-06 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409520+0000", 2024-04-17T15:39:24.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042551409999999996 2024-04-17T15:39:24.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409566+0000", 2024-04-17T15:39:24.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5596000000000002e-05 2024-04-17T15:39:24.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409592+0000", 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6186999999999998e-05 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.409755+0000", 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000163435 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.410051+0000", 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000296221 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.410294+0000", 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000242704 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.418835+0000", 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085410869999999993 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423420+0000", 2024-04-17T15:39:24.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004584996 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423609+0000", 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018851499999999999 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.423738+0000", 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129052 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2230 3.3a 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.962682121, 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025252924, 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.472 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2230 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448979+0000", 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454011+0000", 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050315719999999998 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454055+0000", 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4382999999999998e-05 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454075+0000", 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0046000000000001e-05 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454276+0000", 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020055800000000001 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454721+0000", 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044527599999999998 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.455157+0000", 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043578999999999997 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.465942+0000", 2024-04-17T15:39:24.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010784936 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474050+0000", 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081079250000000002 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474144+0000", 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4479000000000001e-05 2024-04-17T15:39:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474229+0000", 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4486000000000004e-05 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2237 3.2a 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:24.478 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.888974059999999, 2024-04-17T15:39:24.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028581945000000001, 2024-04-17T15:39:24.479 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.479 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.479 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.479 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.479 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.479 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.479 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2237 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522688+0000", 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5260000000000004e-06 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526833+0000", 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004144427 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526875+0000", 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1715999999999998e-05 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526894+0000", 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9307e-05 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527045+0000", 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151201 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527303+0000", 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025805199999999999 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527546+0000", 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024263099999999999 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.543539+0000", 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015993657000000001 2024-04-17T15:39:24.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550954+0000", 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074142239999999996 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551129+0000", 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017543100000000001 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551266+0000", 2024-04-17T15:39:24.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136773 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2243 3.2 e76/18 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.825490263999999, 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019774896, 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.485 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586171+0000", 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2430000000000001e-06 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592943+0000", 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067716190000000004 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592982+0000", 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9133e-05 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593000+0000", 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.872e-05 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593167+0000", 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016682200000000001 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593212+0000", 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5262999999999997e-05 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605840+0000", 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012627714 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605943+0000", 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102382 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2248 3.1c 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.776757253, 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028561188000000001, 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.490 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2248 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634905+0000", 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6530000000000002e-06 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638983+0000", 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040774130000000002 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639023+0000", 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0703e-05 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639048+0000", 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4437e-05 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639211+0000", 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016346500000000001 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639455+0000", 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243324 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639679+0000", 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223935 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661540+0000", 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021861068000000001 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663140+0000", 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016003860000000001 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663326+0000", 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018592500000000001 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663462+0000", 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013587899999999999 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2259 3.22 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.658237359000001, 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023533335999999998, 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2259 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.496 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753424+0000", 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5669999999999999e-06 2024-04-17T15:39:24.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757463+0000", 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040386470000000002 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757507+0000", 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4393e-05 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757537+0000", 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9473000000000001e-05 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757736+0000", 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019940800000000001 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757980+0000", 2024-04-17T15:39:24.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244398 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.758213+0000", 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023253799999999999 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.766682+0000", 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084694950000000005 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776706+0000", 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010023676 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776825+0000", 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118396 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776954+0000", 2024-04-17T15:39:24.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129345 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2275 3.3c 3:3dedeaf1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.488733720999999, 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019151476000000001, 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.502 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2275 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922928+0000", 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6940000000000001e-06 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926921+0000", 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039930369999999996 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926965+0000", 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4397000000000002e-05 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926985+0000", 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9488999999999999e-05 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927169+0000", 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018456500000000001 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927447+0000", 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027765100000000002 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927707+0000", 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026028800000000001 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.936871+0000", 2024-04-17T15:39:24.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091640409999999995 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.941911+0000", 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050392379999999997 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942004+0000", 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3763000000000003e-05 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942076+0000", 2024-04-17T15:39:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1313e-05 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2283 3.1c 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.407451594000001, 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028433096000000001, 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.508 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2283 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004210+0000", 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2770000000000001e-06 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008596+0000", 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043866770000000003 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008636+0000", 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9767000000000001e-05 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008655+0000", 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9083e-05 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008831+0000", 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017611100000000001 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009255+0000", 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042393699999999999 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009704+0000", 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044862299999999999 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.029616+0000", 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019912474999999999 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032482+0000", 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028657439999999999 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032575+0000", 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3146000000000006e-05 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032639+0000", 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4256000000000003e-05 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.513 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2287 3.1c 3:3a30054e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.367187680000001, 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020107487, 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.514 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2287 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044473+0000", 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048619+0000", 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041462959999999998 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048657+0000", 2024-04-17T15:39:24.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7911999999999999e-05 2024-04-17T15:39:24.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048681+0000", 2024-04-17T15:39:24.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3873999999999999e-05 2024-04-17T15:39:24.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048815+0000", 2024-04-17T15:39:24.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000133869 2024-04-17T15:39:24.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049079+0000", 2024-04-17T15:39:24.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026408099999999999 2024-04-17T15:39:24.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:24.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049312+0000", 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023292399999999999 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.062430+0000", 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013118747 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064257+0000", 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268959999999999 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064443+0000", 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018521499999999999 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064578+0000", 2024-04-17T15:39:24.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013511600000000001 2024-04-17T15:39:24.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.522 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.523 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2289 3.36 e76/18 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:24.523 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:24.523 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.340598597, 2024-04-17T15:39:24.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022085479000000002, 2024-04-17T15:39:24.523 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.523 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071062+0000", 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2290000000000002e-06 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074727+0000", 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036655809999999998 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074765+0000", 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7778999999999999e-05 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074782+0000", 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246999999999999e-05 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074948+0000", 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016588900000000001 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075033+0000", 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4602000000000001e-05 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093017+0000", 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017984473000000001 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093145+0000", 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012767900000000001 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2290 3.5 3:a1064484:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:24.528 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.335732941, 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023102762999999998, 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2290 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075928+0000", 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080045+0000", 2024-04-17T15:39:24.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041169969999999998 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080083+0000", 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7196000000000001e-05 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080109+0000", 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6373e-05 2024-04-17T15:39:24.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080259+0000", 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015042899999999999 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080519+0000", 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025933100000000001 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080748+0000", 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022913100000000001 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.095782+0000", 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015033902 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:24.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098708+0000", 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029261339999999999 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098890+0000", 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000182222 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.099028+0000", 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137575 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:24.535 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:24.535 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:24.536 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:24.537 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:24.537+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:24.637 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:24.637+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:24.712 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:24.712 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:24.712 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:24.712 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:24.726 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:24.738 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:24.737+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:24.839 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:24.838+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:24.846 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:24.847 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:24.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:24.940 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:24.941+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:25.034 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:25.034 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:25.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 142.782356881, 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.035 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.036 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.036 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.036 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.036 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:39:25.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.036 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:39:25.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:39:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:39:25.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:39:25.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:25.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:39:25.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:39:25.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:39:25.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:39:25.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:39:25.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:39:25.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:39:25.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:39:25.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:39:25.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:39:25.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:39:25.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:39:25.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:39:25.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:39:25.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:39:25.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:39:25.049 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.049 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.049 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.049 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.5049.0:14 5.2 5:40000000::::head [pgnls start_epoch 71] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:25.050 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:25.050 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.734183471999998, 2024-04-17T15:39:25.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065939630000000004, 2024-04-17T15:39:25.050 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.050 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.050 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-04-17T15:39:25.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.5049", 2024-04-17T15:39:25.051 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2262844792", 2024-04-17T15:39:25.051 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 14 2024-04-17T15:39:25.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.052 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:25.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298290+0000", 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298292+0000", 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3700000000000002e-06 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298304+0000", 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1946999999999999e-05 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298324+0000", 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9959e-05 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298344+0000", 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0420000000000001e-05 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298487+0000", 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014289500000000001 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.298497+0000", 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.008e-05 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304538+0000", 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060409690000000002 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304605+0000", 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6632999999999997e-05 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.304884+0000", 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027869 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 43.229014626999998, 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:39:25.056 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:39:25.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1807 4.20 4:07124e4f:::.dir.5305729a-6754-489e-9706-ab50dfde728d.4412.6.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.364699723999998, 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066949260000000003, 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1807 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667773+0000", 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667776+0000", 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.43e-06 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667809+0000", 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3052999999999997e-05 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667846+0000", 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7478999999999998e-05 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.667868+0000", 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1933000000000002e-05 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.668039+0000", 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017102600000000001 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.668368+0000", 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032887999999999998 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.669608+0000", 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001240306 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.671529+0000", 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019204929999999999 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674159+0000", 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026297159999999998 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674339+0000", 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018073500000000001 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:42.674468+0000", 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128875 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2183 3.35 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.079380159000003, 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028592128000000001, 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2183 2024-04-17T15:39:25.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953097+0000", 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2139999999999998e-06 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960326+0000", 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072287250000000001 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960458+0000", 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013165599999999999 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960485+0000", 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7455999999999999e-05 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960672+0000", 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961101+0000", 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042912000000000001 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961545+0000", 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044391599999999998 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.980369+0000", 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018824257 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981505+0000", 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011363339999999999 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981610+0000", 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104249 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981685+0000", 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5369000000000003e-05 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2187 3.20 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.073 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.033388717000001, 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020078048000000001, 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2187 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999089+0000", 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6369999999999998e-06 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003407+0000", 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043177679999999996 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003446+0000", 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666999999999998e-05 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003473+0000", 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-05 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003668+0000", 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019524399999999999 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003925+0000", 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025612500000000001 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.004147+0000", 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222704 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014024+0000", 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098762980000000004 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.018985+0000", 2024-04-17T15:39:25.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049610729999999999 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019082+0000", 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7758999999999997e-05 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019162+0000", 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0003e-05 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2200 3.1e e76/18 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.888614420000003, 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019523622000000001, 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2600000000000002e-07 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148444+0000", 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045848859999999998 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148482+0000", 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7975999999999997e-05 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148503+0000", 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0713e-05 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148684+0000", 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018094899999999999 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148752+0000", 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8325999999999996e-05 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163218+0000", 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014465660999999999 2024-04-17T15:39:25.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163382+0000", 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016448499999999999 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2203 3.33 e76/18 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.856798974999997, 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015459875999999999, 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.084 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175677+0000", 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1499999999999999e-06 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179688+0000", 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040107040000000004 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179724+0000", 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6165999999999999e-05 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179742+0000", 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7669999999999999e-05 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179879+0000", 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137386 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179922+0000", 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2472999999999998e-05 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.190989+0000", 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067367999999999 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.191134+0000", 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014495900000000001 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2209 3.36 3:6e4caeb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.088 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.798191578000001, 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028046186000000001, 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2209 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:25.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234287+0000", 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5160000000000002e-06 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241867+0000", 2024-04-17T15:39:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075797390000000003 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241907+0000", 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0401999999999997e-05 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241926+0000", 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9179999999999999e-05 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242060+0000", 2024-04-17T15:39:25.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013408300000000001 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242320+0000", 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025917699999999998 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242624+0000", 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000304574 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.255662+0000", 2024-04-17T15:39:25.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013038131 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262099+0000", 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064368660000000003 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262247+0000", 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148202 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262328+0000", 2024-04-17T15:39:25.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0315999999999995e-05 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2221 3.2c 3:3579995b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.676996787, 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022481615, 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.094 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2221 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355480+0000", 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.58e-06 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360595+0000", 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051151290000000004 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360643+0000", 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8313999999999999e-05 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360667+0000", 2024-04-17T15:39:25.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4125e-05 2024-04-17T15:39:25.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360807+0000", 2024-04-17T15:39:25.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013905999999999999 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361054+0000", 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024716799999999998 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361268+0000", 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000214768 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.372233+0000", 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010965044 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377661+0000", 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054271830000000004 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377836+0000", 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017558100000000001 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377958+0000", 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121663 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2225 3.36 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.636340359000002, 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025820422999999999, 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2225 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396136+0000", 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2339999999999999e-06 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400026+0000", 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038900950000000001 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400069+0000", 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2979999999999998e-05 2024-04-17T15:39:25.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400093+0000", 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3896e-05 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400243+0000", 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015054599999999999 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400526+0000", 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000283007 2024-04-17T15:39:25.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400800+0000", 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027318399999999999 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.411636+0000", 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01083604 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421617+0000", 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099808669999999992 2024-04-17T15:39:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421810+0000", 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000193155 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421953+0000", 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014341899999999999 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.105 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2238 3.2e e76/18 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.498905956999998, 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017854851000000001, 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533568+0000", 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538745+0000", 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051771400000000002 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538791+0000", 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6196000000000003e-05 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538816+0000", 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5179999999999999e-05 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.539011+0000", 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019481500000000001 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.539076+0000", 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4735999999999998e-05 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551279+0000", 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012203208 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551422+0000", 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143072 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.109 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2247 3.34 e76/18 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.401098298000001, 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030485694000000001, 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631378+0000", 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0429999999999999e-06 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637843+0000", 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064650599999999999 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637892+0000", 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8899000000000001e-05 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637915+0000", 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2903000000000001e-05 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638070+0000", 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155289 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638133+0000", 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2955999999999998e-05 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661702+0000", 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023568782999999999 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661860+0000", 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015876099999999999 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2249 3.20 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.387499196, 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02987182, 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.114 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2249 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644979+0000", 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652360+0000", 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073812269999999998 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652401+0000", 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1316999999999998e-05 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652421+0000", 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9687e-05 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652563+0000", 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014209499999999999 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652811+0000", 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024760400000000001 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.653043+0000", 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231998 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667188+0000", 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014145342 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674671+0000", 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074827380000000001 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674769+0000", 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7838999999999996e-05 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674846+0000", 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7072999999999999e-05 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2262 3.26 3:6636822f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.250137721000002, 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020197527, 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.120 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2262 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782340+0000", 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3370000000000001e-06 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786395+0000", 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040552740000000002 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786450+0000", 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4846999999999999e-05 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786478+0000", 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.811e-05 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786621+0000", 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142798 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786898+0000", 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027743800000000002 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.787136+0000", 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.797168+0000", 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010032350000000001 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802156+0000", 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049883000000000002 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802329+0000", 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017284099999999999 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802533+0000", 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020359800000000001 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2266 3.a 3:523a9b7a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:25.125 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.205735703999999, 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020319462, 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2266 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:25.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826740+0000", 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-06 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830715+0000", 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039743479999999999 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830753+0000", 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8192999999999998e-05 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830771+0000", 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8139999999999999e-05 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830972+0000", 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201595 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831209+0000", 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023676799999999999 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831439+0000", 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022980799999999999 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.845969+0000", 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014529553000000001 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846744+0000", 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077553300000000002 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846916+0000", 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171695 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.847057+0000", 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141049 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2269 3.a 3:53ae1501:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.176602860999999, 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019009920999999999, 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.131 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2269 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855873+0000", 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8430000000000001e-06 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859856+0000", 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039826690000000003 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859893+0000", 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6974999999999998e-05 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859910+0000", 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6926999999999999e-05 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860041+0000", 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013170900000000001 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860311+0000", 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027012800000000001 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860565+0000", 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025331699999999997 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873793+0000", 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013228439 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874705+0000", 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00091167799999999997 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874800+0000", 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5032999999999996e-05 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874880+0000", 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0203000000000004e-05 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2270 3.1e e76/18 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.163386836000001, 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016422573999999999, 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869088+0000", 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9939999999999999e-06 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873478+0000", 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043902009999999998 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873514+0000", 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5525999999999998e-05 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873539+0000", 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5007e-05 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873713+0000", 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173585 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873773+0000", 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0166e-05 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.885357+0000", 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011583776 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.885509+0000", 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015231899999999999 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2289 3.36 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.967503416, 2024-04-17T15:39:25.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028794229000000001, 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2289 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064974+0000", 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5800000000000002e-06 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069897+0000", 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049227460000000004 2024-04-17T15:39:25.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069939+0000", 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2376999999999998e-05 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069964+0000", 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5015999999999999e-05 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070150+0000", 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018596500000000001 2024-04-17T15:39:25.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070583+0000", 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043244600000000001 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070838+0000", 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000255491 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093151+0000", 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022312304000000002 2024-04-17T15:39:25.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093505+0000", 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035477600000000001 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093610+0000", 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010493300000000001 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093764+0000", 2024-04-17T15:39:25.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153595 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2293 3.a 3:53332383:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 31.925877590999999, 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021728066000000001, 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.147 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2293 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106598+0000", 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7599999999999998e-06 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110394+0000", 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037959489999999999 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110433+0000", 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9289000000000003e-05 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110459+0000", 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.51e-05 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110594+0000", 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013532299999999999 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110866+0000", 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027189100000000002 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.111110+0000", 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024460999999999998 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.127108+0000", 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015997838 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128143+0000", 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001034791 2024-04-17T15:39:25.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128245+0000", 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101859 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128324+0000", 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8656e-05 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.152 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:25.154 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:25.155 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:25.154+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:25.254 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:25.253+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:25.324 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:25.325 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:25.339 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:25.384 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:25.386+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:25.394 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:39:25.457 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:25.458+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:25.470 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:25.470 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:25.470 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:25.470 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:25.471 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:25.485 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:25.575 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:25.578+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:25.658 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:25.659 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:25.658+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 157.58651831399999, 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:25.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:39:25.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 157.094525092, 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021643887000000001, 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:25.667 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 113 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564645+0000", 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564646+0000", 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5300000000000002e-07 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564653+0000", 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564664+0000", 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0643e-05 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564672+0000", 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5830000000000001e-06 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.580936+0000", 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016264686 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581082+0000", 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014543299999999999 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.581292+0000", 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021060100000000001 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.582717+0000", 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014248659999999999 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.585977+0000", 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003260008 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586120+0000", 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014297800000000001 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586289+0000", 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168536 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:25.672 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 157.09448514299999, 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:25.678 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 157.09444622000001, 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:39:25.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:39:25.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:39:25.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:39:25.683 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 157.09424663799999, 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:25.684 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:39:25.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 157.094201406, 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:39:25.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:39:25.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:39:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 156.86760033199999, 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020739305999999999, 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 141 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791570+0000", 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791571+0000", 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2200000000000002e-07 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791577+0000", 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0630000000000002e-06 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791585+0000", 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3610000000000001e-06 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.791590+0000", 2024-04-17T15:39:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6469999999999997e-06 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810229+0000", 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018638983000000001 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810291+0000", 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2867000000000006e-05 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.810431+0000", 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139918 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812181+0000", 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001749156 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812230+0000", 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9944000000000002e-05 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812274+0000", 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3244999999999997e-05 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.812309+0000", 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5200000000000002e-05 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.701 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.691097190000001, 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.702 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2191 3.3b 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.707 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.612139358999997, 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024079896999999999, 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2191 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047034+0000", 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051686+0000", 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046523550000000004 2024-04-17T15:39:25.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051729+0000", 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3032999999999999e-05 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051748+0000", 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9148999999999999e-05 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051911+0000", 2024-04-17T15:39:25.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016241300000000001 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052338+0000", 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000427549 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052584+0000", 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000245861 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.059685+0000", 2024-04-17T15:39:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071007229999999998 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070946+0000", 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011261136 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071036+0000", 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0066000000000001e-05 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071110+0000", 2024-04-17T15:39:25.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4609000000000003e-05 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2195 3.f 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.569581927000002, 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022167662000000001, 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.713 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2195 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089591+0000", 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.134e-06 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093534+0000", 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039429010000000004 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093579+0000", 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5423000000000002e-05 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093601+0000", 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1622999999999999e-05 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093781+0000", 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017973500000000001 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094072+0000", 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029165799999999998 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094318+0000", 2024-04-17T15:39:25.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024528400000000002 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103355+0000", 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090377029999999994 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111447+0000", 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080915640000000007 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111616+0000", 2024-04-17T15:39:25.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016912200000000001 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111756+0000", 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013951499999999999 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.560975249999998, 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.718 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:39:25.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:25.723 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.550770425000003, 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:39:25.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2207 3.15 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.444658683999997, 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022770393999999999, 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.729 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2207 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214516+0000", 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.284e-06 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218674+0000", 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004158953 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218721+0000", 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6669999999999999e-05 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218749+0000", 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7846000000000001e-05 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218887+0000", 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013819200000000001 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219113+0000", 2024-04-17T15:39:25.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022536100000000001 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219315+0000", 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020251500000000001 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232744+0000", 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013428796999999999 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.236964+0000", 2024-04-17T15:39:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042205189999999998 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237138+0000", 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173198 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237282+0000", 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014405900000000001 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2214 3.2f e76/45 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.370034283000003, 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022854762000000001, 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289138+0000", 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293890+0000", 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047525909999999996 2024-04-17T15:39:25.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293918+0000", 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7742999999999998e-05 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293933+0000", 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4623e-05 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294082+0000", 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149662 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294148+0000", 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5345999999999994e-05 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311863+0000", 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017715564999999999 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311990+0000", 2024-04-17T15:39:25.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012724899999999999 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2216 3.3b 3:dce33251:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.307335+0000", 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.351834785999998, 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020880069000000001, 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.739 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2216 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.307335+0000", 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.307335+0000", 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.307366+0000", 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0929999999999997e-05 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312129+0000", 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047628039999999998 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312157+0000", 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8563000000000001e-05 2024-04-17T15:39:25.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312177+0000", 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9318999999999999e-05 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312308+0000", 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013134600000000001 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312541+0000", 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023259100000000001 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.312759+0000", 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000218781 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.322021+0000", 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092614540000000006 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.328054+0000", 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006033137 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.328143+0000", 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8907999999999996e-05 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.328215+0000", 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2236000000000004e-05 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2218 3.39 3:9d9d4055:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.331846228000003, 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023480399999999998, 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2218 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327327+0000", 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331723+0000", 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043962680000000001 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331760+0000", 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6903000000000002e-05 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331783+0000", 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3598999999999999e-05 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331906+0000", 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012282300000000001 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332168+0000", 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026144100000000001 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332408+0000", 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024071499999999999 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.345166+0000", 2024-04-17T15:39:25.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012757961 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350543+0000", 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053770720000000001 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350728+0000", 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018468599999999999 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350804+0000", 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6066e-05 2024-04-17T15:39:25.749 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2219 3.11 3:8990f5d3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.337039+0000", 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.322131048000003, 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021972254, 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.750 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2219 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.337039+0000", 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.337039+0000", 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.337042+0000", 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341094+0000", 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040514610000000001 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341126+0000", 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2483000000000001e-05 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341143+0000", 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6742999999999999e-05 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341280+0000", 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013707899999999999 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341562+0000", 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028206699999999999 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.341825+0000", 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026330499999999997 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.356408+0000", 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014582725 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.358722+0000", 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002313444 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.358883+0000", 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016161600000000001 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.359011+0000", 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012785800000000001 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2237 3.2a e76/18 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:39:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.131380553, 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022753497000000001, 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527792+0000", 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7130000000000001e-06 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534227+0000", 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064349760000000002 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534276+0000", 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8996999999999999e-05 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534302+0000", 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6279e-05 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534552+0000", 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024917100000000002 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534609+0000", 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7837000000000002e-05 2024-04-17T15:39:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550416+0000", 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015806222000000002 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550543+0000", 2024-04-17T15:39:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012730200000000001 2024-04-17T15:39:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.085222545999997, 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:39:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:39:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 32.957366331999999, 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:39:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:39:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:25.773 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:25.775 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:25.774+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:25.776 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:25.819 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:25.819 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:25.837 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:25.854 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:25.854 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:25.871 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:25.871 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:25.876 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:25.878+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:25.892 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:25.913 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:25.913 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:25.932 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:25.933 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:25.934 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:25.934 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:25.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:25.955 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:25.956 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:26.016 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:26.017+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:26.077 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:26.078+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:26.088 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:26.089 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:26.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:26.178 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:26.178+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:26.279 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:26.277+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:26.283 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:26.284 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:26.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:26.396 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:26.397+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:26.476 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:26.476 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:26.479 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:26.481+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:26.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:26.580 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:26.581+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:26.662 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:26.662 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:26.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:26.699 INFO:tasks.workunit.client.0.smithi044.stderr:100+0 records in 2024-04-17T15:39:26.699 INFO:tasks.workunit.client.0.smithi044.stderr:100+0 records out 2024-04-17T15:39:26.699 INFO:tasks.workunit.client.0.smithi044.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 6.91784 s, 152 MB/s 2024-04-17T15:39:26.699 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:26.697+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:26.782 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:26.781+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:26.814 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:26.814 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:26.829 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:26.882 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:26.881+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:26.983 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:26.985+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:27.000 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:27.000 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:27.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:27.084 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:27.085+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:27.142 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:27.142 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:27.155 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:27.200 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:27.201+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:27.285 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:27.285 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:27.285 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:27.285+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:27.298 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:27.386 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:27.385+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:27.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:39:27.467 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:27.467 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:27.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:27.524 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:27.525+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:27.587 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:27.585+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:27.635 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:27.635 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:27.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:27.688 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:27.689+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:27.787 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:39:27.789 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:27.789+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:27.825 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:27.826 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:27.839 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:27.890 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:27.889+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:27.973 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:27.973 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:27.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:27.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:28.031 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:28.033+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:28.092 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:28.093+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:28.120 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:28.120 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:28.136 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:28.136 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:28.154 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:28.154 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:28.159 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:28.159 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:28.171 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:28.172 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:28.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:28.191 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:28.191 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:28.211 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:28.211 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:28.219 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:28.221+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:28.228 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:28.228 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:28.246 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:28.247 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:28.293 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:28.293+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 49.487832453999999, 2024-04-17T15:39:28.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:39:28.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:39:28.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.333654697999997, 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.321318204999997, 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:39:28.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:39:28.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:39:28.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2189 3.3 3:c1edeb6a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.288677857000003, 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016969445, 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2189 2024-04-17T15:39:28.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021607+0000", 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.021610+0000", 2024-04-17T15:39:28.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9100000000000001e-06 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025660+0000", 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040499380000000003 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025706+0000", 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5914999999999997e-05 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025736+0000", 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9913999999999999e-05 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.025872+0000", 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013620900000000001 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026163+0000", 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029049300000000001 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.026449+0000", 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028624500000000002 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.033587+0000", 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071378650000000002 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047364709999999999 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038462+0000", 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138746 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038577+0000", 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114739 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2190 3.9 3:91419384:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.276016050999999, 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018014220000000001, 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2190 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034269+0000", 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.034272+0000", 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-06 2024-04-17T15:39:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038323+0000", 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040506539999999999 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038348+0000", 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5086999999999999e-05 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038382+0000", 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4816e-05 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038551+0000", 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016887799999999999 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.038804+0000", 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000253088 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.039021+0000", 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021690199999999999 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051114+0000", 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012092284999999999 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051953+0000", 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083926200000000002 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052131+0000", 2024-04-17T15:39:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017803900000000001 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052283+0000", 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253200000000001 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.240281412999998, 2024-04-17T15:39:28.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.341 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2195 3.f e76/18 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.215715279000001, 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016421760000000001, 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:28.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094570+0000", 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094572+0000", 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2400000000000002e-06 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097267+0000", 2024-04-17T15:39:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002694686 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097306+0000", 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9428999999999998e-05 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097329+0000", 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2327000000000002e-05 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097508+0000", 2024-04-17T15:39:28.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017951499999999999 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.097578+0000", 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9865999999999998e-05 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110805+0000", 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013226628000000001 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.110992+0000", 2024-04-17T15:39:28.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018706899999999999 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2208 3.1b e76/18 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.083390571999999, 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018441939000000001, 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226895+0000", 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.226898+0000", 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9469999999999999e-06 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231882+0000", 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049839719999999997 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231919+0000", 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6983000000000001e-05 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.231936+0000", 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7099999999999999e-05 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232092+0000", 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000156448 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232133+0000", 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0917000000000001e-05 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245213+0000", 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013079456 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.245337+0000", 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012411599999999999 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2210 3.9 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.065703839999998, 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021814205, 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.350 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2210 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244585+0000", 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8199999999999998e-06 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248808+0000", 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004222689 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248846+0000", 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8062999999999998e-05 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248866+0000", 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0443000000000001e-05 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249007+0000", 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014065200000000001 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249351+0000", 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034406699999999998 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249759+0000", 2024-04-17T15:39:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040812900000000002 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.261660+0000", 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011900834000000001 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266158+0000", 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044976039999999997 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266264+0000", 2024-04-17T15:39:28.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106179 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266396+0000", 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013172499999999999 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2220 3.9 3:938544dd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.964087221, 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017714483999999999, 2024-04-17T15:39:28.355 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2220 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346198+0000", 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.346202+0000", 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351067+0000", 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048656560000000003 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351104+0000", 2024-04-17T15:39:28.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6860000000000003e-05 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351123+0000", 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8828999999999999e-05 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351295+0000", 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017146300000000001 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.351709+0000", 2024-04-17T15:39:28.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041460899999999997 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.352146+0000", 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043721299999999999 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360734+0000", 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085879530000000006 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363590+0000", 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028559840000000002 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363764+0000", 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017367899999999999 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.363913+0000", 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148555 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.360 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2239 3.1a 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.767756009000003, 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02117043, 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2239 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542533+0000", 2024-04-17T15:39:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1459999999999998e-06 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547455+0000", 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049219700000000003 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547505+0000", 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9094999999999997e-05 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547533+0000", 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.813e-05 2024-04-17T15:39:28.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547687+0000", 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015475600000000001 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547958+0000", 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027019000000000001 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.548202+0000", 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244615 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.557187+0000", 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0089846390000000009 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563517+0000", 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063303439999999999 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563622+0000", 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104652 2024-04-17T15:39:28.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563700+0000", 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7892999999999994e-05 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2242 3.f e76/18 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head v 76'4, mlcod=76'2)", 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.726243869999998, 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016600970999999999, 2024-04-17T15:39:28.366 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584041+0000", 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.584044+0000", 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.016e-06 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587806+0000", 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037613199999999999 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587849+0000", 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3189999999999998e-05 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.587867+0000", 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588016+0000", 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014827800000000001 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.588060+0000", 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4523e-05 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600492+0000", 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012432145 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.600642+0000", 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149999 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.370 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2246 3.3 3:c10f4bfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.694722986000002, 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022677520999999999, 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2246 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:28.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615601+0000", 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8197e-05 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623411+0000", 2024-04-17T15:39:28.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007810773 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623455+0000", 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3263999999999998e-05 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623474+0000", 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9366000000000001e-05 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623637+0000", 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016321200000000001 2024-04-17T15:39:28.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623894+0000", 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025645799999999999 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.624163+0000", 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026971999999999999 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.636351+0000", 2024-04-17T15:39:28.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012188094 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637944+0000", 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001592263 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638115+0000", 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017097799999999999 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638240+0000", 2024-04-17T15:39:28.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125196 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.683802550000003, 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.376 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:28.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:39:28.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.670344640000003, 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:39:28.381 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2251 3.1a 3:5bad2ae0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.385 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.643228065000002, 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016964861000000001, 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2251 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667057+0000", 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667059+0000", 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.670968+0000", 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039089800000000003 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671001+0000", 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2456000000000002e-05 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671015+0000", 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4432e-05 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671184+0000", 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016877799999999999 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.671605+0000", 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000420846 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.672016+0000", 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041139600000000002 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.682956+0000", 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010939285999999999 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683731+0000", 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077576999999999995 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.683903+0000", 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017203800000000001 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.684022+0000", 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011863599999999999 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2254 3.11 e76/18 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.602564733000001, 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019675885000000001, 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.391 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707724+0000", 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7129999999999999e-06 2024-04-17T15:39:28.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711670+0000", 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039457720000000002 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711712+0000", 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.214e-05 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711734+0000", 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2158999999999999e-05 2024-04-17T15:39:28.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711887+0000", 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253900000000001 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711952+0000", 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5173999999999996e-05 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727265+0000", 2024-04-17T15:39:28.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015312622 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727396+0000", 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013176600000000001 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2256 3.24 e76/45 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.590168607000003, 2024-04-17T15:39:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016800223, 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720117+0000", 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.720119+0000", 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2570000000000002e-06 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725518+0000", 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053986549999999996 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725564+0000", 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6202999999999998e-05 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725590+0000", 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5982999999999998e-05 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725761+0000", 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017110500000000001 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.725813+0000", 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1922999999999997e-05 2024-04-17T15:39:28.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736772+0000", 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010959365 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.736917+0000", 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014473200000000001 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.399 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2274 3.27 e76/18 3:e615bb38:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_93:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.398375408, 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017285802999999999, 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911910+0000", 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.911912+0000", 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916353+0000", 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004441164 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916389+0000", 2024-04-17T15:39:28.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5916e-05 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916408+0000", 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8539999999999999e-05 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916559+0000", 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015148200000000001 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.916621+0000", 2024-04-17T15:39:28.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1651999999999999e-05 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929024+0000", 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012403529999999999 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.929196+0000", 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171392 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2283 3.1c e76/18 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.300316723999998, 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021912134, 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009971+0000", 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8899999999999999e-06 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013348+0000", 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033769429999999999 2024-04-17T15:39:28.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013391+0000", 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2339999999999998e-05 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013409+0000", 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8502999999999999e-05 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013548+0000", 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138422 2024-04-17T15:39:28.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013591+0000", 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.375e-05 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031701+0000", 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018109600999999999 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031881+0000", 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017968500000000001 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.408 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.408 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:28.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:28.409 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:28.409+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:28.510 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:28.509+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:28.584 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:28.584 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:28.584 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:28.584 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:28.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:28.611 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:28.609+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:28.711 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:28.709+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:28.728 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:28.728 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:28.728 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:28.728 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:28.728 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:28.743 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:28.812 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:28.813+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2182 3.22 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.940150961999997, 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020945306, 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.880 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2182 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940490+0000", 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946030+0000", 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055396229999999996 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946069+0000", 2024-04-17T15:39:28.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9919999999999997e-05 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946095+0000", 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5769999999999999e-05 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946290+0000", 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019428800000000001 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946583+0000", 2024-04-17T15:39:28.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029335100000000002 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946819+0000", 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023653699999999999 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960915+0000", 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014095721 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961184+0000", 2024-04-17T15:39:28.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026861799999999998 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961321+0000", 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013719200000000001 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961432+0000", 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111146 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2183 3.35 e75/18 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head v 75'2, mlcod=0'0)", 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.918850202000002, 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019360209, 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961788+0000", 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961789+0000", 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.513e-06 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964955+0000", 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031659840000000002 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.964994+0000", 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8957e-05 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965011+0000", 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6653000000000001e-05 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965297+0000", 2024-04-17T15:39:28.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028633100000000002 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.965364+0000", 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6768999999999997e-05 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981015+0000", 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015651457000000001 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981148+0000", 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132545 2024-04-17T15:39:28.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2188 3.c 3:316225b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.869577589999999, 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018633493000000001, 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2188 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011060+0000", 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.011064+0000", 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8870000000000002e-06 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015212+0000", 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041482259999999996 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015252+0000", 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9836000000000003e-05 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015271+0000", 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8980000000000001e-05 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015408+0000", 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013688900000000001 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015665+0000", 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256968 2024-04-17T15:39:28.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.015903+0000", 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.028073+0000", 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012170728 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029386+0000", 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001312725 2024-04-17T15:39:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029539+0000", 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015330899999999999 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.029694+0000", 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015431099999999999 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2198 3.3a 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.763589517, 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026029244, 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2198 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117051+0000", 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9059999999999998e-06 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121284+0000", 2024-04-17T15:39:28.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042323589999999998 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121335+0000", 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1643e-05 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121362+0000", 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6650000000000001e-05 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121586+0000", 2024-04-17T15:39:28.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223928 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122021+0000", 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043530199999999999 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122505+0000", 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048423599999999998 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.134629+0000", 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012124118 2024-04-17T15:39:28.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142907+0000", 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082773959999999994 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142998+0000", 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0828999999999994e-05 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143077+0000", 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9876999999999994e-05 2024-04-17T15:39:28.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2202 3.30 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.716888920999999, 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023532595999999999, 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2202 2024-04-17T15:39:28.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163753+0000", 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9700000000000001e-06 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168372+0000", 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004618942 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168415+0000", 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3272000000000002e-05 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168433+0000", 2024-04-17T15:39:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8196999999999999e-05 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168572+0000", 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013865500000000001 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168828+0000", 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256328 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.169055+0000", 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000226331 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.176874+0000", 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078199310000000005 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.186974+0000", 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010100012 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187144+0000", 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016979899999999999 2024-04-17T15:39:28.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187281+0000", 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013715900000000001 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2204 3.1c 3:3aa83ff5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.694983520999997, 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019530355999999999, 2024-04-17T15:39:28.906 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2204 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185654+0000", 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.185657+0000", 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2569999999999999e-06 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188693+0000", 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003035163 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188721+0000", 2024-04-17T15:39:28.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8002999999999999e-05 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188736+0000", 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5829999999999999e-05 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.188856+0000", 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119376 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189095+0000", 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023956100000000001 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.189320+0000", 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000224121 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.198523+0000", 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092036619999999996 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.204907+0000", 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063834520000000004 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205027+0000", 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012050200000000001 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205185+0000", 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000157429 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2206 3.2a 3:554687e0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.675492695000003, 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029258256, 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2206 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205148+0000", 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6900000000000001e-06 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211713+0000", 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065654110000000002 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211744+0000", 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1232999999999997e-05 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211761+0000", 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6994e-05 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211928+0000", 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166195 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212314+0000", 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000385993 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212704+0000", 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039051 2024-04-17T15:39:28.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.223772+0000", 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067521 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234062+0000", 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010289918 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234240+0000", 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000178302 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234403+0000", 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016348900000000001 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2212 3.28 3:1630d003:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.614651778999999, 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019714803999999999, 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2212 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.265986+0000", 2024-04-17T15:39:28.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266001+0000", 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5427e-05 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272057+0000", 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060554090000000003 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272098+0000", 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.155e-05 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272117+0000", 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9127000000000002e-05 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272317+0000", 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019985099999999999 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.272712+0000", 2024-04-17T15:39:28.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039508000000000002 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.273099+0000", 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00038697299999999998 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.284174+0000", 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011074218 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285528+0000", 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013542840000000001 2024-04-17T15:39:28.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285623+0000", 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5563000000000006e-05 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.285701+0000", 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7322000000000003e-05 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.922 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2225 3.36 e76/18 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.479574249000002, 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020106353, 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401067+0000", 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2200000000000001e-06 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404215+0000", 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031480280000000002 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404253+0000", 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8303999999999998e-05 2024-04-17T15:39:28.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404277+0000", 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4428999999999999e-05 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404428+0000", 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150402 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404496+0000", 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8120000000000005e-05 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421035+0000", 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016538517999999999 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421170+0000", 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135332 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2230 3.3a 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.431661966999997, 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025252924, 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2230 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448979+0000", 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454011+0000", 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050315719999999998 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454055+0000", 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4382999999999998e-05 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454075+0000", 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0046000000000001e-05 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454276+0000", 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020055800000000001 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454721+0000", 2024-04-17T15:39:28.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044527599999999998 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.455157+0000", 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043578999999999997 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.465942+0000", 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010784936 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474050+0000", 2024-04-17T15:39:28.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081079250000000002 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474144+0000", 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4479000000000001e-05 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474229+0000", 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4486000000000004e-05 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2237 3.2a 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.357953905999999, 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028581945000000001, 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2237 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522688+0000", 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5260000000000004e-06 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526833+0000", 2024-04-17T15:39:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004144427 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526875+0000", 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1715999999999998e-05 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526894+0000", 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9307e-05 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527045+0000", 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151201 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527303+0000", 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025805199999999999 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527546+0000", 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024263099999999999 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.543539+0000", 2024-04-17T15:39:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015993657000000001 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550954+0000", 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074142239999999996 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551129+0000", 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017543100000000001 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551266+0000", 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136773 2024-04-17T15:39:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2243 3.2 e76/18 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.294470109999999, 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019774896, 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586168+0000", 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.586171+0000", 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2430000000000001e-06 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592943+0000", 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067716190000000004 2024-04-17T15:39:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.592982+0000", 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9133e-05 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593000+0000", 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.872e-05 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593167+0000", 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016682200000000001 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.593212+0000", 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5262999999999997e-05 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605840+0000", 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012627714 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.605943+0000", 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102382 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2248 3.1c 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.245737099000003, 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028561188000000001, 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2248 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634905+0000", 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6530000000000002e-06 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638983+0000", 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040774130000000002 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639023+0000", 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0703e-05 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639048+0000", 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4437e-05 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639211+0000", 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016346500000000001 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639455+0000", 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243324 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639679+0000", 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223935 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661540+0000", 2024-04-17T15:39:28.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021861068000000001 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663140+0000", 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016003860000000001 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663326+0000", 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018592500000000001 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663462+0000", 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013587899999999999 2024-04-17T15:39:28.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2259 3.22 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.127217205000001, 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023533335999999998, 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.946 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2259 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753424+0000", 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5669999999999999e-06 2024-04-17T15:39:28.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757463+0000", 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040386470000000002 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757507+0000", 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4393e-05 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757537+0000", 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9473000000000001e-05 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757736+0000", 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019940800000000001 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757980+0000", 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244398 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.758213+0000", 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023253799999999999 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.766682+0000", 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084694950000000005 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776706+0000", 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010023676 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776825+0000", 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118396 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776954+0000", 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129345 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2275 3.3c 3:3dedeaf1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.957713566999999, 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019151476000000001, 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.951 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2275 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922924+0000", 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.922928+0000", 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6940000000000001e-06 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926921+0000", 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039930369999999996 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926965+0000", 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4397000000000002e-05 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.926985+0000", 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9488999999999999e-05 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927169+0000", 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018456500000000001 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927447+0000", 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027765100000000002 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.927707+0000", 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026028800000000001 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.936871+0000", 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091640409999999995 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.941911+0000", 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050392379999999997 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942004+0000", 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3763000000000003e-05 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.942076+0000", 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1313e-05 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2283 3.1c 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:28.956 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.876431439999998, 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028433096000000001, 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2283 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004210+0000", 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2770000000000001e-06 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008596+0000", 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043866770000000003 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008636+0000", 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9767000000000001e-05 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008655+0000", 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9083e-05 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008831+0000", 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017611100000000001 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009255+0000", 2024-04-17T15:39:28.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042393699999999999 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009704+0000", 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044862299999999999 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.029616+0000", 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019912474999999999 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032482+0000", 2024-04-17T15:39:28.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028657439999999999 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032575+0000", 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3146000000000006e-05 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032639+0000", 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4256000000000003e-05 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2287 3.1c 3:3a30054e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.961 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.836167525999997, 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020107487, 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2287 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044473+0000", 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048619+0000", 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041462959999999998 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048657+0000", 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7911999999999999e-05 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048681+0000", 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3873999999999999e-05 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048815+0000", 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000133869 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049079+0000", 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026408099999999999 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049312+0000", 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023292399999999999 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.062430+0000", 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013118747 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064257+0000", 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268959999999999 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064443+0000", 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018521499999999999 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064578+0000", 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013511600000000001 2024-04-17T15:39:28.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2289 3.36 e76/18 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.809578442999999, 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022085479000000002, 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:28.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071062+0000", 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2290000000000002e-06 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074727+0000", 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036655809999999998 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074765+0000", 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7778999999999999e-05 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074782+0000", 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246999999999999e-05 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074948+0000", 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016588900000000001 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075033+0000", 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4602000000000001e-05 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093017+0000", 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017984473000000001 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093145+0000", 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012767900000000001 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2290 3.5 3:a1064484:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.804712787, 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023102762999999998, 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2290 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075928+0000", 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080045+0000", 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041169969999999998 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080083+0000", 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7196000000000001e-05 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080109+0000", 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6373e-05 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080259+0000", 2024-04-17T15:39:28.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015042899999999999 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080519+0000", 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025933100000000001 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080748+0000", 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022913100000000001 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.095782+0000", 2024-04-17T15:39:28.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015033902 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098708+0000", 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029261339999999999 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098890+0000", 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000182222 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.099028+0000", 2024-04-17T15:39:28.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137575 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2647 3.1c 3:38e91c04:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.745740+0000", 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.134897605, 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018697802999999999, 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:28.976 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2647 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.745740+0000", 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.745740+0000", 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.745745+0000", 2024-04-17T15:39:28.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6800000000000001e-06 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.752801+0000", 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0070557679999999996 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.752844+0000", 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3593000000000001e-05 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.752864+0000", 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.967e-05 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.752962+0000", 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8531999999999998e-05 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.753121+0000", 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015855700000000001 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.753257+0000", 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013581800000000001 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.760153+0000", 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068960619999999997 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.764338+0000", 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041851459999999998 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.764391+0000", 2024-04-17T15:39:28.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2952999999999999e-05 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.764438+0000", 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7024000000000002e-05 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:28.981 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:28.982 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:28.983 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:28.981+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:29.084 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:29.085+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:29.165 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:29.165 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:29.165 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:29.165 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:29.180 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:29.223 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:29.225+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:29.285 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:29.285+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:29.360 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:29.361 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:29.361 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:29.361 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:29.361 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:29.375 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:29.419 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:29.421+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:29.488 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:29.489+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:29.513 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 147.26178758699999, 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.514 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:39:29.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.708445333, 2024-04-17T15:39:29.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:39:29.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:39:29.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:39:29.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2183 3.35 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.558810864999998, 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028592128000000001, 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.527 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2183 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953097+0000", 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2139999999999998e-06 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960326+0000", 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072287250000000001 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960458+0000", 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013165599999999999 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960485+0000", 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7455999999999999e-05 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960672+0000", 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961101+0000", 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042912000000000001 2024-04-17T15:39:29.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961545+0000", 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044391599999999998 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.980369+0000", 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018824257 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981505+0000", 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011363339999999999 2024-04-17T15:39:29.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981610+0000", 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104249 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981685+0000", 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5369000000000003e-05 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.532 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2187 3.20 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.512819423000003, 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020078048000000001, 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2187 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999089+0000", 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6369999999999998e-06 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003407+0000", 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043177679999999996 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003446+0000", 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666999999999998e-05 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003473+0000", 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-05 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003668+0000", 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019524399999999999 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003925+0000", 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025612500000000001 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.004147+0000", 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222704 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014024+0000", 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098762980000000004 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.018985+0000", 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049610729999999999 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019082+0000", 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7758999999999997e-05 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019162+0000", 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0003e-05 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2200 3.1e e76/18 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.368045125999998, 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019523622000000001, 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.538 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2600000000000002e-07 2024-04-17T15:39:29.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148444+0000", 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045848859999999998 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148482+0000", 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7975999999999997e-05 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148503+0000", 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0713e-05 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148684+0000", 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018094899999999999 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148752+0000", 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8325999999999996e-05 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163218+0000", 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014465660999999999 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163382+0000", 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016448499999999999 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2203 3.33 e76/18 3:cfe6061e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_22:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.336229680999999, 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015459875999999999, 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.542 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175674+0000", 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.175677+0000", 2024-04-17T15:39:29.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1499999999999999e-06 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179688+0000", 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040107040000000004 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179724+0000", 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6165999999999999e-05 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179742+0000", 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7669999999999999e-05 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179879+0000", 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137386 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.179922+0000", 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2472999999999998e-05 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.190989+0000", 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067367999999999 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.191134+0000", 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014495900000000001 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2209 3.36 3:6e4caeb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.546 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.277622284000003, 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028046186000000001, 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2209 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:29.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234287+0000", 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5160000000000002e-06 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241867+0000", 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075797390000000003 2024-04-17T15:39:29.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241907+0000", 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0401999999999997e-05 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241926+0000", 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9179999999999999e-05 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242060+0000", 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013408300000000001 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242320+0000", 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025917699999999998 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242624+0000", 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000304574 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.255662+0000", 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013038131 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262099+0000", 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064368660000000003 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262247+0000", 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148202 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262328+0000", 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0315999999999995e-05 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2221 3.2c 3:3579995b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.156427493000002, 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022481615, 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2221 2024-04-17T15:39:29.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355480+0000", 2024-04-17T15:39:29.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.58e-06 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360595+0000", 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051151290000000004 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360643+0000", 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8313999999999999e-05 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360667+0000", 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4125e-05 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360807+0000", 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013905999999999999 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361054+0000", 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024716799999999998 2024-04-17T15:39:29.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361268+0000", 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000214768 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.372233+0000", 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010965044 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377661+0000", 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054271830000000004 2024-04-17T15:39:29.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377836+0000", 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017558100000000001 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377958+0000", 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121663 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2225 3.36 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.115771064999997, 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025820422999999999, 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2225 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396136+0000", 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2339999999999999e-06 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400026+0000", 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038900950000000001 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400069+0000", 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2979999999999998e-05 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400093+0000", 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3896e-05 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400243+0000", 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015054599999999999 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400526+0000", 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000283007 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400800+0000", 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027318399999999999 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.411636+0000", 2024-04-17T15:39:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01083604 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421617+0000", 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099808669999999992 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421810+0000", 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000193155 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421953+0000", 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014341899999999999 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2238 3.2e e76/18 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.978336663, 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017854851000000001, 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533567+0000", 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.533568+0000", 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538745+0000", 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051771400000000002 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538791+0000", 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6196000000000003e-05 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.538816+0000", 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5179999999999999e-05 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.539011+0000", 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019481500000000001 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.539076+0000", 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4735999999999998e-05 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551279+0000", 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012203208 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551422+0000", 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143072 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2247 3.34 e76/18 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.880529004000003, 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030485694000000001, 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.567 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631378+0000", 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0429999999999999e-06 2024-04-17T15:39:29.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637843+0000", 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064650599999999999 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637892+0000", 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8899000000000001e-05 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637915+0000", 2024-04-17T15:39:29.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2903000000000001e-05 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638070+0000", 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155289 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638133+0000", 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2955999999999998e-05 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661702+0000", 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023568782999999999 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661860+0000", 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015876099999999999 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2249 3.20 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.866929902000003, 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02987182, 2024-04-17T15:39:29.571 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2249 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644979+0000", 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652360+0000", 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073812269999999998 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652401+0000", 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1316999999999998e-05 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652421+0000", 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9687e-05 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652563+0000", 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014209499999999999 2024-04-17T15:39:29.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652811+0000", 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024760400000000001 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.653043+0000", 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231998 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667188+0000", 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014145342 2024-04-17T15:39:29.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674671+0000", 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074827380000000001 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674769+0000", 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7838999999999996e-05 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674846+0000", 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7072999999999999e-05 2024-04-17T15:39:29.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2262 3.26 3:6636822f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.729568426999997, 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020197527, 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.577 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2262 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782340+0000", 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3370000000000001e-06 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786395+0000", 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040552740000000002 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786450+0000", 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4846999999999999e-05 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786478+0000", 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.811e-05 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786621+0000", 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142798 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786898+0000", 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027743800000000002 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.787136+0000", 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.797168+0000", 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010032350000000001 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802156+0000", 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049883000000000002 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802329+0000", 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017284099999999999 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802533+0000", 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020359800000000001 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.582 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2266 3.a 3:523a9b7a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.685166410000001, 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020319462, 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2266 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826740+0000", 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-06 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830715+0000", 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039743479999999999 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830753+0000", 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8192999999999998e-05 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830771+0000", 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8139999999999999e-05 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830972+0000", 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201595 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831209+0000", 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023676799999999999 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831439+0000", 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022980799999999999 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.845969+0000", 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014529553000000001 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846744+0000", 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077553300000000002 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846916+0000", 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171695 2024-04-17T15:39:29.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.847057+0000", 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141049 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2269 3.a 3:53ae1501:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.656033567000001, 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019009920999999999, 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.588 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2269 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855870+0000", 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.855873+0000", 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8430000000000001e-06 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859856+0000", 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039826690000000003 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859893+0000", 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6974999999999998e-05 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.859910+0000", 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6926999999999999e-05 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860041+0000", 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013170900000000001 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860311+0000", 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027012800000000001 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.860565+0000", 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025331699999999997 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873793+0000", 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013228439 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874705+0000", 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00091167799999999997 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874800+0000", 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5032999999999996e-05 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.874880+0000", 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0203000000000004e-05 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.593 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2270 3.1e e76/18 3:78ccc8e7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_89:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.642817542000003, 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016422573999999999, 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869086+0000", 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.869088+0000", 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9939999999999999e-06 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873478+0000", 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043902009999999998 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873514+0000", 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5525999999999998e-05 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873539+0000", 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5007e-05 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873713+0000", 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173585 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.873773+0000", 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0166e-05 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.885357+0000", 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011583776 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.885509+0000", 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015231899999999999 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2289 3.36 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.446934122000002, 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028794229000000001, 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2289 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:29.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064974+0000", 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5800000000000002e-06 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069897+0000", 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049227460000000004 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069939+0000", 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2376999999999998e-05 2024-04-17T15:39:29.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069964+0000", 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5015999999999999e-05 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070150+0000", 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018596500000000001 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070583+0000", 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043244600000000001 2024-04-17T15:39:29.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070838+0000", 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000255491 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093151+0000", 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022312304000000002 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093505+0000", 2024-04-17T15:39:29.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035477600000000001 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093610+0000", 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010493300000000001 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093764+0000", 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153595 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2293 3.a 3:53332383:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.405308296999998, 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021728066000000001, 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2293 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106598+0000", 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7599999999999998e-06 2024-04-17T15:39:29.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110394+0000", 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037959489999999999 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110433+0000", 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9289000000000003e-05 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110459+0000", 2024-04-17T15:39:29.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.51e-05 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110594+0000", 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013532299999999999 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110866+0000", 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027189100000000002 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:29.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.111110+0000", 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024460999999999998 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.127108+0000", 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015997838 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128143+0000", 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001034791 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128245+0000", 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101859 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128324+0000", 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8656e-05 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2654 3.2e e89/18 3:76a8e0a0:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_9:head v 89'5, mlcod=76'3)", 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.910276+0000", 2024-04-17T15:39:29.609 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.601627527, 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011130833, 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.910276+0000", 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.910276+0000", 2024-04-17T15:39:29.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.910277+0000", 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3000000000000001e-07 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.915568+0000", 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052911440000000002 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.915588+0000", 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9939e-05 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.915598+0000", 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7759999999999992e-06 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.915683+0000", 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5592000000000003e-05 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.915718+0000", 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5105999999999999e-05 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.921340+0000", 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056212730000000004 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.921407+0000", 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7472999999999996e-05 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2668 3.26 3:657fda54:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.27058593399999997, 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01928042, 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:29.614 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2668 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241320+0000", 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2749999999999998e-06 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247273+0000", 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059532719999999999 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247297+0000", 2024-04-17T15:39:29.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306e-05 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247308+0000", 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1248e-05 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247426+0000", 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011807300000000001 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:29.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247677+0000", 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025140299999999998 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247920+0000", 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024303399999999999 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.255818+0000", 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078976210000000005 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260460+0000", 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046419640000000002 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260537+0000", 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6971999999999994e-05 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260598+0000", 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1252000000000002e-05 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:29.620 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:29.620 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:29.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:29.622 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:29.621+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:29.722 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:29.721+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:29.805 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:29.806 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:29.806 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:29.806 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:29.814 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:39:29.822 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:29.821+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:29.824 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:29.922 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:29.921+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:30.008 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:30.008 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:30.009 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:30.009 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:30.009 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:30.023 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:30.021+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:30.026 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:30.124 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:30.125+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:30.214 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:30.214 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:30.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:30.214 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:30.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 162.138783171, 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:39:30.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:39:30.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 161.64675, 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.221 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:39:30.226 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 161.64671107699999, 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:30.227 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:39:30.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.232 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 161.646511495, 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 161.64646626300001, 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:39:30.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:39:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.243362046999998, 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:39:30.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:39:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2191 3.3b 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.164404216000001, 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024079896999999999, 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2191 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047034+0000", 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:39:30.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051686+0000", 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046523550000000004 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051729+0000", 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3032999999999999e-05 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051748+0000", 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9148999999999999e-05 2024-04-17T15:39:30.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051911+0000", 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016241300000000001 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052338+0000", 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000427549 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052584+0000", 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000245861 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.059685+0000", 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071007229999999998 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070946+0000", 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011261136 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071036+0000", 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0066000000000001e-05 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071110+0000", 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4609000000000003e-05 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2195 3.f 3:f0d50201:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.121846783999999, 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022167662000000001, 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.255 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2195 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089588+0000", 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.089591+0000", 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.134e-06 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093534+0000", 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039429010000000004 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093579+0000", 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5423000000000002e-05 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093601+0000", 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1622999999999999e-05 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.093781+0000", 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017973500000000001 2024-04-17T15:39:30.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094072+0000", 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029165799999999998 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.094318+0000", 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024528400000000002 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103355+0000", 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090377029999999994 2024-04-17T15:39:30.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111447+0000", 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080915640000000007 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111616+0000", 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016912200000000001 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.111756+0000", 2024-04-17T15:39:30.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013951499999999999 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.113240107000003, 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.261 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.266 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.103035282, 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2207 3.15 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.996923541000001, 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022770393999999999, 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.272 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2207 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:30.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214516+0000", 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.284e-06 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218674+0000", 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004158953 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218721+0000", 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6669999999999999e-05 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218749+0000", 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7846000000000001e-05 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218887+0000", 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013819200000000001 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219113+0000", 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022536100000000001 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219315+0000", 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020251500000000001 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232744+0000", 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013428796999999999 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.236964+0000", 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042205189999999998 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237138+0000", 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173198 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237282+0000", 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014405900000000001 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2214 3.2f e76/45 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.92229914, 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022854762000000001, 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289138+0000", 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293890+0000", 2024-04-17T15:39:30.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047525909999999996 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293918+0000", 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7742999999999998e-05 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293933+0000", 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4623e-05 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294082+0000", 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149662 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294148+0000", 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5345999999999994e-05 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311863+0000", 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017715564999999999 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311990+0000", 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012724899999999999 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2218 3.39 3:9d9d4055:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.884111085000001, 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023480399999999998, 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2218 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:30.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327327+0000", 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331723+0000", 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043962680000000001 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331760+0000", 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6903000000000002e-05 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331783+0000", 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3598999999999999e-05 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331906+0000", 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012282300000000001 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332168+0000", 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026144100000000001 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332408+0000", 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024071499999999999 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.345166+0000", 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012757961 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350543+0000", 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053770720000000001 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350728+0000", 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018468599999999999 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350804+0000", 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6066e-05 2024-04-17T15:39:30.287 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2237 3.2a e76/18 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.683645409999997, 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022753497000000001, 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527789+0000", 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527792+0000", 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7130000000000001e-06 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534227+0000", 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064349760000000002 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534276+0000", 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8996999999999999e-05 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534302+0000", 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6279e-05 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534552+0000", 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024917100000000002 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.534609+0000", 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7837000000000002e-05 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550416+0000", 2024-04-17T15:39:30.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015806222000000002 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550543+0000", 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012730200000000001 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:30.292 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.637487403000002, 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.509631188999997, 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.298 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:30.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.303 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2655 3.3b 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.2838441709999999, 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027395325000000002, 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2655 2024-04-17T15:39:30.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927594+0000", 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931218+0000", 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036242679999999999 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931243+0000", 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5072e-05 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931254+0000", 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931332+0000", 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8238999999999994e-05 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931477+0000", 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014441599999999999 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931605+0000", 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128959 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.937946+0000", 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063408049999999997 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954869+0000", 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016922554999999999 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954921+0000", 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2250999999999998e-05 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954986+0000", 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4843000000000002e-05 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2682 3.2d 3:b4597fd6:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.546954+0000", 2024-04-17T15:39:30.309 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.66448106299999998, 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022320336999999999, 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2682 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.546954+0000", 2024-04-17T15:39:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.546954+0000", 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.546957+0000", 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1999999999999999e-06 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.550615+0000", 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036580089999999998 2024-04-17T15:39:30.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.550640+0000", 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4822000000000001e-05 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.550650+0000", 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0464e-05 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.550776+0000", 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012586800000000001 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.550951+0000", 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175088 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.551099+0000", 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014764699999999999 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.557805+0000", 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006706442 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.569049+0000", 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011243678999999999 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.569158+0000", 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010917900000000001 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.569274+0000", 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115939 2024-04-17T15:39:30.314 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2689 3.2d 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.51083532700000001, 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029047231999999999, 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2689 2024-04-17T15:39:30.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700603+0000", 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1480000000000002e-06 2024-04-17T15:39:30.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704578+0000", 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039753929999999998 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704621+0000", 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2707999999999998e-05 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704638+0000", 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7711999999999999e-05 2024-04-17T15:39:30.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704752+0000", 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113894 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704982+0000", 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022947700000000001 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.705211+0000", 2024-04-17T15:39:30.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022907099999999999 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.713505+0000", 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082936940000000008 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729431+0000", 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015926419000000001 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729539+0000", 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108517 2024-04-17T15:39:30.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729647+0000", 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107199 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2717 3.11 3:8a343ec0:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.115663742, 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022786449, 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:30.320 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2717 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:30.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095773+0000", 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3460000000000001e-06 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099572+0000", 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037990350000000001 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099595+0000", 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2194000000000001e-05 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099605+0000", 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0125999999999999e-05 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099676+0000", 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1738999999999999e-05 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099813+0000", 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013640899999999999 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099941+0000", 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012855700000000001 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.105972+0000", 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060307570000000003 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:30.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118437+0000", 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012464761 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118491+0000", 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4240000000000002e-05 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118557+0000", 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6285000000000007e-05 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:30.326 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:30.326 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:30.326 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:39:30.328 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:30.325+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:30.329 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:30.428 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:30.429+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:30.529 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:30.529+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:30.537 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:30.537 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:30.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:30.568 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:30.591 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:30.612 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:30.612 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:30.629 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:30.629+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:30.634 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:30.674 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:30.674 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:30.716 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:30.729 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:30.730 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:30.729+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:30.747 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:30.747 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:30.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:30.777 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:30.777 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:30.855 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:30.857+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:30.929 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:30.931 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:30.933+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:30.948 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:31.033 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:31.033+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:31.133 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:31.133+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:31.135 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:31.136 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:31.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:31.234 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:31.233+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:31.298 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:31.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:31.368 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:31.369+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:31.405 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-17T15:39:31.406 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-17T15:39:31.406 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-04-17T15:39:31.406 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-17T15:39:31.406 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-17T15:39:31.406 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-04-17T15:39:31.435 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:31.433+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:31.484 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:31.536 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:31.537+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:31.560 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:31.560 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-17T15:39:31.560 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:31.637 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:31.637+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:31.691 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:31.713 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:31.738 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:31.737+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:31.840 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:31.837+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:31.905 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:31.921 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:31.964 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:31.965+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:32.042 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:32.041+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:32.053 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 1Gb. 2024-04-17T15:39:32.053 INFO:tasks.workunit.client.0.smithi044.stdout:upload file successful 2024-04-17T15:39:32.053 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:39:32.054 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-04-17T15:39:32.054 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:39:32.095 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:32.095 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:32.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:32.142 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:32.141+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:32.243 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:32.241+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:32.271 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:32.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:32.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:39:32.339 INFO:tasks.workunit.client.0.smithi044.stdout:user qa_user deleted 2024-04-17T15:39:32.339 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:39:32.384 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:32.385+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:32.441 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:32.445 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:32.445+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:32.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:32.547 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:32.545+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:32.620 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:32.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:32.683 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:32.685+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:32.748 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:32.749+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:32.772 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:32.773 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:32.788 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:32.810 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:32.856 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:32.857+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:32.949 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:32.949+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:32.951 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:32.952 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:32.956 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:32.957 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:32.970 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:32.970 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:32.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:32.987 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:33.003 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:33.004 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:33.024 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:33.024 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:33.043 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:33.044 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:33.059 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:33.061+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:33.061 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:33.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:33.079 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:33.149 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:33.149 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:33.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:33.149 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:33.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.149 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.325090154999998, 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.170912399000002, 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:39:33.155 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.159 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.158575906000003, 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:39:33.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:33.165 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.077539113999997, 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:33.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:39:33.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2210 3.9 3:93853e31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.902961541000003, 2024-04-17T15:39:33.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021814205, 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2210 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244581+0000", 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.244585+0000", 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8199999999999998e-06 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248808+0000", 2024-04-17T15:39:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004222689 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248846+0000", 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8062999999999998e-05 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.248866+0000", 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0443000000000001e-05 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249007+0000", 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014065200000000001 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249351+0000", 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034406699999999998 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.249759+0000", 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040812900000000002 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.261660+0000", 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011900834000000001 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266158+0000", 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044976039999999997 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266264+0000", 2024-04-17T15:39:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106179 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.266396+0000", 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013172499999999999 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2239 3.1a 3:59a3b68b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.605013710000001, 2024-04-17T15:39:33.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02117043, 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2239 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542529+0000", 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.542533+0000", 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1459999999999998e-06 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547455+0000", 2024-04-17T15:39:33.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049219700000000003 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547505+0000", 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9094999999999997e-05 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547533+0000", 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.813e-05 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547687+0000", 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015475600000000001 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.547958+0000", 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027019000000000001 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.548202+0000", 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244615 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.557187+0000", 2024-04-17T15:39:33.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0089846390000000009 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563517+0000", 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063303439999999999 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563622+0000", 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104652 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.563700+0000", 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7892999999999994e-05 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2246 3.3 3:c10f4bfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.531980687000001, 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022677520999999999, 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.183 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2246 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615562+0000", 2024-04-17T15:39:33.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.615601+0000", 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8197e-05 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623411+0000", 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007810773 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623455+0000", 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3263999999999998e-05 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623474+0000", 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9366000000000001e-05 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623637+0000", 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016321200000000001 2024-04-17T15:39:33.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.623894+0000", 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025645799999999999 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.624163+0000", 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026971999999999999 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.636351+0000", 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012188094 2024-04-17T15:39:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637944+0000", 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001592263 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638115+0000", 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017097799999999999 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638240+0000", 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125196 2024-04-17T15:39:33.188 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.521060251000002, 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.189 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:39:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:39:33.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:39:33.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.507602341000002, 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:33.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:39:33.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:39:33.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:39:33.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2254 3.11 e76/18 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head v 76'3, mlcod=71'1)", 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.439822434, 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019675885000000001, 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707721+0000", 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707724+0000", 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7129999999999999e-06 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711670+0000", 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039457720000000002 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711712+0000", 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.214e-05 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711734+0000", 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2158999999999999e-05 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711887+0000", 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015253900000000001 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.711952+0000", 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5173999999999996e-05 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727265+0000", 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015312622 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727396+0000", 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013176600000000001 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2283 3.1c e76/18 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.137574424999997, 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021912134, 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.203 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009969+0000", 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009971+0000", 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8899999999999999e-06 2024-04-17T15:39:33.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013348+0000", 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033769429999999999 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013391+0000", 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2339999999999998e-05 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013409+0000", 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8502999999999999e-05 2024-04-17T15:39:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013548+0000", 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138422 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.013591+0000", 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.375e-05 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031701+0000", 2024-04-17T15:39:33.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018109600999999999 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.031881+0000", 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017968500000000001 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2651 3.3 3:c1c33c87:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.835027+0000", 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.3125156350000005, 2024-04-17T15:39:33.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021497543000000001, 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2651 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.835027+0000", 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.835027+0000", 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.835029+0000", 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.886e-06 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.840361+0000", 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005331321 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.840388+0000", 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7674e-05 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.840400+0000", 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1657e-05 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.840492+0000", 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2427000000000001e-05 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.840611+0000", 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118297 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.840849+0000", 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023817200000000001 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.845445+0000", 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045957580000000001 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.856398+0000", 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010953071999999999 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.856465+0000", 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7415000000000004e-05 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.856525+0000", 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9864000000000001e-05 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2670 3.9 3:9110b884:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.291740+0000", 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.8558029330000001, 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020174827999999999, 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.213 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2670 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.291740+0000", 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.291740+0000", 2024-04-17T15:39:33.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.291743+0000", 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.88e-06 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.295438+0000", 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036945720000000001 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.295463+0000", 2024-04-17T15:39:33.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5684e-05 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.295476+0000", 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2514000000000001e-05 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.295577+0000", 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010118799999999999 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.295792+0000", 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021483900000000001 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.296005+0000", 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021357099999999999 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.301672+0000", 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056671050000000004 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.311784+0000", 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010111767000000001 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.311860+0000", 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5877000000000006e-05 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.311915+0000", 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4830999999999997e-05 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.218 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2671 3.3 3:c39e45bd:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.315476+0000", 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.832067136, 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020443237999999999, 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2671 2024-04-17T15:39:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.315476+0000", 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.315476+0000", 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.315478+0000", 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2539999999999999e-06 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.319459+0000", 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003981091 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.319500+0000", 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1134000000000003e-05 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.319524+0000", 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3986e-05 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.319652+0000", 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012751900000000001 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.319774+0000", 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012215699999999999 2024-04-17T15:39:33.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.319879+0000", 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104775 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.327442+0000", 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075631960000000003 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.335755+0000", 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0083127240000000005 2024-04-17T15:39:33.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.335849+0000", 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4559e-05 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.335919+0000", 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9843000000000002e-05 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2687 3.1a 3:5bebffce:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.660701+0000", 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.4868421070000002, 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021222479999999998, 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2687 2024-04-17T15:39:33.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.660701+0000", 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.660701+0000", 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.660704+0000", 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3699999999999999e-06 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.664607+0000", 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003902329 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.664644+0000", 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7169999999999998e-05 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.664661+0000", 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.766e-05 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.664815+0000", 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015323499999999999 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.665076+0000", 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026083399999999999 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.665312+0000", 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000236925 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.674887+0000", 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095750020000000009 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.681746+0000", 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068581229999999998 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.681844+0000", 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8213000000000003e-05 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.681923+0000", 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9618999999999998e-05 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.230 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2693 3.1a 3:5aa2660d:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.790566+0000", 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.3569770810000001, 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019468800000000001, 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.231 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2693 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.790566+0000", 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.790566+0000", 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.790568+0000", 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.317e-06 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.794616+0000", 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040477109999999998 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.794655+0000", 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8995999999999997e-05 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.794674+0000", 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8593e-05 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.794813+0000", 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013955599999999999 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.795055+0000", 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024191499999999999 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.795285+0000", 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000230301 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.803817+0000", 2024-04-17T15:39:33.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085320050000000005 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.809862+0000", 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060443800000000002 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.809962+0000", 2024-04-17T15:39:33.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000100523 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.810035+0000", 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2502999999999993e-05 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2701 3.3 3:c3da646c:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.2315433100000002, 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023302740999999998, 2024-04-17T15:39:33.237 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2701 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916003+0000", 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919735+0000", 2024-04-17T15:39:33.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037320090000000001 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919758+0000", 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3213e-05 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919769+0000", 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0692e-05 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919848+0000", 2024-04-17T15:39:33.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9340999999999998e-05 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.920004+0000", 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015543600000000001 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.920144+0000", 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140242 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.928075+0000", 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079310189999999992 2024-04-17T15:39:33.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939200+0000", 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011125245000000001 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939256+0000", 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6320000000000003e-05 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939302+0000", 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6026000000000003e-05 2024-04-17T15:39:33.242 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2743 3.34 3:2f634024:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.7428571480000001, 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025426936000000001, 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2743 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.243 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404706+0000", 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9983000000000002e-05 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408933+0000", 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042273040000000003 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408972+0000", 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8495000000000003e-05 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408990+0000", 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8219999999999998e-05 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.409170+0000", 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018019600000000001 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.409592+0000", 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042226600000000003 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410018+0000", 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042519299999999998 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.428938+0000", 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018920248000000001 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430015+0000", 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001077103 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430067+0000", 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2494000000000003e-05 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430113+0000", 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5433999999999999e-05 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2754 3.3 3:c015b210:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.6255043140000001, 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022904342000000001, 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.248 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2754 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522043+0000", 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8160000000000004e-06 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527193+0000", 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051507990000000002 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527235+0000", 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1306000000000001e-05 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527257+0000", 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2855999999999999e-05 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527445+0000", 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018744200000000001 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527846+0000", 2024-04-17T15:39:33.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040134300000000002 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.528089+0000", 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024270800000000001 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.537308+0000", 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092189520000000007 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544773+0000", 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074648049999999997 2024-04-17T15:39:33.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544869+0000", 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6643000000000003e-05 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544943+0000", 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3671999999999995e-05 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2762 3.1 e90/18 3:82c647bc:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_117:head v 90'7, mlcod=89'5)", 2024-04-17T15:39:33.253 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.5204892459999999, 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023406844999999999, 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627056+0000", 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5129999999999999e-06 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631125+0000", 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040686120000000001 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631161+0000", 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6239000000000003e-05 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631178+0000", 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6779999999999999e-05 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631336+0000", 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158379 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631401+0000", 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4331999999999993e-05 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.650306+0000", 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018905511 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.650461+0000", 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015447900000000001 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.257 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.258 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.258 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:33.259 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:33.260 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:33.257+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:39:33.360 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:33.361+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:33.435 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:33.436 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:33.436 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:33.436 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:33.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:33.496 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:33.497+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:33.562 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:33.561+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:33.627 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:33.627 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:33.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:33.662 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:33.661+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:33.763 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:33.761+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:33.816 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:33.816 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:33.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:33.816 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:33.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.816 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2182 3.22 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.874240264000001, 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020945306, 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2182 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940490+0000", 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946030+0000", 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055396229999999996 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946069+0000", 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9919999999999997e-05 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946095+0000", 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5769999999999999e-05 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946290+0000", 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019428800000000001 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946583+0000", 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029335100000000002 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946819+0000", 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023653699999999999 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960915+0000", 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014095721 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961184+0000", 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026861799999999998 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961321+0000", 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013719200000000001 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961432+0000", 2024-04-17T15:39:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111146 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2198 3.3a 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.697678818999997, 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026029244, 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2198 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117051+0000", 2024-04-17T15:39:33.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9059999999999998e-06 2024-04-17T15:39:33.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121284+0000", 2024-04-17T15:39:33.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042323589999999998 2024-04-17T15:39:33.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121335+0000", 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1643e-05 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121362+0000", 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6650000000000001e-05 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121586+0000", 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223928 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122021+0000", 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043530199999999999 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122505+0000", 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048423599999999998 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.134629+0000", 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012124118 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142907+0000", 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082773959999999994 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142998+0000", 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0828999999999994e-05 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143077+0000", 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9876999999999994e-05 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2202 3.30 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.650978223000003, 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023532595999999999, 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2202 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163753+0000", 2024-04-17T15:39:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9700000000000001e-06 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168372+0000", 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004618942 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168415+0000", 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3272000000000002e-05 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168433+0000", 2024-04-17T15:39:33.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8196999999999999e-05 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168572+0000", 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013865500000000001 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168828+0000", 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256328 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.169055+0000", 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000226331 2024-04-17T15:39:33.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.176874+0000", 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078199310000000005 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.186974+0000", 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010100012 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187144+0000", 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016979899999999999 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187281+0000", 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013715900000000001 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2206 3.2a 3:554687e0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.609581996999999, 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029258256, 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.834 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2206 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:33.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205148+0000", 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6900000000000001e-06 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211713+0000", 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065654110000000002 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211744+0000", 2024-04-17T15:39:33.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1232999999999997e-05 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211761+0000", 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6994e-05 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211928+0000", 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166195 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212314+0000", 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000385993 2024-04-17T15:39:33.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212704+0000", 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039051 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.223772+0000", 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067521 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234062+0000", 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010289918 2024-04-17T15:39:33.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234240+0000", 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000178302 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234403+0000", 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016348900000000001 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2225 3.36 e76/18 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:33.839 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.413663550999999, 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020106353, 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401067+0000", 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2200000000000001e-06 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404215+0000", 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031480280000000002 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404253+0000", 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8303999999999998e-05 2024-04-17T15:39:33.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404277+0000", 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4428999999999999e-05 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404428+0000", 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150402 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404496+0000", 2024-04-17T15:39:33.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8120000000000005e-05 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421035+0000", 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016538517999999999 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421170+0000", 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135332 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.843 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2230 3.3a 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.365751269, 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025252924, 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2230 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448979+0000", 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454011+0000", 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050315719999999998 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454055+0000", 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4382999999999998e-05 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454075+0000", 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0046000000000001e-05 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454276+0000", 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020055800000000001 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454721+0000", 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044527599999999998 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.455157+0000", 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043578999999999997 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.465942+0000", 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010784936 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474050+0000", 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081079250000000002 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474144+0000", 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4479000000000001e-05 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474229+0000", 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4486000000000004e-05 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2237 3.2a 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.292043208000003, 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028581945000000001, 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2237 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522688+0000", 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5260000000000004e-06 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526833+0000", 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004144427 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526875+0000", 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1715999999999998e-05 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526894+0000", 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9307e-05 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527045+0000", 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151201 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527303+0000", 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025805199999999999 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527546+0000", 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024263099999999999 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.543539+0000", 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015993657000000001 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550954+0000", 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074142239999999996 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551129+0000", 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017543100000000001 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551266+0000", 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136773 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2248 3.1c 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:33.854 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.179826401, 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028561188000000001, 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2248 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634905+0000", 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6530000000000002e-06 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638983+0000", 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040774130000000002 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639023+0000", 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0703e-05 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639048+0000", 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4437e-05 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639211+0000", 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016346500000000001 2024-04-17T15:39:33.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639455+0000", 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243324 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639679+0000", 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223935 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661540+0000", 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021861068000000001 2024-04-17T15:39:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663140+0000", 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016003860000000001 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663326+0000", 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018592500000000001 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663462+0000", 2024-04-17T15:39:33.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013587899999999999 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2259 3.22 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.061306506999998, 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023533335999999998, 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.860 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2259 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753424+0000", 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5669999999999999e-06 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757463+0000", 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040386470000000002 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757507+0000", 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4393e-05 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757537+0000", 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9473000000000001e-05 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757736+0000", 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019940800000000001 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757980+0000", 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244398 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.758213+0000", 2024-04-17T15:39:33.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023253799999999999 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.766682+0000", 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084694950000000005 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776706+0000", 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010023676 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776825+0000", 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118396 2024-04-17T15:39:33.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776954+0000", 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129345 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2283 3.1c 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.810520742000001, 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028433096000000001, 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.865 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2283 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:33.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004210+0000", 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2770000000000001e-06 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008596+0000", 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043866770000000003 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008636+0000", 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9767000000000001e-05 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008655+0000", 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9083e-05 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008831+0000", 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017611100000000001 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009255+0000", 2024-04-17T15:39:33.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042393699999999999 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009704+0000", 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044862299999999999 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.029616+0000", 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019912474999999999 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032482+0000", 2024-04-17T15:39:33.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028657439999999999 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032575+0000", 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3146000000000006e-05 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032639+0000", 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4256000000000003e-05 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2287 3.1c 3:3a30054e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.770256828000001, 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020107487, 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2287 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044473+0000", 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048619+0000", 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041462959999999998 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048657+0000", 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7911999999999999e-05 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048681+0000", 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3873999999999999e-05 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048815+0000", 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000133869 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049079+0000", 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026408099999999999 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049312+0000", 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023292399999999999 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.062430+0000", 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013118747 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064257+0000", 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268959999999999 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064443+0000", 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018521499999999999 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064578+0000", 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013511600000000001 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2289 3.36 e76/18 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.743667745000003, 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022085479000000002, 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071062+0000", 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2290000000000002e-06 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074727+0000", 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036655809999999998 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074765+0000", 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7778999999999999e-05 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074782+0000", 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246999999999999e-05 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074948+0000", 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016588900000000001 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075033+0000", 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4602000000000001e-05 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093017+0000", 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017984473000000001 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093145+0000", 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012767900000000001 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2290 3.5 3:a1064484:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.738802089000004, 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023102762999999998, 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.880 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2290 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:33.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075928+0000", 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080045+0000", 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041169969999999998 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080083+0000", 2024-04-17T15:39:33.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7196000000000001e-05 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080109+0000", 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6373e-05 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080259+0000", 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015042899999999999 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080519+0000", 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025933100000000001 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080748+0000", 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022913100000000001 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.095782+0000", 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015033902 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098708+0000", 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029261339999999999 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098890+0000", 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000182222 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.099028+0000", 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137575 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2694 3.30 3:0c0bbe39:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.813697+0000", 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.0010297489999997, 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021002597000000001, 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2694 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.813697+0000", 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.813697+0000", 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.813700+0000", 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4820000000000001e-06 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817495+0000", 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037950179999999998 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817530+0000", 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5144000000000001e-05 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817546+0000", 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5940999999999999e-05 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817735+0000", 2024-04-17T15:39:33.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018912000000000001 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817982+0000", 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024725399999999997 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.818219+0000", 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023652800000000001 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.824901+0000", 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066817450000000002 2024-04-17T15:39:33.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.834608+0000", 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0097070179999999995 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.834660+0000", 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2929000000000001e-05 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.834700+0000", 2024-04-17T15:39:33.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9418000000000001e-05 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2704 3.28 3:1508c84f:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.950561+0000", 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.8641657179999997, 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022024485, 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2704 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.950561+0000", 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.950561+0000", 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.950564+0000", 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.965e-06 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954427+0000", 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038625809999999999 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954452+0000", 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5326000000000001e-05 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954466+0000", 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3964e-05 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954559+0000", 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2419999999999999e-05 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954745+0000", 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186174 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954870+0000", 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012526700000000001 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.961200+0000", 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063298290000000004 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.972415+0000", 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011215101 2024-04-17T15:39:33.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.972517+0000", 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101925 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.972586+0000", 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8932999999999999e-05 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2723 3.35 e89/18 3:acec52b7:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_78:head v 89'9, mlcod=89'7)", 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.177879+0000", 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.6368480320000001, 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022590208000000001, 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177879+0000", 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177879+0000", 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177881+0000", 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.891e-06 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180535+0000", 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026541540000000001 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180560+0000", 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4771000000000001e-05 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180572+0000", 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2532e-05 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180725+0000", 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015307999999999999 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180763+0000", 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7769999999999999e-05 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200381+0000", 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019617992000000001 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200469+0000", 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8017999999999997e-05 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.900 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2736 3.5 3:a18cd429:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.4902023639999999, 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.031892391999999999, 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2736 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:39:33.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324528+0000", 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.056e-06 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329199+0000", 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004671171 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329244+0000", 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4765999999999998e-05 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329263+0000", 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9426999999999999e-05 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329381+0000", 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117856 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329387+0000", 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2929999999999997e-06 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.334989+0000", 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056018659999999996 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.335183+0000", 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000194284 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.335374+0000", 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000190259 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.340432+0000", 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050583310000000001 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356298+0000", 2024-04-17T15:39:33.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015865945999999999 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356355+0000", 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7312000000000003e-05 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356417+0000", 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1824999999999998e-05 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2745 3.2a 3:55f28608:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.425878+0000", 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.3888490710000001, 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02490902, 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2745 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.425878+0000", 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.425878+0000", 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.425881+0000", 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0790000000000001e-06 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429938+0000", 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040571510000000002 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429996+0000", 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7370000000000001e-05 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430023+0000", 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7489999999999999e-05 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430194+0000", 2024-04-17T15:39:33.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171084 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430636+0000", 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044166300000000002 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.431064+0000", 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042786700000000002 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.446040+0000", 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014976227999999999 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450455+0000", 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044150279999999997 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450641+0000", 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018558499999999999 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450787+0000", 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146475 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2746 3.22 3:47e1b608:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.379502708, 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025681591, 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.912 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2746 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435227+0000", 2024-04-17T15:39:33.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.604e-06 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439128+0000", 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003901121 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439155+0000", 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7311999999999999e-05 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439166+0000", 2024-04-17T15:39:33.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0437e-05 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439277+0000", 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111181 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439514+0000", 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237338 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439734+0000", 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219681 2024-04-17T15:39:33.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450454+0000", 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010719553 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460592+0000", 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010138263999999999 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460778+0000", 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018652799999999999 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460906+0000", 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000127572 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2751 3.1d 3:b9afbdb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.489794+0000", 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.32493346, 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022202605, 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:33.917 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2751 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.489794+0000", 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.489794+0000", 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.489798+0000", 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.104e-06 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494224+0000", 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044261209999999999 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494279+0000", 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4929000000000002e-05 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:33.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494306+0000", 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6863e-05 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494445+0000", 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013908099999999999 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494649+0000", 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204785 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:33.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494876+0000", 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022674699999999999 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.502293+0000", 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007416499 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.511684+0000", 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093915630000000003 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:33.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.511861+0000", 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017623399999999999 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.511996+0000", 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013567900000000001 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:33.922 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:33.924 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:33.924 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:33.925+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:34.025 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:34.025+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:34.054 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:34.054 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:34.054 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:34.054 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:34.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:34.126 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:34.125+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:34.195 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:34.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:34.195 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:34.195 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:34.196 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:34.211 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:34.255 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:34.257+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:34.327 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:34.325+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 152.13447187, 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.386 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:34.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 52.581129615999998, 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.393 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:39:34.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2183 3.35 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.431495148000003, 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028592128000000001, 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2183 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953097+0000", 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2139999999999998e-06 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960326+0000", 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072287250000000001 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960458+0000", 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013165599999999999 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960485+0000", 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7455999999999999e-05 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960672+0000", 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961101+0000", 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042912000000000001 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961545+0000", 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044391599999999998 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.980369+0000", 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018824257 2024-04-17T15:39:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981505+0000", 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011363339999999999 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981610+0000", 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104249 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981685+0000", 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5369000000000003e-05 2024-04-17T15:39:34.403 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2187 3.20 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.385503706000002, 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020078048000000001, 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.404 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2187 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999089+0000", 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6369999999999998e-06 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003407+0000", 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043177679999999996 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003446+0000", 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666999999999998e-05 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003473+0000", 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-05 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003668+0000", 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019524399999999999 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003925+0000", 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025612500000000001 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:34.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.004147+0000", 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222704 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014024+0000", 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098762980000000004 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.018985+0000", 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049610729999999999 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019082+0000", 2024-04-17T15:39:34.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7758999999999997e-05 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019162+0000", 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0003e-05 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2200 3.1e e76/18 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.240729408999997, 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019523622000000001, 2024-04-17T15:39:34.409 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:34.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:34.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2600000000000002e-07 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148444+0000", 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045848859999999998 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148482+0000", 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7975999999999997e-05 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148503+0000", 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0713e-05 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148684+0000", 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018094899999999999 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148752+0000", 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8325999999999996e-05 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163218+0000", 2024-04-17T15:39:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014465660999999999 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163382+0000", 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016448499999999999 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2209 3.36 3:6e4caeb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.150306567000001, 2024-04-17T15:39:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028046186000000001, 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2209 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234287+0000", 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5160000000000002e-06 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241867+0000", 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075797390000000003 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241907+0000", 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0401999999999997e-05 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241926+0000", 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9179999999999999e-05 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242060+0000", 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013408300000000001 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242320+0000", 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025917699999999998 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242624+0000", 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000304574 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.255662+0000", 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013038131 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262099+0000", 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064368660000000003 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262247+0000", 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148202 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262328+0000", 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0315999999999995e-05 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2221 3.2c 3:3579995b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.029111776000001, 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022481615, 2024-04-17T15:39:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2221 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355480+0000", 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.58e-06 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360595+0000", 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051151290000000004 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360643+0000", 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8313999999999999e-05 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360667+0000", 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4125e-05 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360807+0000", 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013905999999999999 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361054+0000", 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024716799999999998 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361268+0000", 2024-04-17T15:39:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000214768 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.372233+0000", 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010965044 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377661+0000", 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054271830000000004 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377836+0000", 2024-04-17T15:39:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017558100000000001 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377958+0000", 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121663 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2225 3.36 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.988455348000002, 2024-04-17T15:39:34.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025820422999999999, 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2225 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396136+0000", 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2339999999999999e-06 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400026+0000", 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038900950000000001 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400069+0000", 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2979999999999998e-05 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400093+0000", 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3896e-05 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400243+0000", 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015054599999999999 2024-04-17T15:39:34.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400526+0000", 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000283007 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400800+0000", 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027318399999999999 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.411636+0000", 2024-04-17T15:39:34.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01083604 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421617+0000", 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099808669999999992 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421810+0000", 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000193155 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421953+0000", 2024-04-17T15:39:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014341899999999999 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2247 3.34 e76/18 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.753213287000001, 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030485694000000001, 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631378+0000", 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0429999999999999e-06 2024-04-17T15:39:34.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637843+0000", 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064650599999999999 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637892+0000", 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8899000000000001e-05 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637915+0000", 2024-04-17T15:39:34.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2903000000000001e-05 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638070+0000", 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155289 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638133+0000", 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2955999999999998e-05 2024-04-17T15:39:34.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661702+0000", 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023568782999999999 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661860+0000", 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015876099999999999 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2249 3.20 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.739614185000001, 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02987182, 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2249 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644979+0000", 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-04-17T15:39:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652360+0000", 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073812269999999998 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652401+0000", 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1316999999999998e-05 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652421+0000", 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9687e-05 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652563+0000", 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014209499999999999 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652811+0000", 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024760400000000001 2024-04-17T15:39:34.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.653043+0000", 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231998 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667188+0000", 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014145342 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674671+0000", 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074827380000000001 2024-04-17T15:39:34.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674769+0000", 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7838999999999996e-05 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674846+0000", 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7072999999999999e-05 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.444 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2262 3.26 3:6636822f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.602252710000002, 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020197527, 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2262 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782340+0000", 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3370000000000001e-06 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786395+0000", 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040552740000000002 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786450+0000", 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4846999999999999e-05 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786478+0000", 2024-04-17T15:39:34.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.811e-05 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786621+0000", 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142798 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786898+0000", 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027743800000000002 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.787136+0000", 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:34.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.797168+0000", 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010032350000000001 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802156+0000", 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049883000000000002 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802329+0000", 2024-04-17T15:39:34.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017284099999999999 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802533+0000", 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020359800000000001 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2266 3.a 3:523a9b7a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.557850692999999, 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020319462, 2024-04-17T15:39:34.450 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2266 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826740+0000", 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-06 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830715+0000", 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039743479999999999 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830753+0000", 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8192999999999998e-05 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830771+0000", 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8139999999999999e-05 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830972+0000", 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201595 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831209+0000", 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023676799999999999 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831439+0000", 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022980799999999999 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.845969+0000", 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014529553000000001 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846744+0000", 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077553300000000002 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846916+0000", 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171695 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.847057+0000", 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141049 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.455 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2289 3.36 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.319618405, 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028794229000000001, 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2289 2024-04-17T15:39:34.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064974+0000", 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5800000000000002e-06 2024-04-17T15:39:34.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069897+0000", 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049227460000000004 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069939+0000", 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2376999999999998e-05 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069964+0000", 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5015999999999999e-05 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070150+0000", 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018596500000000001 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070583+0000", 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043244600000000001 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070838+0000", 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000255491 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093151+0000", 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022312304000000002 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093505+0000", 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035477600000000001 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093610+0000", 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010493300000000001 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093764+0000", 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153595 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.461 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2293 3.a 3:53332383:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.277992580000003, 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021728066000000001, 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2293 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106598+0000", 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7599999999999998e-06 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110394+0000", 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037959489999999999 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110433+0000", 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9289000000000003e-05 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110459+0000", 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.51e-05 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110594+0000", 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013532299999999999 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110866+0000", 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027189100000000002 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.111110+0000", 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024460999999999998 2024-04-17T15:39:34.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.127108+0000", 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015997838 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128143+0000", 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001034791 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128245+0000", 2024-04-17T15:39:34.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101859 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128324+0000", 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8656e-05 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2668 3.26 3:657fda54:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:34.467 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1432702170000004, 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01928042, 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2668 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:34.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241320+0000", 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2749999999999998e-06 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247273+0000", 2024-04-17T15:39:34.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059532719999999999 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247297+0000", 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306e-05 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247308+0000", 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1248e-05 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247426+0000", 2024-04-17T15:39:34.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011807300000000001 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247677+0000", 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025140299999999998 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247920+0000", 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024303399999999999 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.255818+0000", 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078976210000000005 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260460+0000", 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046419640000000002 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260537+0000", 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6971999999999994e-05 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260598+0000", 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1252000000000002e-05 2024-04-17T15:39:34.472 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2675 3.20 3:05d5fe92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.9782026259999999, 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020675137, 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.473 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2675 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406389+0000", 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410448+0000", 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004059961 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410484+0000", 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5676000000000002e-05 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410501+0000", 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6506000000000001e-05 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410583+0000", 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2711000000000001e-05 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410735+0000", 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197600000000001 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:34.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410871+0000", 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013602500000000001 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.415155+0000", 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004283706 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.426964+0000", 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011808637 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.427018+0000", 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4342000000000002e-05 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.427061+0000", 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2549999999999997e-05 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2723 3.35 3:acec52b7:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:34.478 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.2114298610000001, 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027979833999999999, 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2723 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173162+0000", 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3569999999999998e-06 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177293+0000", 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041312199999999997 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177335+0000", 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2026e-05 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177352+0000", 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7292999999999999e-05 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177446+0000", 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3929000000000001e-05 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177594+0000", 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014783 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177714+0000", 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120328 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.186751+0000", 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090370250000000006 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200795+0000", 2024-04-17T15:39:34.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014044176 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200990+0000", 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000194904 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.201138+0000", 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000147746 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2743 3.34 e90/18 3:2f634024:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_98:head v 90'4, mlcod=89'2)", 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.9742860090000001, 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019401910000000001, 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410303+0000", 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8700000000000004e-07 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414523+0000", 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042196400000000002 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414555+0000", 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2101999999999999e-05 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414579+0000", 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4003e-05 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414711+0000", 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132383 2024-04-17T15:39:34.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414780+0000", 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8936000000000005e-05 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429545+0000", 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014764823999999999 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429704+0000", 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159135 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.487 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2748 3.36 3:6c2725e9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.9262575910000002, 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021509582999999999, 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2748 2024-04-17T15:39:34.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458333+0000", 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:39:34.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462083+0000", 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037501040000000002 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462107+0000", 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4278e-05 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462122+0000", 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4289e-05 2024-04-17T15:39:34.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462272+0000", 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015080099999999999 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462582+0000", 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030927100000000001 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462855+0000", 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027330099999999999 2024-04-17T15:39:34.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.476558+0000", 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013703473000000001 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479667+0000", 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031088439999999999 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479765+0000", 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7820999999999997e-05 2024-04-17T15:39:34.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479840+0000", 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5041000000000002e-05 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2750 3.20 3:07eaa1ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.904584657, 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020193289, 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:34.493 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2750 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480006+0000", 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.463e-06 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485236+0000", 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052299909999999998 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485275+0000", 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9153000000000003e-05 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485295+0000", 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0412999999999999e-05 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485469+0000", 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017371500000000001 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485744+0000", 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027470100000000003 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.486016+0000", 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027220100000000002 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494631+0000", 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086144940000000003 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.499969+0000", 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053388300000000001 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.500108+0000", 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138892 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.500197+0000", 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8436000000000005e-05 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:34.499 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:34.500 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:34.501 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:34.501+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:34.602 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:34.601+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:34.630 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:34.630 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:34.630 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:34.630 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:34.646 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:34.731 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:34.733+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:34.803 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:34.805+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:34.816 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:34.816 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:34.816 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:34.816 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:34.816 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:34.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:34.919 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:34.921+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:35.005 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 166.93122597600001, 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:35.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:39:35.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:39:35.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:35.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:35.012 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 166.439192805, 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:39:35.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:39:35.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 166.439153882, 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:39:35.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 166.43895430000001, 2024-04-17T15:39:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:39:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:39:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 166.43890906799999, 2024-04-17T15:39:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 43.035804851999998, 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:39:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2191 3.3b 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.956847021000002, 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024079896999999999, 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2191 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047034+0000", 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051686+0000", 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046523550000000004 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051729+0000", 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3032999999999999e-05 2024-04-17T15:39:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051748+0000", 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9148999999999999e-05 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051911+0000", 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016241300000000001 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052338+0000", 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000427549 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052584+0000", 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000245861 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.059685+0000", 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071007229999999998 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070946+0000", 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011261136 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071036+0000", 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0066000000000001e-05 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071110+0000", 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4609000000000003e-05 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.905682912000003, 2024-04-17T15:39:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.895478087000001, 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:39:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:39:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2207 3.15 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.789366346000001, 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022770393999999999, 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2207 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214516+0000", 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.284e-06 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218674+0000", 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004158953 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218721+0000", 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6669999999999999e-05 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218749+0000", 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7846000000000001e-05 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218887+0000", 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013819200000000001 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219113+0000", 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022536100000000001 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219315+0000", 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020251500000000001 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232744+0000", 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013428796999999999 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.236964+0000", 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042205189999999998 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237138+0000", 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173198 2024-04-17T15:39:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237282+0000", 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014405900000000001 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2214 3.2f e76/45 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.714741945, 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022854762000000001, 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289138+0000", 2024-04-17T15:39:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293890+0000", 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047525909999999996 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293918+0000", 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7742999999999998e-05 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293933+0000", 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4623e-05 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294082+0000", 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149662 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294148+0000", 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5345999999999994e-05 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311863+0000", 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017715564999999999 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311990+0000", 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012724899999999999 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2218 3.39 3:9d9d4055:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.676553890000001, 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023480399999999998, 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2218 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327327+0000", 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331723+0000", 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043962680000000001 2024-04-17T15:39:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331760+0000", 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6903000000000002e-05 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331783+0000", 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3598999999999999e-05 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331906+0000", 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012282300000000001 2024-04-17T15:39:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332168+0000", 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026144100000000001 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332408+0000", 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024071499999999999 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.345166+0000", 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012757961 2024-04-17T15:39:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350543+0000", 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053770720000000001 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350728+0000", 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018468599999999999 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350804+0000", 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6066e-05 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.429930208000002, 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:39:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.302073993999997, 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:39:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:39:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:39:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2655 3.3b 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.0762869760000005, 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027395325000000002, 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2655 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927594+0000", 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931218+0000", 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036242679999999999 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931243+0000", 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5072e-05 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931254+0000", 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931332+0000", 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8238999999999994e-05 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931477+0000", 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014441599999999999 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931605+0000", 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128959 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.937946+0000", 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063408049999999997 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954869+0000", 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016922554999999999 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954921+0000", 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2250999999999998e-05 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954986+0000", 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4843000000000002e-05 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2689 3.2d 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.303278132, 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029047231999999999, 2024-04-17T15:39:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2689 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700603+0000", 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1480000000000002e-06 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704578+0000", 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039753929999999998 2024-04-17T15:39:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704621+0000", 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2707999999999998e-05 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704638+0000", 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7711999999999999e-05 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704752+0000", 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113894 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704982+0000", 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022947700000000001 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.705211+0000", 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022907099999999999 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.713505+0000", 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082936940000000008 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729431+0000", 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015926419000000001 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729539+0000", 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108517 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729647+0000", 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107199 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2717 3.11 3:8a343ec0:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.908106547, 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022786449, 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2717 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095773+0000", 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3460000000000001e-06 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099572+0000", 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037990350000000001 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099595+0000", 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2194000000000001e-05 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099605+0000", 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0125999999999999e-05 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099676+0000", 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1738999999999999e-05 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099813+0000", 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013640899999999999 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099941+0000", 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012855700000000001 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.105972+0000", 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060307570000000003 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118437+0000", 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012464761 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118491+0000", 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4240000000000002e-05 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118557+0000", 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6285000000000007e-05 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2741 3.39 3:9f26ba31:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.6245505180000004, 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027414362000000001, 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2741 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379330+0000", 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1599999999999998e-06 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383931+0000", 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046010790000000001 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383974+0000", 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2700000000000001e-05 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383993+0000", 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8938999999999999e-05 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384090+0000", 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7207000000000006e-05 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384097+0000", 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4309999999999999e-06 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388621+0000", 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045244179999999997 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388822+0000", 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020077199999999999 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388956+0000", 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013419500000000001 2024-04-17T15:39:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.394950+0000", 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059936980000000004 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406560+0000", 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011610448000000001 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406665+0000", 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104949 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406741+0000", 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6365999999999994e-05 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2744 3.11 3:88cda062:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.5887738320000002, 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024291046, 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2744 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415108+0000", 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5399999999999997e-06 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.418996+0000", 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038875849999999998 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419040+0000", 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3696999999999999e-05 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419059+0000", 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.897e-05 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419168+0000", 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010971 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419367+0000", 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019839900000000001 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419540+0000", 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017327799999999999 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.436287+0000", 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016746727999999999 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439104+0000", 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028172520000000001 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439275+0000", 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017058500000000001 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439395+0000", 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120302 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2767 3.f 3:f0d8e033:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.3237720319999999, 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024335816999999999, 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:35.111 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2767 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:35.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680108+0000", 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7640000000000001e-06 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684062+0000", 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039540349999999998 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684097+0000", 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4517000000000002e-05 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684114+0000", 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7469000000000002e-05 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684225+0000", 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110746 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684469+0000", 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243911 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684718+0000", 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024909800000000001 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.701761+0000", 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017042486999999999 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704218+0000", 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024576820000000001 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704315+0000", 2024-04-17T15:39:35.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6482000000000002e-05 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704441+0000", 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012662599999999999 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:35.116 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:35.117 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:35.005+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:35.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:35.118 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:35.119 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:35.121+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:35.220 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:35.221+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:35.248 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:35.248 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:35.248 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:35.249 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:35.266 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:35.278 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:35.279 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:35.297 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:35.297 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:35.313 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:35.314 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:35.321 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:35.321+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:35.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:39:35.332 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:35.332 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:35.354 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:35.354 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:35.375 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:35.387 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:35.387 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:35.396 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:35.397 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:35.403 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:35.418 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:35.419 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:35.422 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:35.421+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:35.522 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:35.521+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:35.537 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:35.537 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:35.551 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:35.624 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:35.625+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:35.704 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:35.704 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:35.718 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:35.724 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:35.725+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:35.825 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:35.825+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:35.843 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:35.844 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:35.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:35.927 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:35.925+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:36.025 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:36.025 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:36.027 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:36.029+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:36.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:36.128 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:36.129+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:36.164 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:36.165 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:36.179 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:36.229 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:36.229+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:36.306 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:36.306 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:36.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:36.330 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:36.329+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:39:36.431 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:36.433+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:36.445 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:36.446 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:36.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:36.532 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:36.533+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:36.585 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:36.586 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:36.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:36.633 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:36.633+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:36.734 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:36.733+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:36.773 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:36.773 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:36.787 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:36.836 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:36.837+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:36.912 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:36.912 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:36.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:36.971 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:36.973+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:37.036 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:37.037+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:37.061 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:37.061 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:37.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:37.163 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:37.165+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:37.238 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:37.237+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:37.241 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:37.255 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:37.339 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:37.337+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:37.427 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:37.439 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:37.440 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:37.441+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:37.442 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:37.541 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:37.541+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:37.571 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:37.571 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:37.586 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:37.600 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:37.600 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:37.617 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:37.634 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:37.635 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:37.642 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:37.641+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:37.653 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:37.653 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:37.672 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:37.691 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:37.692 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:37.707 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:37.707 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:37.707 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:37.707 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:37.707 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:37.713 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:37.714 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:37.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:37.734 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:37.734 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:37.763 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:37.765+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:37.844 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:37.845+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:37.890 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:37.890 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:37.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2182 3.22 3:453dc06c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.949526947999999, 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020945306, 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2182 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940487+0000", 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.940490+0000", 2024-04-17T15:39:37.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946030+0000", 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055396229999999996 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946069+0000", 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9919999999999997e-05 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946095+0000", 2024-04-17T15:39:37.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5769999999999999e-05 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946290+0000", 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019428800000000001 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946583+0000", 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029335100000000002 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.946819+0000", 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023653699999999999 2024-04-17T15:39:37.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960915+0000", 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014095721 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961184+0000", 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026861799999999998 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961321+0000", 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013719200000000001 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961432+0000", 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111146 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2198 3.3a 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.772965503000002, 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026029244, 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2198 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117051+0000", 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9059999999999998e-06 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121284+0000", 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042323589999999998 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121335+0000", 2024-04-17T15:39:37.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1643e-05 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121362+0000", 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6650000000000001e-05 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121586+0000", 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223928 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122021+0000", 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043530199999999999 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122505+0000", 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048423599999999998 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.134629+0000", 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012124118 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142907+0000", 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082773959999999994 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142998+0000", 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0828999999999994e-05 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143077+0000", 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9876999999999994e-05 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.901 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2202 3.30 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.726264907000001, 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023532595999999999, 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.902 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2202 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163749+0000", 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163753+0000", 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9700000000000001e-06 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168372+0000", 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004618942 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168415+0000", 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3272000000000002e-05 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168433+0000", 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8196999999999999e-05 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168572+0000", 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013865500000000001 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.168828+0000", 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000256328 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.169055+0000", 2024-04-17T15:39:37.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000226331 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.176874+0000", 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078199310000000005 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.186974+0000", 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010100012 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187144+0000", 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016979899999999999 2024-04-17T15:39:37.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.187281+0000", 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013715900000000001 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2206 3.2a 3:554687e0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.684868680999998, 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029258256, 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.907 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2206 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205148+0000", 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6900000000000001e-06 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211713+0000", 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065654110000000002 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211744+0000", 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1232999999999997e-05 2024-04-17T15:39:37.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211761+0000", 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6994e-05 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211928+0000", 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166195 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212314+0000", 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000385993 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212704+0000", 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039051 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.223772+0000", 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067521 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234062+0000", 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010289918 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234240+0000", 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000178302 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234403+0000", 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016348900000000001 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2225 3.36 e76/18 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.488950234999997, 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020106353, 2024-04-17T15:39:37.913 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401064+0000", 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.401067+0000", 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2200000000000001e-06 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404215+0000", 2024-04-17T15:39:37.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031480280000000002 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404253+0000", 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8303999999999998e-05 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404277+0000", 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4428999999999999e-05 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404428+0000", 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150402 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.404496+0000", 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8120000000000005e-05 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421035+0000", 2024-04-17T15:39:37.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016538517999999999 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421170+0000", 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135332 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2230 3.3a 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:37.918 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.441037952999999, 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025252924, 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2230 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448976+0000", 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.448979+0000", 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454011+0000", 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050315719999999998 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454055+0000", 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4382999999999998e-05 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454075+0000", 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0046000000000001e-05 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454276+0000", 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020055800000000001 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.454721+0000", 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044527599999999998 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.455157+0000", 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043578999999999997 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.465942+0000", 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010784936 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474050+0000", 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081079250000000002 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474144+0000", 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4479000000000001e-05 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.474229+0000", 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4486000000000004e-05 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2237 3.2a 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.367329892000001, 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028581945000000001, 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2237 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522688+0000", 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5260000000000004e-06 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526833+0000", 2024-04-17T15:39:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004144427 2024-04-17T15:39:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526875+0000", 2024-04-17T15:39:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1715999999999998e-05 2024-04-17T15:39:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526894+0000", 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9307e-05 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527045+0000", 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151201 2024-04-17T15:39:37.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527303+0000", 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025805199999999999 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527546+0000", 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024263099999999999 2024-04-17T15:39:37.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.543539+0000", 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015993657000000001 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550954+0000", 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074142239999999996 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551129+0000", 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017543100000000001 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551266+0000", 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136773 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.933 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2248 3.1c 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.255113084999998, 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028561188000000001, 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.934 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2248 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634905+0000", 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6530000000000002e-06 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638983+0000", 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040774130000000002 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639023+0000", 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0703e-05 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639048+0000", 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4437e-05 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639211+0000", 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016346500000000001 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639455+0000", 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243324 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639679+0000", 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223935 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661540+0000", 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021861068000000001 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663140+0000", 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016003860000000001 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663326+0000", 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018592500000000001 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663462+0000", 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013587899999999999 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2259 3.22 3:46c1eef1:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.136593191000003, 2024-04-17T15:39:37.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023533335999999998, 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2259 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.942 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753421+0000", 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.753424+0000", 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5669999999999999e-06 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757463+0000", 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040386470000000002 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757507+0000", 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4393e-05 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757537+0000", 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9473000000000001e-05 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757736+0000", 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019940800000000001 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.757980+0000", 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000244398 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:37.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.758213+0000", 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023253799999999999 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.766682+0000", 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084694950000000005 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776706+0000", 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010023676 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776825+0000", 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118396 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.776954+0000", 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129345 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.948 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2283 3.1c 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.885807426, 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028433096000000001, 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.949 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2283 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004210+0000", 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2770000000000001e-06 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008596+0000", 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043866770000000003 2024-04-17T15:39:37.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008636+0000", 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9767000000000001e-05 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008655+0000", 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9083e-05 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008831+0000", 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017611100000000001 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009255+0000", 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042393699999999999 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009704+0000", 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044862299999999999 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.029616+0000", 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019912474999999999 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032482+0000", 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028657439999999999 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032575+0000", 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3146000000000006e-05 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032639+0000", 2024-04-17T15:39:37.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4256000000000003e-05 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2287 3.1c 3:3a30054e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.845543511999999, 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020107487, 2024-04-17T15:39:37.956 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2287 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044470+0000", 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.044473+0000", 2024-04-17T15:39:37.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5569999999999998e-06 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048619+0000", 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041462959999999998 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048657+0000", 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7911999999999999e-05 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048681+0000", 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3873999999999999e-05 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.048815+0000", 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000133869 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049079+0000", 2024-04-17T15:39:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026408099999999999 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.049312+0000", 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023292399999999999 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.062430+0000", 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013118747 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064257+0000", 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268959999999999 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064443+0000", 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018521499999999999 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064578+0000", 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013511600000000001 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2289 3.36 e76/18 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head v 76'3, mlcod=76'1)", 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.818954429000001, 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022085479000000002, 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071059+0000", 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.071062+0000", 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2290000000000002e-06 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074727+0000", 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036655809999999998 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074765+0000", 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7778999999999999e-05 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074782+0000", 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246999999999999e-05 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.074948+0000", 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016588900000000001 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075033+0000", 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4602000000000001e-05 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093017+0000", 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017984473000000001 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093145+0000", 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012767900000000001 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2290 3.5 3:a1064484:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.814088773000002, 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023102762999999998, 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.968 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2290 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075925+0000", 2024-04-17T15:39:37.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.075928+0000", 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.473e-06 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080045+0000", 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041169969999999998 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080083+0000", 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7196000000000001e-05 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080109+0000", 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6373e-05 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080259+0000", 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015042899999999999 2024-04-17T15:39:37.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080519+0000", 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025933100000000001 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.080748+0000", 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022913100000000001 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.095782+0000", 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015033902 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098708+0000", 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029261339999999999 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.098890+0000", 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000182222 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.099028+0000", 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137575 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2694 3.30 3:0c0bbe39:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:37.974 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.813697+0000", 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.0763164330000006, 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021002597000000001, 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2694 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.975 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.813697+0000", 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.813697+0000", 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.813700+0000", 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4820000000000001e-06 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817495+0000", 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037950179999999998 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817530+0000", 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5144000000000001e-05 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817546+0000", 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5940999999999999e-05 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817735+0000", 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018912000000000001 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.817982+0000", 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024725399999999997 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.818219+0000", 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023652800000000001 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.824901+0000", 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066817450000000002 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.834608+0000", 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0097070179999999995 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.834660+0000", 2024-04-17T15:39:37.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2929000000000001e-05 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.834700+0000", 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9418000000000001e-05 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.981 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2704 3.28 3:1508c84f:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.950561+0000", 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.9394524019999997, 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022024485, 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.982 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2704 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.950561+0000", 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.950561+0000", 2024-04-17T15:39:37.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.950564+0000", 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.965e-06 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954427+0000", 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038625809999999999 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954452+0000", 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5326000000000001e-05 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954466+0000", 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3964e-05 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954559+0000", 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2419999999999999e-05 2024-04-17T15:39:37.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954745+0000", 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186174 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.954870+0000", 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012526700000000001 2024-04-17T15:39:37.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.961200+0000", 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063298290000000004 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.972415+0000", 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011215101 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.972517+0000", 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101925 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.972586+0000", 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8932999999999999e-05 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2723 3.35 e89/18 3:acec52b7:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_78:head v 89'9, mlcod=89'7)", 2024-04-17T15:39:37.988 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.177879+0000", 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.7121347159999996, 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022590208000000001, 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177879+0000", 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177879+0000", 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177881+0000", 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.891e-06 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180535+0000", 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026541540000000001 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180560+0000", 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4771000000000001e-05 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180572+0000", 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2532e-05 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180725+0000", 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015307999999999999 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.180763+0000", 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7769999999999999e-05 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200381+0000", 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019617992000000001 2024-04-17T15:39:37.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200469+0000", 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8017999999999997e-05 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2736 3.5 3:a18cd429:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:37.993 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:39:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.5654890479999999, 2024-04-17T15:39:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.031892391999999999, 2024-04-17T15:39:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:37.994 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2736 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324528+0000", 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.056e-06 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329199+0000", 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004671171 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329244+0000", 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4765999999999998e-05 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329263+0000", 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9426999999999999e-05 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329381+0000", 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117856 2024-04-17T15:39:37.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329387+0000", 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2929999999999997e-06 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.334989+0000", 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056018659999999996 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.335183+0000", 2024-04-17T15:39:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000194284 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.335374+0000", 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000190259 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.340432+0000", 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050583310000000001 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356298+0000", 2024-04-17T15:39:37.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015865945999999999 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356355+0000", 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7312000000000003e-05 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356417+0000", 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1824999999999998e-05 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2745 3.2a 3:55f28608:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.425878+0000", 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.464135755, 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02490902, 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2745 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.425878+0000", 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.425878+0000", 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.425881+0000", 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0790000000000001e-06 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429938+0000", 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040571510000000002 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429996+0000", 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7370000000000001e-05 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430023+0000", 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7489999999999999e-05 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430194+0000", 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171084 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430636+0000", 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044166300000000002 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.431064+0000", 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042786700000000002 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.446040+0000", 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014976227999999999 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450455+0000", 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044150279999999997 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450641+0000", 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018558499999999999 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450787+0000", 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000146475 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2746 3.22 3:47e1b608:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.4547893920000003, 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025681591, 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2746 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435227+0000", 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.604e-06 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439128+0000", 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003901121 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439155+0000", 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7311999999999999e-05 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439166+0000", 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0437e-05 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439277+0000", 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111181 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439514+0000", 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237338 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:38.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439734+0000", 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219681 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450454+0000", 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010719553 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460592+0000", 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010138263999999999 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460778+0000", 2024-04-17T15:39:38.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018652799999999999 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460906+0000", 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000127572 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2751 3.1d 3:b9afbdb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.489794+0000", 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 7.4002201440000004, 2024-04-17T15:39:38.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022202605, 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2751 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.489794+0000", 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.489794+0000", 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.489798+0000", 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.104e-06 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494224+0000", 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044261209999999999 2024-04-17T15:39:38.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494279+0000", 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4929000000000002e-05 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494306+0000", 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6863e-05 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494445+0000", 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013908099999999999 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494649+0000", 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204785 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494876+0000", 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022674699999999999 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.502293+0000", 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007416499 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.511684+0000", 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093915630000000003 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.511861+0000", 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017623399999999999 2024-04-17T15:39:38.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.511996+0000", 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013567900000000001 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.017 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:38.019 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:38.019 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:38.017+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:38.120 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:38.121+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:38.152 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:38.152 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:38.152 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:38.152 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:38.166 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:38.221 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:38.221+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:38.296 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:38.296 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:38.296 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:38.296 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:38.296 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:38.310 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:38.322 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:38.321+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:38.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:39:38.422 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:38.421+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:38.482 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:39:38.482 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 156.23062015400001, 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:38.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:39:38.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:39:38.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:39:38.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:39:38.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.489 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.6772779, 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:39:38.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:38.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2183 3.35 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:38.495 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.527643431999998, 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028592128000000001, 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2183 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953097+0000", 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2139999999999998e-06 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960326+0000", 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072287250000000001 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960458+0000", 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013165599999999999 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960485+0000", 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7455999999999999e-05 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960672+0000", 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961101+0000", 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042912000000000001 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961545+0000", 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044391599999999998 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.980369+0000", 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018824257 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981505+0000", 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011363339999999999 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981610+0000", 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104249 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981685+0000", 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5369000000000003e-05 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.501 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2187 3.20 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.481651990000003, 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020078048000000001, 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2187 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999089+0000", 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6369999999999998e-06 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003407+0000", 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043177679999999996 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003446+0000", 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666999999999998e-05 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003473+0000", 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-05 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003668+0000", 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019524399999999999 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003925+0000", 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025612500000000001 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.004147+0000", 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222704 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014024+0000", 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098762980000000004 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.018985+0000", 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049610729999999999 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019082+0000", 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7758999999999997e-05 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019162+0000", 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0003e-05 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2200 3.1e e76/18 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.336877692999998, 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019523622000000001, 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.507 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2600000000000002e-07 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148444+0000", 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045848859999999998 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148482+0000", 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7975999999999997e-05 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148503+0000", 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0713e-05 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148684+0000", 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018094899999999999 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148752+0000", 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8325999999999996e-05 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163218+0000", 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014465660999999999 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163382+0000", 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016448499999999999 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2209 3.36 3:6e4caeb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.246454851000003, 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028046186000000001, 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2209 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234287+0000", 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5160000000000002e-06 2024-04-17T15:39:38.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241867+0000", 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075797390000000003 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241907+0000", 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0401999999999997e-05 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241926+0000", 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9179999999999999e-05 2024-04-17T15:39:38.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242060+0000", 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013408300000000001 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242320+0000", 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025917699999999998 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242624+0000", 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000304574 2024-04-17T15:39:38.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.255662+0000", 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013038131 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262099+0000", 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064368660000000003 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262247+0000", 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148202 2024-04-17T15:39:38.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262328+0000", 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0315999999999995e-05 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2221 3.2c 3:3579995b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.125260060000002, 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022481615, 2024-04-17T15:39:38.517 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2221 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355480+0000", 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.58e-06 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360595+0000", 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051151290000000004 2024-04-17T15:39:38.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360643+0000", 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8313999999999999e-05 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360667+0000", 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4125e-05 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360807+0000", 2024-04-17T15:39:38.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013905999999999999 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361054+0000", 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024716799999999998 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361268+0000", 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000214768 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.372233+0000", 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010965044 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377661+0000", 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054271830000000004 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377836+0000", 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017558100000000001 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377958+0000", 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121663 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2225 3.36 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.084603631999997, 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025820422999999999, 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2225 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396136+0000", 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2339999999999999e-06 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400026+0000", 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038900950000000001 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400069+0000", 2024-04-17T15:39:38.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2979999999999998e-05 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400093+0000", 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3896e-05 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400243+0000", 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015054599999999999 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400526+0000", 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000283007 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400800+0000", 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027318399999999999 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.411636+0000", 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01083604 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421617+0000", 2024-04-17T15:39:38.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099808669999999992 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421810+0000", 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000193155 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421953+0000", 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014341899999999999 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2247 3.34 e76/18 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.849361571000003, 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030485694000000001, 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631378+0000", 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0429999999999999e-06 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637843+0000", 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064650599999999999 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637892+0000", 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8899000000000001e-05 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637915+0000", 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2903000000000001e-05 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638070+0000", 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155289 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638133+0000", 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2955999999999998e-05 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661702+0000", 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023568782999999999 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661860+0000", 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015876099999999999 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.532 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2249 3.20 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.835762469000002, 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02987182, 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.533 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2249 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644979+0000", 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652360+0000", 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073812269999999998 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652401+0000", 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1316999999999998e-05 2024-04-17T15:39:38.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652421+0000", 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9687e-05 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652563+0000", 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014209499999999999 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652811+0000", 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024760400000000001 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.653043+0000", 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231998 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667188+0000", 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014145342 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674671+0000", 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074827380000000001 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674769+0000", 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7838999999999996e-05 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674846+0000", 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7072999999999999e-05 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.538 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2262 3.26 3:6636822f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.698400993999996, 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020197527, 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.539 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2262 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782340+0000", 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3370000000000001e-06 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786395+0000", 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040552740000000002 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786450+0000", 2024-04-17T15:39:38.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4846999999999999e-05 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786478+0000", 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.811e-05 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786621+0000", 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142798 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786898+0000", 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027743800000000002 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.787136+0000", 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.797168+0000", 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010032350000000001 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802156+0000", 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049883000000000002 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802329+0000", 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017284099999999999 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802533+0000", 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020359800000000001 2024-04-17T15:39:38.544 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2266 3.a 3:523a9b7a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.653998977000001, 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020319462, 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.545 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2266 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826740+0000", 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-06 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830715+0000", 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039743479999999999 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830753+0000", 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8192999999999998e-05 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830771+0000", 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8139999999999999e-05 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830972+0000", 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201595 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831209+0000", 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023676799999999999 2024-04-17T15:39:38.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831439+0000", 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022980799999999999 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.845969+0000", 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014529553000000001 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846744+0000", 2024-04-17T15:39:38.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077553300000000002 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846916+0000", 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171695 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.847057+0000", 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141049 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.550 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2289 3.36 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.415766689000002, 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028794229000000001, 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2289 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064974+0000", 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5800000000000002e-06 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069897+0000", 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049227460000000004 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069939+0000", 2024-04-17T15:39:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2376999999999998e-05 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069964+0000", 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5015999999999999e-05 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070150+0000", 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018596500000000001 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070583+0000", 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043244600000000001 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070838+0000", 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000255491 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093151+0000", 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022312304000000002 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093505+0000", 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035477600000000001 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093610+0000", 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010493300000000001 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093764+0000", 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153595 2024-04-17T15:39:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2293 3.a 3:53332383:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.374140863999997, 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021728066000000001, 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2293 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106598+0000", 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7599999999999998e-06 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110394+0000", 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037959489999999999 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110433+0000", 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9289000000000003e-05 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110459+0000", 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.51e-05 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110594+0000", 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013532299999999999 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110866+0000", 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027189100000000002 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.111110+0000", 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024460999999999998 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.127108+0000", 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015997838 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128143+0000", 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001034791 2024-04-17T15:39:38.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128245+0000", 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101859 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128324+0000", 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8656e-05 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2668 3.26 3:657fda54:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.2394185009999994, 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01928042, 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2668 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.563 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241320+0000", 2024-04-17T15:39:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2749999999999998e-06 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247273+0000", 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059532719999999999 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247297+0000", 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306e-05 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247308+0000", 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1248e-05 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247426+0000", 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011807300000000001 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247677+0000", 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025140299999999998 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247920+0000", 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024303399999999999 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.255818+0000", 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078976210000000005 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260460+0000", 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046419640000000002 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260537+0000", 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6971999999999994e-05 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260598+0000", 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1252000000000002e-05 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2675 3.20 3:05d5fe92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:38.568 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.0743509099999997, 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020675137, 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2675 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:38.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406389+0000", 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410448+0000", 2024-04-17T15:39:38.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004059961 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410484+0000", 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5676000000000002e-05 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410501+0000", 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6506000000000001e-05 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410583+0000", 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2711000000000001e-05 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410735+0000", 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197600000000001 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410871+0000", 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013602500000000001 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.415155+0000", 2024-04-17T15:39:38.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004283706 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.426964+0000", 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011808637 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.427018+0000", 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4342000000000002e-05 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.427061+0000", 2024-04-17T15:39:38.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2549999999999997e-05 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2723 3.35 3:acec52b7:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.3075781450000008, 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027979833999999999, 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.574 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2723 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:38.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173162+0000", 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3569999999999998e-06 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177293+0000", 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041312199999999997 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177335+0000", 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2026e-05 2024-04-17T15:39:38.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177352+0000", 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7292999999999999e-05 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177446+0000", 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3929000000000001e-05 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177594+0000", 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014783 2024-04-17T15:39:38.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177714+0000", 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120328 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.186751+0000", 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090370250000000006 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200795+0000", 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014044176 2024-04-17T15:39:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200990+0000", 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000194904 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.201138+0000", 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000147746 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.579 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2743 3.34 e90/18 3:2f634024:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_98:head v 90'4, mlcod=89'2)", 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.0704342929999999, 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019401910000000001, 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410303+0000", 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8700000000000004e-07 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414523+0000", 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042196400000000002 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414555+0000", 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2101999999999999e-05 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414579+0000", 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4003e-05 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414711+0000", 2024-04-17T15:39:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132383 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414780+0000", 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8936000000000005e-05 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429545+0000", 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014764823999999999 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429704+0000", 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159135 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2748 3.36 3:6c2725e9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.0224058750000005, 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021509582999999999, 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.584 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2748 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458333+0000", 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462083+0000", 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037501040000000002 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462107+0000", 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4278e-05 2024-04-17T15:39:38.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462122+0000", 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4289e-05 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462272+0000", 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015080099999999999 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462582+0000", 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030927100000000001 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462855+0000", 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027330099999999999 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.476558+0000", 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013703473000000001 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479667+0000", 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031088439999999999 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479765+0000", 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7820999999999997e-05 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479840+0000", 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5041000000000002e-05 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2750 3.20 3:07eaa1ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.0007329410000008, 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020193289, 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2750 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.590 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480006+0000", 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.463e-06 2024-04-17T15:39:38.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485236+0000", 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052299909999999998 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485275+0000", 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9153000000000003e-05 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:38.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485295+0000", 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0412999999999999e-05 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485469+0000", 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017371500000000001 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485744+0000", 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027470100000000003 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.486016+0000", 2024-04-17T15:39:38.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027220100000000002 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494631+0000", 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086144940000000003 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.499969+0000", 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053388300000000001 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:38.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.500108+0000", 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138892 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.500197+0000", 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8436000000000005e-05 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:38.595 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:38.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:38.597 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:38.597+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:38.698 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:38.697+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:38.728 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:38.728 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:38.728 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:38.728 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:38.743 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:38.827 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:38.829+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:38.899 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:38.901+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:38.911 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:38.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:38.911 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:38.911 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:38.911 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:38.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:39.011 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:39.013+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 171.02574072100001, 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:39:39.100 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:39.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:39:39.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:39:39.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 170.53370755, 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:39:39.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:39:39.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:39:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:39:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:39:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 170.533668627, 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.113 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:39.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:39.118 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 170.533469045, 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:39:39.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:39:39.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:39:39.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:39:39.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 170.53342381300001, 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:39.124 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.130319597000003, 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:39:39.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2191 3.3b 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.051361765999999, 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024079896999999999, 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.135 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2191 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047034+0000", 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051686+0000", 2024-04-17T15:39:39.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046523550000000004 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051729+0000", 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3032999999999999e-05 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051748+0000", 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9148999999999999e-05 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051911+0000", 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016241300000000001 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052338+0000", 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000427549 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052584+0000", 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000245861 2024-04-17T15:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.059685+0000", 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071007229999999998 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070946+0000", 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011261136 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071036+0000", 2024-04-17T15:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0066000000000001e-05 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071110+0000", 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4609000000000003e-05 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.000197657000001, 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:39:39.141 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:39:39.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:39:39.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:39:39.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.989992831999999, 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:39:39.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:39:39.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2207 3.15 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.883881090999999, 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022770393999999999, 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2207 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.153 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214516+0000", 2024-04-17T15:39:39.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.284e-06 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218674+0000", 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004158953 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218721+0000", 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6669999999999999e-05 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218749+0000", 2024-04-17T15:39:39.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7846000000000001e-05 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218887+0000", 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013819200000000001 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219113+0000", 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022536100000000001 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219315+0000", 2024-04-17T15:39:39.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020251500000000001 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232744+0000", 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013428796999999999 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.236964+0000", 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042205189999999998 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237138+0000", 2024-04-17T15:39:39.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173198 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237282+0000", 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014405900000000001 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2214 3.2f e76/45 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.809256689999998, 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022854762000000001, 2024-04-17T15:39:39.158 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289138+0000", 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293890+0000", 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047525909999999996 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293918+0000", 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7742999999999998e-05 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293933+0000", 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4623e-05 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294082+0000", 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149662 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294148+0000", 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5345999999999994e-05 2024-04-17T15:39:39.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311863+0000", 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017715564999999999 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311990+0000", 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012724899999999999 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.162 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2218 3.39 3:9d9d4055:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.771068634999999, 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023480399999999998, 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2218 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327327+0000", 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331723+0000", 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043962680000000001 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331760+0000", 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6903000000000002e-05 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331783+0000", 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3598999999999999e-05 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.165 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331906+0000", 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012282300000000001 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332168+0000", 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026144100000000001 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332408+0000", 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024071499999999999 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.345166+0000", 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012757961 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350543+0000", 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053770720000000001 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350728+0000", 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018468599999999999 2024-04-17T15:39:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350804+0000", 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6066e-05 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.524444953, 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.168 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:39:39.173 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.396588739000002, 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.174 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:39:39.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2655 3.3b 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.170801721, 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027395325000000002, 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2655 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927594+0000", 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931218+0000", 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036242679999999999 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931243+0000", 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5072e-05 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931254+0000", 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931332+0000", 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8238999999999994e-05 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931477+0000", 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014441599999999999 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931605+0000", 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128959 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.937946+0000", 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063408049999999997 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954869+0000", 2024-04-17T15:39:39.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016922554999999999 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954921+0000", 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2250999999999998e-05 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954986+0000", 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4843000000000002e-05 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2689 3.2d 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.3977928770000005, 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029047231999999999, 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2689 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700603+0000", 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1480000000000002e-06 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704578+0000", 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039753929999999998 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704621+0000", 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2707999999999998e-05 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704638+0000", 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7711999999999999e-05 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704752+0000", 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113894 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704982+0000", 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022947700000000001 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.705211+0000", 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022907099999999999 2024-04-17T15:39:39.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.713505+0000", 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082936940000000008 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729431+0000", 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015926419000000001 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729539+0000", 2024-04-17T15:39:39.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108517 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729647+0000", 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107199 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2717 3.11 3:8a343ec0:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.191 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.0026212920000006, 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022786449, 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2717 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095773+0000", 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3460000000000001e-06 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099572+0000", 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037990350000000001 2024-04-17T15:39:39.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099595+0000", 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2194000000000001e-05 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099605+0000", 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0125999999999999e-05 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099676+0000", 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1738999999999999e-05 2024-04-17T15:39:39.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099813+0000", 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013640899999999999 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099941+0000", 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012855700000000001 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.105972+0000", 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060307570000000003 2024-04-17T15:39:39.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118437+0000", 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012464761 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118491+0000", 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4240000000000002e-05 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118557+0000", 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6285000000000007e-05 2024-04-17T15:39:39.196 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2741 3.39 3:9f26ba31:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.7190652629999992, 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027414362000000001, 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.197 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2741 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379330+0000", 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1599999999999998e-06 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383931+0000", 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046010790000000001 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383974+0000", 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2700000000000001e-05 2024-04-17T15:39:39.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383993+0000", 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8938999999999999e-05 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384090+0000", 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7207000000000006e-05 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384097+0000", 2024-04-17T15:39:39.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4309999999999999e-06 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388621+0000", 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045244179999999997 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388822+0000", 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020077199999999999 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388956+0000", 2024-04-17T15:39:39.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013419500000000001 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.394950+0000", 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059936980000000004 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406560+0000", 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011610448000000001 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406665+0000", 2024-04-17T15:39:39.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104949 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406741+0000", 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6365999999999994e-05 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2744 3.11 3:88cda062:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.6832885770000008, 2024-04-17T15:39:39.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024291046, 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2744 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415108+0000", 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5399999999999997e-06 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.418996+0000", 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038875849999999998 2024-04-17T15:39:39.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419040+0000", 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3696999999999999e-05 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419059+0000", 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.897e-05 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419168+0000", 2024-04-17T15:39:39.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010971 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419367+0000", 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019839900000000001 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419540+0000", 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017327799999999999 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.436287+0000", 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016746727999999999 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439104+0000", 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028172520000000001 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439275+0000", 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017058500000000001 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439395+0000", 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120302 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2767 3.f 3:f0d8e033:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.4182867770000005, 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024335816999999999, 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:39.209 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2767 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:39.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680108+0000", 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7640000000000001e-06 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684062+0000", 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039540349999999998 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684097+0000", 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4517000000000002e-05 2024-04-17T15:39:39.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684114+0000", 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7469000000000002e-05 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684225+0000", 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110746 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684469+0000", 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243911 2024-04-17T15:39:39.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684718+0000", 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024909800000000001 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.701761+0000", 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017042486999999999 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704218+0000", 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024576820000000001 2024-04-17T15:39:39.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704315+0000", 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6482000000000002e-05 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704441+0000", 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012662599999999999 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:39.214 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:39.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:39.216 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:39.217+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:39.317 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:39.317+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:39.356 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:39:39.359 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:39.359 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:39.360 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:39.360 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:39.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:39.418 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:39.417+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:39.519 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:39.517+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:39.546 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:39.546 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:39.546 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:39.547 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:39.547 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:39.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:39.620 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:39.621+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:39.686 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:39.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2198 3.3a e76/18 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.562246342000002, 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019644212000000001, 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9499999999999998e-07 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129524+0000", 2024-04-17T15:39:39.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067742130000000003 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129550+0000", 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5395999999999999e-05 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129565+0000", 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5064e-05 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129665+0000", 2024-04-17T15:39:39.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100381 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129688+0000", 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3479999999999999e-05 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142322+0000", 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012633287999999999 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142394+0000", 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2094999999999993e-05 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2202 3.30 e76/18 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.515883502000001, 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017043618999999999, 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169115+0000", 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0990000000000001e-06 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174068+0000", 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049531810000000001 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174103+0000", 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4885000000000002e-05 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174119+0000", 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6263999999999999e-05 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174216+0000", 2024-04-17T15:39:39.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7578000000000007e-05 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174246+0000", 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9810000000000001e-05 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186092+0000", 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011845496 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186156+0000", 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4306000000000004e-05 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2205 3.17 3:ea2615d0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.490742574999999, 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017729135, 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.695 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2205 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194257+0000", 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1470000000000001e-06 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196293+0000", 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020363099999999999 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196318+0000", 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5194999999999998e-05 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196331+0000", 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2977e-05 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196416+0000", 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5049000000000005e-05 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196543+0000", 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012732100000000001 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:39.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196639+0000", 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5302000000000003e-05 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.202228+0000", 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055891480000000004 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211895+0000", 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096668139999999993 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211941+0000", 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6783999999999998e-05 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211983+0000", 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1087999999999997e-05 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2208 3.1b 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.460794501999999, 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021369764999999999, 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2208 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224204+0000", 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6259999999999999e-06 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226060+0000", 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001855766 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226089+0000", 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8806000000000002e-05 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226103+0000", 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.483e-05 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226194+0000", 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0162999999999997e-05 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226364+0000", 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017058399999999999 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226515+0000", 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000150493 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236552+0000", 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010037107999999999 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245450+0000", 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088980710000000005 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245517+0000", 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7325999999999999e-05 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245571+0000", 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3992000000000001e-05 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2230 3.3a e76/18 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.229705064000001, 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018369284999999999, 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.706 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455293+0000", 2024-04-17T15:39:39.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.841e-06 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460234+0000", 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049411330000000003 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460257+0000", 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3159999999999998e-05 2024-04-17T15:39:39.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460268+0000", 2024-04-17T15:39:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1056000000000001e-05 2024-04-17T15:39:39.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460336+0000", 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7595000000000006e-05 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460368+0000", 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2205000000000001e-05 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473473+0000", 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013105314 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473660+0000", 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698099999999999 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.711 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2232 3.1b 3:da25f619:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.215439619999998, 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017288061, 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.712 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2232 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469559+0000", 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.649e-06 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.471972+0000", 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002412862 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472008+0000", 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5945999999999998e-05 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472023+0000", 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5122e-05 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472113+0000", 2024-04-17T15:39:39.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0183e-05 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472254+0000", 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014096900000000001 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472363+0000", 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010873499999999999 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.482529+0000", 2024-04-17T15:39:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010166019 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486718+0000", 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041890080000000001 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486790+0000", 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1953999999999996e-05 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486844+0000", 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4614000000000003e-05 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2234 3.17 3:eb70e137:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.194787142000003, 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017531280999999999, 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2234 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490212+0000", 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3749999999999999e-06 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492617+0000", 2024-04-17T15:39:39.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024048540000000001 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492639+0000", 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1472e-05 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492648+0000", 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9870000000000005e-06 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492729+0000", 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1034999999999999e-05 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492870+0000", 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014136800000000001 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.493035+0000", 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016558 2024-04-17T15:39:39.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.497649+0000", 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046137119999999998 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507638+0000", 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099891249999999997 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507687+0000", 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8869000000000003e-05 2024-04-17T15:39:39.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507740+0000", 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2904e-05 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2240 3.1f 3:f8ad20ec:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.131494881000002, 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018806135000000002, 2024-04-17T15:39:39.724 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2240 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553505+0000", 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.715e-06 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556184+0000", 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026795149999999999 2024-04-17T15:39:39.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556217+0000", 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2323000000000002e-05 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556231+0000", 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4662e-05 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556329+0000", 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7598999999999998e-05 2024-04-17T15:39:39.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556493+0000", 2024-04-17T15:39:39.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016452900000000001 2024-04-17T15:39:39.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556649+0000", 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000155291 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.564664+0000", 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080152699999999997 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572214+0000", 2024-04-17T15:39:39.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00754991 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572260+0000", 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6526000000000001e-05 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572307+0000", 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6795000000000002e-05 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.731 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2241 3.12 3:4bb118b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.119512929000003, 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018446299999999999, 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2241 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565485+0000", 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566940+0000", 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001454718 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566971+0000", 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0550999999999999e-05 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566996+0000", 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5537999999999998e-05 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567065+0000", 2024-04-17T15:39:39.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9153999999999996e-05 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567197+0000", 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013143200000000001 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567298+0000", 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101488 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.573358+0000", 2024-04-17T15:39:39.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060601309999999999 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583838+0000", 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010479197000000001 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583890+0000", 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2117999999999998e-05 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583929+0000", 2024-04-17T15:39:39.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9530000000000003e-05 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2245 3.17 3:e9b13e02:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.081774529999997, 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018296036000000002, 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.738 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2245 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603225+0000", 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1379999999999999e-06 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604941+0000", 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001716595 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604968+0000", 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7137000000000001e-05 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604980+0000", 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1704e-05 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605056+0000", 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6265000000000002e-05 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605181+0000", 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012499399999999999 2024-04-17T15:39:39.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605283+0000", 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102027 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.613207+0000", 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079242050000000001 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621395+0000", 2024-04-17T15:39:39.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081871159999999995 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621463+0000", 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8354000000000003e-05 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621517+0000", 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4500999999999999e-05 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.743 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2249 3.20 e76/18 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.031857510000002, 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021006212999999999, 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653140+0000", 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-06 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658320+0000", 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051792610000000001 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658379+0000", 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8829999999999997e-05 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658398+0000", 2024-04-17T15:39:39.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9193000000000001e-05 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658487+0000", 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9685999999999995e-05 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658514+0000", 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6818999999999999e-05 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674073+0000", 2024-04-17T15:39:39.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015559078 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674145+0000", 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1360999999999997e-05 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2258 3.17 3:e8df4510:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:39.748 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 46.944558090000001, 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017321514, 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2258 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:39.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740440+0000", 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4609999999999998e-06 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.750 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742267+0000", 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018265239999999999 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742291+0000", 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3787000000000001e-05 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742301+0000", 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0253e-05 2024-04-17T15:39:39.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742388+0000", 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7157000000000006e-05 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742592+0000", 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020355699999999999 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742772+0000", 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018084399999999999 2024-04-17T15:39:39.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.748426+0000", 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056539870000000001 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757641+0000", 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092143060000000002 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757693+0000", 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1916999999999998e-05 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757759+0000", 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6721e-05 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2278 3.1b 3:d8a1e895:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 46.733912605, 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017298622, 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2278 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951086+0000", 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459999999999998e-06 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952905+0000", 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001818442 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952936+0000", 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1260000000000002e-05 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952950+0000", 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3658e-05 2024-04-17T15:39:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953031+0000", 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1593000000000003e-05 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953143+0000", 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011195400000000001 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953266+0000", 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012241500000000001 2024-04-17T15:39:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.961279+0000", 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080132980000000003 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968256+0000", 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006977507 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968326+0000", 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9251999999999994e-05 2024-04-17T15:39:39.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968382+0000", 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6297e-05 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2658 3.12 3:4af6eaf9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.687264334, 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022170373, 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.760 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2658 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997736+0000", 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2699999999999998e-06 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002164+0000", 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044277179999999998 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002223+0000", 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8977000000000001e-05 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002245+0000", 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-05 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002392+0000", 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014651000000000001 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002690+0000", 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029813000000000002 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002969+0000", 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027968200000000001 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.014066+0000", 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011096415 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019790+0000", 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057241410000000003 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019854+0000", 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3875999999999996e-05 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019902+0000", 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8093999999999997e-05 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2661 3.1f 3:fb74984d:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.612339613, 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019684444999999998, 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2661 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.766 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072660+0000", 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999999e-06 2024-04-17T15:39:39.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075792+0000", 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003131778 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075850+0000", 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8428999999999999e-05 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075871+0000", 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:39.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076025+0000", 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000154516 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076299+0000", 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000273808 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076562+0000", 2024-04-17T15:39:39.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000262718 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.087909+0000", 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011347411999999999 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092100+0000", 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041911700000000001 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092207+0000", 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010683600000000001 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092341+0000", 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133685 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2662 3.1b 3:db91a7d5:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.771 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.587084374, 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017881869000000002, 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2662 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097915+0000", 2024-04-17T15:39:39.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.977e-06 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101097+0000", 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181967 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101143+0000", 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6186000000000001e-05 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101162+0000", 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9639999999999998e-05 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101303+0000", 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014092900000000001 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101603+0000", 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029994499999999998 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101842+0000", 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023849099999999999 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.113214+0000", 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011372372 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115477+0000", 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022628879999999998 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115665+0000", 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018835799999999999 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115793+0000", 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000128116 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2684 3.6 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:39.777 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.089649807000001, 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024322572000000001, 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2684 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:39.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595350+0000", 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7400000000000002e-06 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598310+0000", 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029596589999999999 2024-04-17T15:39:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598365+0000", 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5748999999999998e-05 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598388+0000", 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2986999999999999e-05 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598582+0000", 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000193356 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598920+0000", 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033823700000000002 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599274+0000", 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000353798 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.608957+0000", 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096830800000000002 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619432+0000", 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010475728 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619528+0000", 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5241999999999994e-05 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619669+0000", 2024-04-17T15:39:39.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000140996 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2695 3.17 3:e967dc33:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.8499893590000003, 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021609239999999998, 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.783 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2695 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835010+0000", 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.337e-06 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838483+0000", 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003473313 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838529+0000", 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5291999999999999e-05 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838550+0000", 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1469000000000001e-05 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838660+0000", 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011021 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838795+0000", 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013448099999999999 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838907+0000", 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847213+0000", 2024-04-17T15:39:39.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0083057990000000009 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856478+0000", 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092645430000000001 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856557+0000", 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9178000000000007e-05 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856616+0000", 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8872999999999997e-05 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2733 3.6 3:600adf99:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3955788600000005, 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017400448999999998, 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.789 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2733 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289420+0000", 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6230000000000001e-06 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292197+0000", 2024-04-17T15:39:39.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027770009999999999 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292217+0000", 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0322999999999998e-05 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292232+0000", 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5265999999999999e-05 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292321+0000", 2024-04-17T15:39:39.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8782999999999993e-05 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292509+0000", 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000187531 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292680+0000", 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017115500000000001 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.303287+0000", 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010606743 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306704+0000", 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034175030000000001 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306775+0000", 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0533999999999999e-05 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306818+0000", 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2987e-05 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2734 3.1 3:80804e22:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3833045750000004, 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017781458, 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:39.795 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2734 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:39.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301694+0000", 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0769999999999999e-06 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304665+0000", 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029708960000000002 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304697+0000", 2024-04-17T15:39:39.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1906999999999998e-05 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304709+0000", 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1793e-05 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304795+0000", 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6108999999999998e-05 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:39.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304985+0000", 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019023900000000001 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.305095+0000", 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010995800000000001 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314807+0000", 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097112610000000005 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319324+0000", 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045170770000000004 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319409+0000", 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5587999999999994e-05 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319473+0000", 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3553000000000006e-05 2024-04-17T15:39:39.800 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.801 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.801 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.801 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:39.801 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:39.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:39.802 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:39.801+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:39.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:39.903 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:39.901+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:39.977 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:39.977 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:39.977 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:39.977 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:39.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:40.004 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:40.005+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:40.022 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:40.040 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:40.040 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:40.058 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:40.058 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:40.074 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:40.096 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:40.096 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:40.105 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:40.105+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:40.116 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:40.117 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:40.138 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:40.139 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:40.140 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:40.140 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:40.155 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:40.160 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:40.161 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:40.224 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:40.225+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:40.297 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:40.297 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:40.307 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:40.305+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:40.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:40.408 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:40.409+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:40.485 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:40.485 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:40.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:40.548 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:40.549+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:40.610 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:40.609+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:40.628 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:40.628 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:40.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:40.728 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:40.729+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:40.812 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:40.813+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:40.813 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:40.813 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:40.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:40.916 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:40.917+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:41.006 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:41.006 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:41.013 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:41.013+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:41.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:41.114 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:41.113+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:41.200 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:41.200 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:41.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:41.215 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:41.213+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:41.315 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:41.313+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:41.341 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:41.342 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:41.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:41.379 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:39:41.444 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:41.445+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:41.496 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:41.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:41.517 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:41.517+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:41.618 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:41.617+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:41.638 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:41.638 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:41.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:41.739 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:41.741+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:41.819 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:41.821+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:41.822 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:41.822 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:41.837 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:41.920 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:41.921+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:42.008 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:42.008 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:42.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:42.023 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:42.021+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:42.123 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:42.121+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:42.141 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:42.141 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:42.155 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:42.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:42.243 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:42.245+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:42.322 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:42.322 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:42.324 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:42.325+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:42.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:42.343 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:42.343 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:42.360 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:42.367 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:39:42.389 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:42.390 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:42.405 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:42.405 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:42.422 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:42.422 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:42.424 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:42.425+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:42.440 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:42.458 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:42.459 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:42.478 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:42.511 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:42.511 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:42.511 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:42.511 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:42.526 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:42.536 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:42.537+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:42.626 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:42.629+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:42.653 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:42.653 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:42.653 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:42.653 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:42.653 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:42.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:42.727 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:42.729+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:42.800 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 160.54932402599999, 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.801 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:39:42.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:39:42.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 60.995981772, 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:39:42.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:39:42.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2183 3.35 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.846347303999998, 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028592128000000001, 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.814 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2183 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953097+0000", 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2139999999999998e-06 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960326+0000", 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072287250000000001 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960458+0000", 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013165599999999999 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960485+0000", 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7455999999999999e-05 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960672+0000", 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961101+0000", 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042912000000000001 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:42.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961545+0000", 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044391599999999998 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.980369+0000", 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018824257 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981505+0000", 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011363339999999999 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981610+0000", 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104249 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981685+0000", 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5369000000000003e-05 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2187 3.20 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:42.819 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.800355862000004, 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020078048000000001, 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2187 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999089+0000", 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6369999999999998e-06 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003407+0000", 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043177679999999996 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003446+0000", 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666999999999998e-05 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003473+0000", 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-05 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003668+0000", 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019524399999999999 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003925+0000", 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025612500000000001 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.004147+0000", 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222704 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014024+0000", 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098762980000000004 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.018985+0000", 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049610729999999999 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019082+0000", 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7758999999999997e-05 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019162+0000", 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0003e-05 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.824 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2200 3.1e e76/18 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.655581564999999, 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019523622000000001, 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2600000000000002e-07 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148444+0000", 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045848859999999998 2024-04-17T15:39:42.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148482+0000", 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7975999999999997e-05 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148503+0000", 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0713e-05 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148684+0000", 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018094899999999999 2024-04-17T15:39:42.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148752+0000", 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8325999999999996e-05 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163218+0000", 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014465660999999999 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163382+0000", 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016448499999999999 2024-04-17T15:39:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2209 3.36 3:6e4caeb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.565158723000003, 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028046186000000001, 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.829 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2209 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234287+0000", 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5160000000000002e-06 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241867+0000", 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075797390000000003 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241907+0000", 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0401999999999997e-05 2024-04-17T15:39:42.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241926+0000", 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9179999999999999e-05 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242060+0000", 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013408300000000001 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242320+0000", 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025917699999999998 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242624+0000", 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000304574 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.255662+0000", 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013038131 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262099+0000", 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064368660000000003 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262247+0000", 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148202 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262328+0000", 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0315999999999995e-05 2024-04-17T15:39:42.834 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2221 3.2c 3:3579995b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.443963932000003, 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022481615, 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.835 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2221 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355480+0000", 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.58e-06 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360595+0000", 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051151290000000004 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360643+0000", 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8313999999999999e-05 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360667+0000", 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4125e-05 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360807+0000", 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013905999999999999 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361054+0000", 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024716799999999998 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361268+0000", 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000214768 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.372233+0000", 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010965044 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377661+0000", 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054271830000000004 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377836+0000", 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017558100000000001 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377958+0000", 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121663 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.840 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2225 3.36 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.403307503999997, 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025820422999999999, 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2225 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396136+0000", 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2339999999999999e-06 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400026+0000", 2024-04-17T15:39:42.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038900950000000001 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400069+0000", 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2979999999999998e-05 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400093+0000", 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3896e-05 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400243+0000", 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015054599999999999 2024-04-17T15:39:42.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400526+0000", 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000283007 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400800+0000", 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027318399999999999 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.411636+0000", 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01083604 2024-04-17T15:39:42.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421617+0000", 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099808669999999992 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421810+0000", 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000193155 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421953+0000", 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014341899999999999 2024-04-17T15:39:42.845 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2247 3.34 e76/18 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.168065443000003, 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030485694000000001, 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.846 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631378+0000", 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0429999999999999e-06 2024-04-17T15:39:42.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637843+0000", 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064650599999999999 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637892+0000", 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8899000000000001e-05 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637915+0000", 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2903000000000001e-05 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638070+0000", 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155289 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638133+0000", 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2955999999999998e-05 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661702+0000", 2024-04-17T15:39:42.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023568782999999999 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661860+0000", 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015876099999999999 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2249 3.20 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:42.850 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.154466341000003, 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02987182, 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2249 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644979+0000", 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652360+0000", 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073812269999999998 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652401+0000", 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1316999999999998e-05 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652421+0000", 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9687e-05 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652563+0000", 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014209499999999999 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652811+0000", 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024760400000000001 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.653043+0000", 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231998 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667188+0000", 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014145342 2024-04-17T15:39:42.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674671+0000", 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074827380000000001 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674769+0000", 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7838999999999996e-05 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674846+0000", 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7072999999999999e-05 2024-04-17T15:39:42.855 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2262 3.26 3:6636822f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.017104865999997, 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020197527, 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2262 2024-04-17T15:39:42.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782340+0000", 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3370000000000001e-06 2024-04-17T15:39:42.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786395+0000", 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040552740000000002 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786450+0000", 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4846999999999999e-05 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786478+0000", 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.811e-05 2024-04-17T15:39:42.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786621+0000", 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142798 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786898+0000", 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027743800000000002 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.787136+0000", 2024-04-17T15:39:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.797168+0000", 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010032350000000001 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802156+0000", 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049883000000000002 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802329+0000", 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017284099999999999 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802533+0000", 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020359800000000001 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2266 3.a 3:523a9b7a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 49.972702849000001, 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020319462, 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.861 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2266 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826740+0000", 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-06 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830715+0000", 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039743479999999999 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830753+0000", 2024-04-17T15:39:42.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8192999999999998e-05 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830771+0000", 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8139999999999999e-05 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830972+0000", 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201595 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831209+0000", 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023676799999999999 2024-04-17T15:39:42.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831439+0000", 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022980799999999999 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.845969+0000", 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014529553000000001 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846744+0000", 2024-04-17T15:39:42.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077553300000000002 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846916+0000", 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171695 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.847057+0000", 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141049 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2289 3.36 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 49.734470561000002, 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028794229000000001, 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2289 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064974+0000", 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5800000000000002e-06 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069897+0000", 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049227460000000004 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069939+0000", 2024-04-17T15:39:42.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2376999999999998e-05 2024-04-17T15:39:42.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069964+0000", 2024-04-17T15:39:42.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5015999999999999e-05 2024-04-17T15:39:42.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070150+0000", 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018596500000000001 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070583+0000", 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043244600000000001 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070838+0000", 2024-04-17T15:39:42.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000255491 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093151+0000", 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022312304000000002 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093505+0000", 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035477600000000001 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093610+0000", 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010493300000000001 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093764+0000", 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153595 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2293 3.a 3:53332383:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 49.692844735999998, 2024-04-17T15:39:42.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021728066000000001, 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2293 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106598+0000", 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7599999999999998e-06 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110394+0000", 2024-04-17T15:39:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037959489999999999 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110433+0000", 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9289000000000003e-05 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110459+0000", 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.51e-05 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110594+0000", 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013532299999999999 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110866+0000", 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027189100000000002 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.111110+0000", 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024460999999999998 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.127108+0000", 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015997838 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128143+0000", 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001034791 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128245+0000", 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101859 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128324+0000", 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8656e-05 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2668 3.26 3:657fda54:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 13.558122373, 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01928042, 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.879 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2668 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241320+0000", 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2749999999999998e-06 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247273+0000", 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059532719999999999 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247297+0000", 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306e-05 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247308+0000", 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1248e-05 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247426+0000", 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011807300000000001 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247677+0000", 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025140299999999998 2024-04-17T15:39:42.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247920+0000", 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024303399999999999 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.255818+0000", 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078976210000000005 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260460+0000", 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046419640000000002 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260537+0000", 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6971999999999994e-05 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260598+0000", 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1252000000000002e-05 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2675 3.20 3:05d5fe92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 13.393054782, 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020675137, 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2675 2024-04-17T15:39:42.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406389+0000", 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410448+0000", 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004059961 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410484+0000", 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5676000000000002e-05 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410501+0000", 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6506000000000001e-05 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410583+0000", 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2711000000000001e-05 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410735+0000", 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197600000000001 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410871+0000", 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013602500000000001 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.415155+0000", 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004283706 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.426964+0000", 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011808637 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.427018+0000", 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4342000000000002e-05 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.427061+0000", 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2549999999999997e-05 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.890 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2723 3.35 3:acec52b7:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 12.626282016999999, 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027979833999999999, 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2723 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173162+0000", 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3569999999999998e-06 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177293+0000", 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041312199999999997 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177335+0000", 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2026e-05 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177352+0000", 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7292999999999999e-05 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177446+0000", 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3929000000000001e-05 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177594+0000", 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014783 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177714+0000", 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120328 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.186751+0000", 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090370250000000006 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200795+0000", 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014044176 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200990+0000", 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000194904 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.201138+0000", 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000147746 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2743 3.34 e90/18 3:2f634024:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_98:head v 90'4, mlcod=89'2)", 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 12.389138165, 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019401910000000001, 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.896 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410303+0000", 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8700000000000004e-07 2024-04-17T15:39:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414523+0000", 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042196400000000002 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414555+0000", 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2101999999999999e-05 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414579+0000", 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4003e-05 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414711+0000", 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132383 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414780+0000", 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8936000000000005e-05 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429545+0000", 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014764823999999999 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429704+0000", 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159135 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2748 3.36 3:6c2725e9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 12.341109747000001, 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021509582999999999, 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.900 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2748 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458333+0000", 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462083+0000", 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037501040000000002 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462107+0000", 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4278e-05 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462122+0000", 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4289e-05 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462272+0000", 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015080099999999999 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462582+0000", 2024-04-17T15:39:42.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030927100000000001 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462855+0000", 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027330099999999999 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.476558+0000", 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013703473000000001 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479667+0000", 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031088439999999999 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479765+0000", 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7820999999999997e-05 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479840+0000", 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5041000000000002e-05 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2750 3.20 3:07eaa1ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 12.319436812999999, 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020193289, 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2750 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.906 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480006+0000", 2024-04-17T15:39:42.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.463e-06 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485236+0000", 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052299909999999998 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485275+0000", 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9153000000000003e-05 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485295+0000", 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0412999999999999e-05 2024-04-17T15:39:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485469+0000", 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017371500000000001 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485744+0000", 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027470100000000003 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.486016+0000", 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027220100000000002 2024-04-17T15:39:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494631+0000", 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086144940000000003 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.499969+0000", 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053388300000000001 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.500108+0000", 2024-04-17T15:39:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138892 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.500197+0000", 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8436000000000005e-05 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:42.911 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:42.913 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:42.913 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:42.913+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:43.014 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:43.013+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:43.045 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:43.045 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:43.045 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:43.045 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:43.059 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:43.151 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:43.153+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:43.216 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:43.217+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:43.230 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:43.231 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:43.231 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:43.231 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:43.231 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:43.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:43.331 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:43.333+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:43.418 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:43.417+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:43.420 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:43.420 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:43.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:43.420 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:43.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.420 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:43.420 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 175.34635984400001, 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:43.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:39:43.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 174.854326673, 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:39:43.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:39:43.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.431 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 174.85428775, 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:39:43.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:39:43.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 174.854088168, 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.437 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.442 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 174.85404293600001, 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:43.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:39:43.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:39:43.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:39:43.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.450938720000003, 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2191 3.3b 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.371980889, 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024079896999999999, 2024-04-17T15:39:43.453 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2191 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047034+0000", 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051686+0000", 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046523550000000004 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051729+0000", 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3032999999999999e-05 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051748+0000", 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9148999999999999e-05 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051911+0000", 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016241300000000001 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052338+0000", 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000427549 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052584+0000", 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000245861 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.059685+0000", 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071007229999999998 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070946+0000", 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011261136 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071036+0000", 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0066000000000001e-05 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071110+0000", 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4609000000000003e-05 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.458 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.320816780000001, 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:39:43.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:39:43.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:39:43.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.310611954999999, 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.464 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:43.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2207 3.15 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.204500213999999, 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022770393999999999, 2024-04-17T15:39:43.469 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2207 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214516+0000", 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.284e-06 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218674+0000", 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004158953 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218721+0000", 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6669999999999999e-05 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218749+0000", 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7846000000000001e-05 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218887+0000", 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013819200000000001 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219113+0000", 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022536100000000001 2024-04-17T15:39:43.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219315+0000", 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020251500000000001 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232744+0000", 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013428796999999999 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.236964+0000", 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042205189999999998 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237138+0000", 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173198 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237282+0000", 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014405900000000001 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2214 3.2f e76/45 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.129875812999998, 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022854762000000001, 2024-04-17T15:39:43.474 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289138+0000", 2024-04-17T15:39:43.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293890+0000", 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047525909999999996 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293918+0000", 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7742999999999998e-05 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293933+0000", 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4623e-05 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294082+0000", 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149662 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294148+0000", 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5345999999999994e-05 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311863+0000", 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017715564999999999 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311990+0000", 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012724899999999999 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2218 3.39 3:9d9d4055:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.091687757999999, 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023480399999999998, 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.478 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2218 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327327+0000", 2024-04-17T15:39:43.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331723+0000", 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043962680000000001 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331760+0000", 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6903000000000002e-05 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331783+0000", 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3598999999999999e-05 2024-04-17T15:39:43.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331906+0000", 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012282300000000001 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332168+0000", 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026144100000000001 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332408+0000", 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024071499999999999 2024-04-17T15:39:43.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.345166+0000", 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012757961 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350543+0000", 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053770720000000001 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350728+0000", 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018468599999999999 2024-04-17T15:39:43.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350804+0000", 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6066e-05 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.845064076, 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.483 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:39:43.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:39:43.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:39:43.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.488 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.717207862000002, 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:39:43.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2655 3.3b 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.491420844, 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027395325000000002, 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2655 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927594+0000", 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931218+0000", 2024-04-17T15:39:43.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036242679999999999 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931243+0000", 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5072e-05 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931254+0000", 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931332+0000", 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8238999999999994e-05 2024-04-17T15:39:43.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931477+0000", 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014441599999999999 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931605+0000", 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128959 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.937946+0000", 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063408049999999997 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954869+0000", 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016922554999999999 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954921+0000", 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2250999999999998e-05 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954986+0000", 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4843000000000002e-05 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2689 3.2d 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 13.718412000000001, 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029047231999999999, 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2689 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700603+0000", 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1480000000000002e-06 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704578+0000", 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039753929999999998 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704621+0000", 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2707999999999998e-05 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704638+0000", 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7711999999999999e-05 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704752+0000", 2024-04-17T15:39:43.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113894 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704982+0000", 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022947700000000001 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.705211+0000", 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022907099999999999 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.713505+0000", 2024-04-17T15:39:43.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082936940000000008 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729431+0000", 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015926419000000001 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729539+0000", 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108517 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729647+0000", 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107199 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.503 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2717 3.11 3:8a343ec0:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 13.323240415000001, 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022786449, 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2717 2024-04-17T15:39:43.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095773+0000", 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3460000000000001e-06 2024-04-17T15:39:43.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099572+0000", 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037990350000000001 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099595+0000", 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2194000000000001e-05 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099605+0000", 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0125999999999999e-05 2024-04-17T15:39:43.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099676+0000", 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1738999999999999e-05 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099813+0000", 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013640899999999999 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099941+0000", 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012855700000000001 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.105972+0000", 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060307570000000003 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118437+0000", 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012464761 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118491+0000", 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4240000000000002e-05 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118557+0000", 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6285000000000007e-05 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2741 3.39 3:9f26ba31:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 13.039684385999999, 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027414362000000001, 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.509 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2741 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379330+0000", 2024-04-17T15:39:43.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1599999999999998e-06 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383931+0000", 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046010790000000001 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383974+0000", 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2700000000000001e-05 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383993+0000", 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8938999999999999e-05 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384090+0000", 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7207000000000006e-05 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384097+0000", 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4309999999999999e-06 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388621+0000", 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045244179999999997 2024-04-17T15:39:43.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388822+0000", 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020077199999999999 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388956+0000", 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013419500000000001 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.394950+0000", 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059936980000000004 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406560+0000", 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011610448000000001 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406665+0000", 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104949 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406741+0000", 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6365999999999994e-05 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.514 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2744 3.11 3:88cda062:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 13.003907699999999, 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024291046, 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2744 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415108+0000", 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5399999999999997e-06 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.418996+0000", 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038875849999999998 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419040+0000", 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3696999999999999e-05 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419059+0000", 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.897e-05 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419168+0000", 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010971 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419367+0000", 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019839900000000001 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419540+0000", 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017327799999999999 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.436287+0000", 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016746727999999999 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439104+0000", 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028172520000000001 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439275+0000", 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017058500000000001 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439395+0000", 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120302 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2767 3.f 3:f0d8e033:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 12.738905900000001, 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024335816999999999, 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.520 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2767 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680108+0000", 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7640000000000001e-06 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684062+0000", 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039540349999999998 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684097+0000", 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4517000000000002e-05 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684114+0000", 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7469000000000002e-05 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684225+0000", 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110746 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684469+0000", 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243911 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684718+0000", 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024909800000000001 2024-04-17T15:39:43.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.701761+0000", 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017042486999999999 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704218+0000", 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024576820000000001 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704315+0000", 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6482000000000002e-05 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:43.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704441+0000", 2024-04-17T15:39:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012662599999999999 2024-04-17T15:39:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:43.525 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:43.525 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:43.526 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:43.527 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:43.525+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:43.627 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:43.629+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:43.661 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:43.661 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:43.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:43.729 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:43.729+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:43.829 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:43.829+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:43.844 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:43.844 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:43.844 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:43.844 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:43.845 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:43.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:43.931 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:43.929+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:43.982 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2198 3.3a e76/18 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.858328092000001, 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019644212000000001, 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9499999999999998e-07 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129524+0000", 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067742130000000003 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129550+0000", 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5395999999999999e-05 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129565+0000", 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5064e-05 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129665+0000", 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100381 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129688+0000", 2024-04-17T15:39:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3479999999999999e-05 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142322+0000", 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012633287999999999 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142394+0000", 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2094999999999993e-05 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2202 3.30 e76/18 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.811965252, 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017043618999999999, 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169115+0000", 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0990000000000001e-06 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174068+0000", 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049531810000000001 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174103+0000", 2024-04-17T15:39:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4885000000000002e-05 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174119+0000", 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6263999999999999e-05 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174216+0000", 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7578000000000007e-05 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174246+0000", 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9810000000000001e-05 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186092+0000", 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011845496 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186156+0000", 2024-04-17T15:39:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4306000000000004e-05 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2205 3.17 3:ea2615d0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.786824324999998, 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017729135, 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2205 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194257+0000", 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1470000000000001e-06 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196293+0000", 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020363099999999999 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196318+0000", 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5194999999999998e-05 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196331+0000", 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2977e-05 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196416+0000", 2024-04-17T15:39:43.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5049000000000005e-05 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196543+0000", 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012732100000000001 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196639+0000", 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5302000000000003e-05 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.202228+0000", 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055891480000000004 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211895+0000", 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096668139999999993 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211941+0000", 2024-04-17T15:39:43.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6783999999999998e-05 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211983+0000", 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1087999999999997e-05 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2208 3.1b 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.756876251999998, 2024-04-17T15:39:43.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021369764999999999, 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2208 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224204+0000", 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6259999999999999e-06 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226060+0000", 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001855766 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226089+0000", 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8806000000000002e-05 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226103+0000", 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.483e-05 2024-04-17T15:39:44.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226194+0000", 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0162999999999997e-05 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226364+0000", 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017058399999999999 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226515+0000", 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000150493 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236552+0000", 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010037107999999999 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245450+0000", 2024-04-17T15:39:44.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088980710000000005 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245517+0000", 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7325999999999999e-05 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245571+0000", 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3992000000000001e-05 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.005 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2230 3.3a e76/18 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.525786814, 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018369284999999999, 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.006 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455293+0000", 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.841e-06 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460234+0000", 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049411330000000003 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460257+0000", 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3159999999999998e-05 2024-04-17T15:39:44.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460268+0000", 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1056000000000001e-05 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460336+0000", 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7595000000000006e-05 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460368+0000", 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2205000000000001e-05 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473473+0000", 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013105314 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473660+0000", 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698099999999999 2024-04-17T15:39:44.010 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2232 3.1b 3:da25f619:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.511521369999997, 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017288061, 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.011 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2232 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469559+0000", 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.649e-06 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.471972+0000", 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002412862 2024-04-17T15:39:44.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472008+0000", 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5945999999999998e-05 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472023+0000", 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5122e-05 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472113+0000", 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0183e-05 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472254+0000", 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014096900000000001 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472363+0000", 2024-04-17T15:39:44.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010873499999999999 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.482529+0000", 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010166019 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486718+0000", 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041890080000000001 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486790+0000", 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1953999999999996e-05 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486844+0000", 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4614000000000003e-05 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.017 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2234 3.17 3:eb70e137:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.490868892000002, 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017531280999999999, 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2234 2024-04-17T15:39:44.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490212+0000", 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3749999999999999e-06 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492617+0000", 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024048540000000001 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492639+0000", 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1472e-05 2024-04-17T15:39:44.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492648+0000", 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9870000000000005e-06 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492729+0000", 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1034999999999999e-05 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492870+0000", 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014136800000000001 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.493035+0000", 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016558 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.497649+0000", 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046137119999999998 2024-04-17T15:39:44.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507638+0000", 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099891249999999997 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507687+0000", 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8869000000000003e-05 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507740+0000", 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2904e-05 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2240 3.1f 3:f8ad20ec:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.427576631000001, 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018806135000000002, 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.024 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2240 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553505+0000", 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.715e-06 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556184+0000", 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026795149999999999 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556217+0000", 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2323000000000002e-05 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556231+0000", 2024-04-17T15:39:44.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4662e-05 2024-04-17T15:39:44.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556329+0000", 2024-04-17T15:39:44.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7598999999999998e-05 2024-04-17T15:39:44.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556493+0000", 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016452900000000001 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556649+0000", 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000155291 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.564664+0000", 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080152699999999997 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572214+0000", 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00754991 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572260+0000", 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6526000000000001e-05 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572307+0000", 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6795000000000002e-05 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2241 3.12 3:4bb118b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.415594679000002, 2024-04-17T15:39:44.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018446299999999999, 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2241 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565485+0000", 2024-04-17T15:39:44.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566940+0000", 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001454718 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566971+0000", 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0550999999999999e-05 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566996+0000", 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5537999999999998e-05 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567065+0000", 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9153999999999996e-05 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567197+0000", 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013143200000000001 2024-04-17T15:39:44.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567298+0000", 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101488 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.573358+0000", 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060601309999999999 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583838+0000", 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010479197000000001 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583890+0000", 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2117999999999998e-05 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583929+0000", 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9530000000000003e-05 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2245 3.17 3:e9b13e02:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.377856280000003, 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018296036000000002, 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.039 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2245 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:44.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603225+0000", 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1379999999999999e-06 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604941+0000", 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001716595 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604968+0000", 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7137000000000001e-05 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604980+0000", 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1704e-05 2024-04-17T15:39:44.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605056+0000", 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6265000000000002e-05 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605181+0000", 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012499399999999999 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:44.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605283+0000", 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102027 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.613207+0000", 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079242050000000001 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621395+0000", 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081871159999999995 2024-04-17T15:39:44.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621463+0000", 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8354000000000003e-05 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621517+0000", 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4500999999999999e-05 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.045 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2249 3.20 e76/18 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.327939260000001, 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021006212999999999, 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653140+0000", 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-06 2024-04-17T15:39:44.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658320+0000", 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051792610000000001 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658379+0000", 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8829999999999997e-05 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658398+0000", 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9193000000000001e-05 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658487+0000", 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9685999999999995e-05 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658514+0000", 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6818999999999999e-05 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674073+0000", 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015559078 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674145+0000", 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1360999999999997e-05 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.050 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2258 3.17 3:e8df4510:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.24063984, 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017321514, 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.051 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2258 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740440+0000", 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4609999999999998e-06 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742267+0000", 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018265239999999999 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742291+0000", 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3787000000000001e-05 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742301+0000", 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0253e-05 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742388+0000", 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7157000000000006e-05 2024-04-17T15:39:44.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742592+0000", 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020355699999999999 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742772+0000", 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018084399999999999 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.748426+0000", 2024-04-17T15:39:44.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056539870000000001 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757641+0000", 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092143060000000002 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757693+0000", 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1916999999999998e-05 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757759+0000", 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6721e-05 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2278 3.1b 3:d8a1e895:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.029994354999999, 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017298622, 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2278 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951086+0000", 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459999999999998e-06 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952905+0000", 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001818442 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952936+0000", 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1260000000000002e-05 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952950+0000", 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3658e-05 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953031+0000", 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1593000000000003e-05 2024-04-17T15:39:44.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953143+0000", 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011195400000000001 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953266+0000", 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012241500000000001 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.961279+0000", 2024-04-17T15:39:44.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080132980000000003 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968256+0000", 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006977507 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968326+0000", 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9251999999999994e-05 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968382+0000", 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6297e-05 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2658 3.12 3:4af6eaf9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.983346084000001, 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022170373, 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.063 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2658 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997736+0000", 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2699999999999998e-06 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002164+0000", 2024-04-17T15:39:44.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044277179999999998 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002223+0000", 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8977000000000001e-05 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002245+0000", 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-05 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002392+0000", 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014651000000000001 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002690+0000", 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029813000000000002 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:44.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002969+0000", 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027968200000000001 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.014066+0000", 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011096415 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019790+0000", 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057241410000000003 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019854+0000", 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3875999999999996e-05 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019902+0000", 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8093999999999997e-05 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.069 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2661 3.1f 3:fb74984d:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.908421363, 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019684444999999998, 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2661 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.070 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072660+0000", 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999999e-06 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075792+0000", 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003131778 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075850+0000", 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8428999999999999e-05 2024-04-17T15:39:44.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075871+0000", 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076025+0000", 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000154516 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076299+0000", 2024-04-17T15:39:44.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000273808 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076562+0000", 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000262718 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.087909+0000", 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011347411999999999 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092100+0000", 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041911700000000001 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092207+0000", 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010683600000000001 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092341+0000", 2024-04-17T15:39:44.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133685 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2662 3.1b 3:db91a7d5:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.883166124000001, 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017881869000000002, 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.076 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2662 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:44.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097915+0000", 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.977e-06 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101097+0000", 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181967 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101143+0000", 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6186000000000001e-05 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101162+0000", 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9639999999999998e-05 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101303+0000", 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014092900000000001 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101603+0000", 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029994499999999998 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101842+0000", 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023849099999999999 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.113214+0000", 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011372372 2024-04-17T15:39:44.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115477+0000", 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022628879999999998 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115665+0000", 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018835799999999999 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115793+0000", 2024-04-17T15:39:44.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000128116 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2684 3.6 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.385731557, 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024322572000000001, 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.082 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2684 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:44.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595350+0000", 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7400000000000002e-06 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598310+0000", 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029596589999999999 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598365+0000", 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5748999999999998e-05 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598388+0000", 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2986999999999999e-05 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598582+0000", 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000193356 2024-04-17T15:39:44.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598920+0000", 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033823700000000002 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599274+0000", 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000353798 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.608957+0000", 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096830800000000002 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619432+0000", 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010475728 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619528+0000", 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5241999999999994e-05 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619669+0000", 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000140996 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2695 3.17 3:e967dc33:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:44.088 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.146071108999999, 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021609239999999998, 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2695 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835010+0000", 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.337e-06 2024-04-17T15:39:44.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838483+0000", 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003473313 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838529+0000", 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5291999999999999e-05 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838550+0000", 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1469000000000001e-05 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838660+0000", 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011021 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838795+0000", 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013448099999999999 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838907+0000", 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847213+0000", 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0083057990000000009 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856478+0000", 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092645430000000001 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856557+0000", 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9178000000000007e-05 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856616+0000", 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8872999999999997e-05 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2733 3.6 3:600adf99:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.69166061, 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017400448999999998, 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2733 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.095 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289420+0000", 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6230000000000001e-06 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292197+0000", 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027770009999999999 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292217+0000", 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0322999999999998e-05 2024-04-17T15:39:44.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292232+0000", 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5265999999999999e-05 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292321+0000", 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8782999999999993e-05 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292509+0000", 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000187531 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292680+0000", 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017115500000000001 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.303287+0000", 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010606743 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306704+0000", 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034175030000000001 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306775+0000", 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0533999999999999e-05 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306818+0000", 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2987e-05 2024-04-17T15:39:44.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2734 3.1 3:80804e22:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.679386324999999, 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017781458, 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.101 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2734 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:44.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301694+0000", 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0769999999999999e-06 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304665+0000", 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029708960000000002 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304697+0000", 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1906999999999998e-05 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304709+0000", 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1793e-05 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304795+0000", 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6108999999999998e-05 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304985+0000", 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019023900000000001 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.305095+0000", 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010995800000000001 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314807+0000", 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097112610000000005 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319324+0000", 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045170770000000004 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319409+0000", 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5587999999999994e-05 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319473+0000", 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3553000000000006e-05 2024-04-17T15:39:44.106 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.107 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.107 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.107 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.107 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.107 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:44.109 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:44.109 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:44.109+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:44.209 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:44.209+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:44.290 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:44.291 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:44.291 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:44.291 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:44.306 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:44.352 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:44.352+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:44.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:39:44.434 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:44.434 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:44.434 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:44.435 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:44.435 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:44.435 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:44.432+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:44.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:44.494 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:44.512 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:44.513+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:44.612 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:44.613+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:44.622 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:44.622 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2192 3.0 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.566921800999999, 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016712945, 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2192 2024-04-17T15:39:44.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056609+0000", 2024-04-17T15:39:44.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8192000000000002e-05 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058326+0000", 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017167980000000001 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058354+0000", 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8469000000000001e-05 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058368+0000", 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3567000000000001e-05 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058448+0000", 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9943000000000004e-05 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058629+0000", 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018072100000000001 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058790+0000", 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016184000000000001 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.069821+0000", 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011030629 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073138+0000", 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033164679999999999 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073206+0000", 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8324999999999994e-05 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073274+0000", 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7992999999999998e-05 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:44.628 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.548719063999997, 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.632 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.545352561999998, 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:39:44.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2231 3.3e 3:7e08bf39:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.165237586000003, 2024-04-17T15:39:44.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016293021000000001, 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2231 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458262+0000", 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6534000000000001e-05 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460097+0000", 2024-04-17T15:39:44.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001835298 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460124+0000", 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7359e-05 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460140+0000", 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5241e-05 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460208+0000", 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8579999999999997e-05 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460333+0000", 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012509500000000001 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460467+0000", 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013373599999999999 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472830+0000", 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012363486 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474285+0000", 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014549669999999999 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474416+0000", 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013019099999999999 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474538+0000", 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012253399999999999 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.968152803999999, 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.644 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:39:44.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:39:44.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2252 3.25 3:a447a9ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.945223331000001, 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014955945, 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2252 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678262+0000", 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0639999999999998e-06 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680355+0000", 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020922559999999998 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680381+0000", 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6437000000000001e-05 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680395+0000", 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3653e-05 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680498+0000", 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103486 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680682+0000", 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018336700000000001 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680824+0000", 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014226399999999999 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692441+0000", 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011617331 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693055+0000", 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000614092 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693133+0000", 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7996000000000003e-05 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693215+0000", 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1998999999999999e-05 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2646 3.8 e89/18 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head v 89'5, mlcod=76'3)", 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.882957081000001, 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018982274, 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.655 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740529+0000", 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9660000000000001e-06 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745823+0000", 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052946060000000003 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745886+0000", 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3251999999999997e-05 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.657 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745910+0000", 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3964e-05 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746063+0000", 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015276100000000001 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746089+0000", 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6180999999999999e-05 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759412+0000", 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013322387999999999 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759508+0000", 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6156000000000006e-05 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2663 3.0 3:00b68c77:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.659 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.499850659, 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020648330999999999, 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2663 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123635+0000", 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126602+0000", 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029664679999999999 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126640+0000", 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.82e-05 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126654+0000", 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4440000000000001e-05 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126752+0000", 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7879000000000003e-05 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126948+0000", 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000195983 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.127139+0000", 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019063500000000001 2024-04-17T15:39:44.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.143125+0000", 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015986416999999999 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144087+0000", 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00096153799999999995 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144196+0000", 2024-04-17T15:39:44.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010974199999999999 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144280+0000", 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3962999999999996e-05 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2669 3.4 3:2238a661:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.35820303, 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020392082999999998, 2024-04-17T15:39:44.665 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2669 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265285+0000", 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4729999999999999e-06 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268400+0000", 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003114618 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268449+0000", 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9462999999999997e-05 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268477+0000", 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7440000000000002e-05 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268646+0000", 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016956299999999999 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.668 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268970+0000", 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032326799999999998 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.269256+0000", 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028625100000000001 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.278736+0000", 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094797909999999996 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285472+0000", 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067364429999999999 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285588+0000", 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116452 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285672+0000", 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3320999999999997e-05 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2673 3.3e 3:7c55c310:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.258414506999999, 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020262019999999999, 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2673 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365073+0000", 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7999999999999998e-06 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368449+0000", 2024-04-17T15:39:44.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003376146 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368509+0000", 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0312999999999997e-05 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368541+0000", 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1803e-05 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368708+0000", 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016662099999999999 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369022+0000", 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031360099999999999 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369297+0000", 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027513 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.674 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.378587+0000", 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092898990000000008 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385219+0000", 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066324770000000003 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385281+0000", 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1766000000000005e-05 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385330+0000", 2024-04-17T15:39:44.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9463999999999999e-05 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2684 3.6 e89/18 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head v 89'3, mlcod=76'1)", 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.023981367999999, 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019575401999999999, 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599504+0000", 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604610+0000", 2024-04-17T15:39:44.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051064400000000003 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604655+0000", 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4943e-05 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604679+0000", 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3572999999999999e-05 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604878+0000", 2024-04-17T15:39:44.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019935600000000001 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604944+0000", 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5869000000000002e-05 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.618945+0000", 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014001095999999999 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619077+0000", 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131765 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.679 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2686 3.3e 3:7c7e4e92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.985394595000001, 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024025214999999999, 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.680 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2686 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638092+0000", 2024-04-17T15:39:44.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643705+0000", 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056133939999999998 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643768+0000", 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2983000000000003e-05 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643797+0000", 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8656000000000001e-05 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643979+0000", 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018241199999999999 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644258+0000", 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000278848 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:44.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644492+0000", 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023429200000000001 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.658683+0000", 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014190408 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.661860+0000", 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031772839999999998 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662022+0000", 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016153900000000001 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662113+0000", 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1656000000000005e-05 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2687 3.1a e89/18 3:5bebffce:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_42:head v 89'6, mlcod=76'4)", 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.665690+0000", 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.957792546, 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015857297999999999, 2024-04-17T15:39:44.685 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.665690+0000", 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.665690+0000", 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.665692+0000", 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.984e-06 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672045+0000", 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063525609999999996 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672091+0000", 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6215999999999999e-05 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672109+0000", 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.842e-05 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672257+0000", 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014734599999999999 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672302+0000", 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5352999999999998e-05 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.681461+0000", 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091589340000000005 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.681547+0000", 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6483999999999994e-05 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2691 3.3e 3:7c0d9124:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.877997616, 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018482157999999999, 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2691 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745489+0000", 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.703e-06 2024-04-17T15:39:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748279+0000", 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027905669999999999 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748329+0000", 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9353e-05 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748357+0000", 2024-04-17T15:39:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8575999999999999e-05 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748540+0000", 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018234300000000001 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748940+0000", 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040061699999999998 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.749226+0000", 2024-04-17T15:39:44.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028620000000000002 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.762456+0000", 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013229925999999999 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763785+0000", 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00132825 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763889+0000", 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104616 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763967+0000", 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8007e-05 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2696 3.31 3:8e0a861b:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.776017506000001, 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019128764999999999, 2024-04-17T15:39:44.695 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2696 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:44.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847469+0000", 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4249999999999998e-06 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849776+0000", 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023068659999999999 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849808+0000", 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2363000000000002e-05 2024-04-17T15:39:44.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849823+0000", 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5238e-05 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849950+0000", 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012710600000000001 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850228+0000", 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000277915 2024-04-17T15:39:44.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850487+0000", 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025900899999999999 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.858273+0000", 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077861379999999997 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866446+0000", 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081723060000000007 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866526+0000", 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0242999999999997e-05 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866594+0000", 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8156000000000003e-05 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2731 3.25 3:a7c57b71:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.361408939, 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022381027000000001, 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2731 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262078+0000", 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8940000000000003e-06 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264600+0000", 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025222119999999998 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264637+0000", 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6875000000000002e-05 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264652+0000", 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4908e-05 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264756+0000", 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104163 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264918+0000", 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016187100000000001 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.265111+0000", 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019296999999999999 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.275063+0000", 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099523719999999993 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284321+0000", 2024-04-17T15:39:44.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092580249999999996 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284399+0000", 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7761000000000003e-05 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284455+0000", 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5976000000000001e-05 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2735 3.4 3:2183b4e5:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:44.705 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.312798+0000", 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.310684425, 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015261830000000001, 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2735 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.312798+0000", 2024-04-17T15:39:44.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.312798+0000", 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.312801+0000", 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3939999999999999e-06 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314314+0000", 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015136349999999999 2024-04-17T15:39:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314351+0000", 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6637000000000002e-05 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314367+0000", 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5951999999999999e-05 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314475+0000", 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108529 2024-04-17T15:39:44.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314652+0000", 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017694799999999999 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314778+0000", 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012603399999999999 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.325154+0000", 2024-04-17T15:39:44.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010375545999999999 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.327966+0000", 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028125030000000001 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.328017+0000", 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0039e-05 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.328060+0000", 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3612999999999997e-05 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2737 3.8 e90/18 3:1044985e:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_92:head v 90'7, mlcod=89'5)", 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.339916+0000", 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.283566839000001, 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014835179, 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.711 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339916+0000", 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339916+0000", 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339916+0000", 2024-04-17T15:39:44.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.89e-07 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342261+0000", 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023448039999999998 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342289+0000", 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8249999999999999e-05 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342304+0000", 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5021999999999999e-05 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342420+0000", 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115691 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342452+0000", 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2225999999999999e-05 2024-04-17T15:39:44.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354680+0000", 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012228121 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354751+0000", 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0675999999999999e-05 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.715 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2747 3.3e 3:7f3f09e9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.445776+0000", 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.177706279000001, 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014928067, 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2747 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.716 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.445776+0000", 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.445776+0000", 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.445780+0000", 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.117e-06 2024-04-17T15:39:44.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.447965+0000", 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021856800000000002 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.447999+0000", 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3399000000000003e-05 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.448010+0000", 2024-04-17T15:39:44.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1639e-05 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.448085+0000", 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4763000000000002e-05 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.448236+0000", 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000151316 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.448371+0000", 2024-04-17T15:39:44.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013494700000000001 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.456507+0000", 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081359940000000006 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.460587+0000", 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040795029999999999 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.460652+0000", 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5345000000000005e-05 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.460705+0000", 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2364000000000002e-05 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2749 3.31 3:8ffe76ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.154095599, 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019338203000000002, 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:44.721 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2749 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469390+0000", 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.402e-06 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471361+0000", 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019715980000000002 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471390+0000", 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9351000000000001e-05 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471405+0000", 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4346e-05 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471500+0000", 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4970999999999996e-05 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471683+0000", 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018349600000000001 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471860+0000", 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017656400000000001 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.479403+0000", 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075432010000000002 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488606+0000", 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092024670000000006 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:44.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488673+0000", 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7230999999999994e-05 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488725+0000", 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2575999999999999e-05 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:44.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:44.729 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:44.729 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:44.730 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:44.730 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:44.731 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:44.732 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:44.732 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:44.729+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:44.751 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:44.751 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:44.829 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:44.829+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:44.849 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:44.849 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:44.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:44.930 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:44.929+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:44.989 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:44.989 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:45.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:45.031 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:45.029+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:45.129 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:45.129 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:45.132 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:45.133+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:45.143 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:45.232 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:45.232+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:45.270 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:45.270 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:45.285 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:45.334 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:45.332+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:45.365 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:39:45.440 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:45.440+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:45.462 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:45.463 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:45.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:45.534 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:45.533+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:45.635 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:45.637+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:45.645 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:45.645 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:45.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:45.736 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:45.736+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:45.796 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:45.797 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:45.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:45.855 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:45.857+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:45.938 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:45.937+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:45.941 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:45.941 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:45.956 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:46.023 INFO:tasks.workunit.client.0.smithi044.stderr:200+0 records in 2024-04-17T15:39:46.023 INFO:tasks.workunit.client.0.smithi044.stderr:200+0 records out 2024-04-17T15:39:46.023 INFO:tasks.workunit.client.0.smithi044.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.468 s, 156 MB/s 2024-04-17T15:39:46.047 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:46.049+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:46.130 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:46.130 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:46.140 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:46.141+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:46.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:46.207 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_39_46 2024-04-17T15:39:46.241 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:46.241+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:46.329 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:46.329 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:46.342 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:46.341+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:46.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:46.354 INFO:tasks.workunit.client.0.smithi044.stdout:quota set for the bucket: buck_2024_03_17_15_39_46 2024-04-17T15:39:46.443 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:46.441+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:46.517 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:46.517 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:46.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:46.575 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:46.577+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:46.645 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:46.644+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:46.700 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:46.700 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:46.715 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:46.746 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:46.744+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:46.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:46.835 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:46.835 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:46.847 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:46.845+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:46.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:46.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:46.943 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:46.947 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:46.949+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:46.961 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:46.961 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:46.980 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:46.980 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:46.999 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:47.019 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:47.019 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:47.021 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:47.021 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:47.033 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:47.043 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:47.044 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:47.065 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:47.066 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:47.075 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:47.077+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:47.085 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:47.149 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:47.148+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 164.95437246500001, 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030355455, 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 46 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250116+0000", 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250120+0000", 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3170000000000002e-06 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250136+0000", 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250171+0000", 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5333000000000002e-05 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250196+0000", 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4865999999999999e-05 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250445+0000", 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.250463+0000", 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8689999999999999e-05 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255546+0000", 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050824850000000003 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.255567+0000", 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0965999999999999e-05 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.272712+0000", 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017145062999999999 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273022+0000", 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031051400000000002 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.273365+0000", 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034239600000000002 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.276313+0000", 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029481080000000001 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280246+0000", 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039330909999999997 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280377+0000", 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013094800000000001 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:37:02.280472+0000", 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4707e-05 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1591 3.35 3:acd93661:::5305729a-6754-489e-9706-ab50dfde728d.4412.4__shadow_.9z9Ekh5JADXULMOFudYeBL8D7rOt3Af_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.401030211000005, 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021869765999999999, 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1591 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803458+0000", 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.803461+0000", 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0549999999999998e-06 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808786+0000", 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250609999999999 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808817+0000", 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1627000000000001e-05 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808833+0000", 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6191000000000001e-05 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.808971+0000", 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000137692 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809262+0000", 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029067600000000002 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.809514+0000", 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000251859 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825059+0000", 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015545829000000001 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825173+0000", 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113996 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825243+0000", 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9258000000000007e-05 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:41.825328+0000", 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5521999999999999e-05 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2183 3.35 3:ac014935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.251395743000003, 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028592128000000001, 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2183 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953093+0000", 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.953097+0000", 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2139999999999998e-06 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960326+0000", 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072287250000000001 2024-04-17T15:39:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960458+0000", 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013165599999999999 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960485+0000", 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7455999999999999e-05 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.960672+0000", 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186832 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961101+0000", 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042912000000000001 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.961545+0000", 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044391599999999998 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.980369+0000", 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018824257 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981505+0000", 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011363339999999999 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981610+0000", 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104249 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.981685+0000", 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5369000000000003e-05 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2187 3.20 3:04afe579:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.205404301000002, 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020078048000000001, 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2187 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999084+0000", 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999089+0000", 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6369999999999998e-06 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003407+0000", 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043177679999999996 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003446+0000", 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9666999999999998e-05 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003473+0000", 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6769999999999999e-05 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003668+0000", 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019524399999999999 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.003925+0000", 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025612500000000001 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.004147+0000", 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222704 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014024+0000", 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098762980000000004 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.018985+0000", 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049610729999999999 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019082+0000", 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7758999999999997e-05 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.019162+0000", 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0003e-05 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2200 3.1e e76/18 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.060630003999997, 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019523622000000001, 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143859+0000", 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2600000000000002e-07 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148444+0000", 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045848859999999998 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148482+0000", 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7975999999999997e-05 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148503+0000", 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0713e-05 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148684+0000", 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018094899999999999 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.148752+0000", 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8325999999999996e-05 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163218+0000", 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014465660999999999 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.163382+0000", 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016448499999999999 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2209 3.36 3:6e4caeb8:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.970207162000001, 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028046186000000001, 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2209 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234282+0000", 2024-04-17T15:39:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234287+0000", 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5160000000000002e-06 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241867+0000", 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075797390000000003 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241907+0000", 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0401999999999997e-05 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.241926+0000", 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9179999999999999e-05 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242060+0000", 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013408300000000001 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242320+0000", 2024-04-17T15:39:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025917699999999998 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.242624+0000", 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000304574 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.255662+0000", 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013038131 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262099+0000", 2024-04-17T15:39:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064368660000000003 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262247+0000", 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148202 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.262328+0000", 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0315999999999995e-05 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2221 3.2c 3:3579995b:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.849012371000001, 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022481615, 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2221 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355476+0000", 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.355480+0000", 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.58e-06 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360595+0000", 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051151290000000004 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360643+0000", 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8313999999999999e-05 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360667+0000", 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4125e-05 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.360807+0000", 2024-04-17T15:39:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013905999999999999 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361054+0000", 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024716799999999998 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.361268+0000", 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000214768 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.372233+0000", 2024-04-17T15:39:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010965044 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377661+0000", 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054271830000000004 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377836+0000", 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017558100000000001 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.377958+0000", 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121663 2024-04-17T15:39:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2225 3.36 3:6dbb4af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.808355943000002, 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025820422999999999, 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2225 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396133+0000", 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.396136+0000", 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2339999999999999e-06 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400026+0000", 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038900950000000001 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400069+0000", 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2979999999999998e-05 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400093+0000", 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3896e-05 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400243+0000", 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015054599999999999 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400526+0000", 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000283007 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.400800+0000", 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027318399999999999 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.411636+0000", 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01083604 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421617+0000", 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099808669999999992 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421810+0000", 2024-04-17T15:39:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000193155 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.421953+0000", 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014341899999999999 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2247 3.34 e76/18 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.573113882000001, 2024-04-17T15:39:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.030485694000000001, 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631375+0000", 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631378+0000", 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0429999999999999e-06 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637843+0000", 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064650599999999999 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637892+0000", 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8899000000000001e-05 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.637915+0000", 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2903000000000001e-05 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638070+0000", 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155289 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638133+0000", 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2955999999999998e-05 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661702+0000", 2024-04-17T15:39:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023568782999999999 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661860+0000", 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015876099999999999 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2249 3.20 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.559514780000001, 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02987182, 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2249 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644974+0000", 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.644979+0000", 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652360+0000", 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073812269999999998 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652401+0000", 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1316999999999998e-05 2024-04-17T15:39:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652421+0000", 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9687e-05 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652563+0000", 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014209499999999999 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.652811+0000", 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024760400000000001 2024-04-17T15:39:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.653043+0000", 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000231998 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.667188+0000", 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014145342 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674671+0000", 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074827380000000001 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674769+0000", 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7838999999999996e-05 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.674846+0000", 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7072999999999999e-05 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2262 3.26 3:6636822f:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.422153305000002, 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020197527, 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2262 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782335+0000", 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.782340+0000", 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3370000000000001e-06 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786395+0000", 2024-04-17T15:39:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040552740000000002 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786450+0000", 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4846999999999999e-05 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786478+0000", 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.811e-05 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786621+0000", 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142798 2024-04-17T15:39:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.786898+0000", 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027743800000000002 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.787136+0000", 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237634 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.797168+0000", 2024-04-17T15:39:47.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010032350000000001 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802156+0000", 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049883000000000002 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802329+0000", 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017284099999999999 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.802533+0000", 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020359800000000001 2024-04-17T15:39:47.263 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2266 3.a 3:523a9b7a:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.377751287999999, 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020319462, 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2266 2024-04-17T15:39:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826737+0000", 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.826740+0000", 2024-04-17T15:39:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7800000000000001e-06 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830715+0000", 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039743479999999999 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830753+0000", 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8192999999999998e-05 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830771+0000", 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8139999999999999e-05 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.830972+0000", 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000201595 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831209+0000", 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023676799999999999 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.831439+0000", 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022980799999999999 2024-04-17T15:39:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.845969+0000", 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014529553000000001 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846744+0000", 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00077553300000000002 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.846916+0000", 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171695 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.847057+0000", 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141049 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2289 3.36 3:6d9c29d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.139519, 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028794229000000001, 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2289 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064970+0000", 2024-04-17T15:39:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.064974+0000", 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5800000000000002e-06 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069897+0000", 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049227460000000004 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069939+0000", 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2376999999999998e-05 2024-04-17T15:39:47.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.069964+0000", 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5015999999999999e-05 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070150+0000", 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018596500000000001 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070583+0000", 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043244600000000001 2024-04-17T15:39:47.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.070838+0000", 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000255491 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093151+0000", 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022312304000000002 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093505+0000", 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035477600000000001 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093610+0000", 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010493300000000001 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.093764+0000", 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000153595 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2293 3.a 3:53332383:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.274 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.097893175000003, 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021728066000000001, 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2293 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:47.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106595+0000", 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.106598+0000", 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7599999999999998e-06 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110394+0000", 2024-04-17T15:39:47.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037959489999999999 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110433+0000", 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9289000000000003e-05 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110459+0000", 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.51e-05 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110594+0000", 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013532299999999999 2024-04-17T15:39:47.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.110866+0000", 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027189100000000002 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.111110+0000", 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024460999999999998 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.127108+0000", 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015997838 2024-04-17T15:39:47.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128143+0000", 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001034791 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128245+0000", 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101859 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.128324+0000", 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8656e-05 2024-04-17T15:39:47.279 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2668 3.26 3:657fda54:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.963170812000001, 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01928042, 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.280 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2668 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241318+0000", 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.241320+0000", 2024-04-17T15:39:47.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2749999999999998e-06 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247273+0000", 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059532719999999999 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247297+0000", 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3306e-05 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247308+0000", 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1248e-05 2024-04-17T15:39:47.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247426+0000", 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011807300000000001 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247677+0000", 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025140299999999998 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.247920+0000", 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024303399999999999 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.255818+0000", 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078976210000000005 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260460+0000", 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046419640000000002 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260537+0000", 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6971999999999994e-05 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.260598+0000", 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1252000000000002e-05 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2675 3.20 3:05d5fe92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.798103221000002, 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020675137, 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.285 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2675 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406385+0000", 2024-04-17T15:39:47.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.406389+0000", 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410448+0000", 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004059961 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410484+0000", 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5676000000000002e-05 2024-04-17T15:39:47.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410501+0000", 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6506000000000001e-05 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410583+0000", 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2711000000000001e-05 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410735+0000", 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015197600000000001 2024-04-17T15:39:47.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.410871+0000", 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013602500000000001 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.415155+0000", 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004283706 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.426964+0000", 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011808637 2024-04-17T15:39:47.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.427018+0000", 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4342000000000002e-05 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.427061+0000", 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2549999999999997e-05 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2723 3.35 3:acec52b7:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.031330455999999, 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027979833999999999, 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2723 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173158+0000", 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.173162+0000", 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3569999999999998e-06 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177293+0000", 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041312199999999997 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177335+0000", 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2026e-05 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177352+0000", 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7292999999999999e-05 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177446+0000", 2024-04-17T15:39:47.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3929000000000001e-05 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177594+0000", 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014783 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.177714+0000", 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120328 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.186751+0000", 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090370250000000006 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200795+0000", 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014044176 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.200990+0000", 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000194904 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.201138+0000", 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000147746 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2743 3.34 e90/18 3:2f634024:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_98:head v 90'4, mlcod=89'2)", 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.794186604, 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019401910000000001, 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410302+0000", 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410303+0000", 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8700000000000004e-07 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414523+0000", 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042196400000000002 2024-04-17T15:39:47.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414555+0000", 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2101999999999999e-05 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414579+0000", 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4003e-05 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414711+0000", 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000132383 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.414780+0000", 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8936000000000005e-05 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429545+0000", 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014764823999999999 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.429704+0000", 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000159135 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.299 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2748 3.36 3:6c2725e9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.746158185999999, 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021509582999999999, 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.300 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2748 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458330+0000", 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.458333+0000", 2024-04-17T15:39:47.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462083+0000", 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037501040000000002 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462107+0000", 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4278e-05 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462122+0000", 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4289e-05 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462272+0000", 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015080099999999999 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462582+0000", 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030927100000000001 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.462855+0000", 2024-04-17T15:39:47.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027330099999999999 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.476558+0000", 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013703473000000001 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479667+0000", 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031088439999999999 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479765+0000", 2024-04-17T15:39:47.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7820999999999997e-05 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.479840+0000", 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5041000000000002e-05 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2750 3.20 3:07eaa1ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.724485252000001, 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020193289, 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2750 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480003+0000", 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.480006+0000", 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.463e-06 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485236+0000", 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052299909999999998 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485275+0000", 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9153000000000003e-05 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485295+0000", 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0412999999999999e-05 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485469+0000", 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017371500000000001 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.485744+0000", 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027470100000000003 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.486016+0000", 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027220100000000002 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.494631+0000", 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086144940000000003 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.499969+0000", 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053388300000000001 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.500108+0000", 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138892 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.500197+0000", 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8436000000000005e-05 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.311 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:47.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:47.313 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:47.312+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:47.392 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:39:47.414 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:47.413+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:47.444 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:47.444 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:47.444 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:39:47.444 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:47.458 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:47.515 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:47.512+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:47.616 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:47.616+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:47.693 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:47.694 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:47.694 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:47.717 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:47.716+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:47.818 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:47.817+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:47.828 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:47.828 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 179.75462683399999, 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:47.829 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:39:47.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:39:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 179.26259366299999, 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:39:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:39:47.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:39:47.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:39:47.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 179.26255474000001, 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.841 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 179.26235515799999, 2024-04-17T15:39:47.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:39:47.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:39:47.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 179.262309926, 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:39:47.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:39:47.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:39:47.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:39:47.857 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.859205709999998, 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:39:47.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.863 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2191 3.3b 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.780247879000001, 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024079896999999999, 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2191 2024-04-17T15:39:47.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047034+0000", 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:39:47.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051686+0000", 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046523550000000004 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051729+0000", 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3032999999999999e-05 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051748+0000", 2024-04-17T15:39:47.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9148999999999999e-05 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051911+0000", 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016241300000000001 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052338+0000", 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000427549 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052584+0000", 2024-04-17T15:39:47.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000245861 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.059685+0000", 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071007229999999998 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070946+0000", 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011261136 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071036+0000", 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0066000000000001e-05 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071110+0000", 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4609000000000003e-05 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.729083770000003, 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.869 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:47.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:39:47.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.718878945, 2024-04-17T15:39:47.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:39:47.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:39:47.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2207 3.15 3:ab698b89:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.612767204000001, 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022770393999999999, 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2207 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214511+0000", 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.214516+0000", 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.284e-06 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218674+0000", 2024-04-17T15:39:47.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004158953 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218721+0000", 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6669999999999999e-05 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218749+0000", 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7846000000000001e-05 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.218887+0000", 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013819200000000001 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219113+0000", 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022536100000000001 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.219315+0000", 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020251500000000001 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.232744+0000", 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013428796999999999 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.236964+0000", 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042205189999999998 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237138+0000", 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000173198 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.237282+0000", 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014405900000000001 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2214 3.2f e76/45 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.538142803, 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022854762000000001, 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289138+0000", 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293890+0000", 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047525909999999996 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293918+0000", 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7742999999999998e-05 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293933+0000", 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4623e-05 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294082+0000", 2024-04-17T15:39:47.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149662 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294148+0000", 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5345999999999994e-05 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311863+0000", 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017715564999999999 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311990+0000", 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012724899999999999 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2218 3.39 3:9d9d4055:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.499954748, 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023480399999999998, 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2218 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.889 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327327+0000", 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:47.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331723+0000", 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043962680000000001 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331760+0000", 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6903000000000002e-05 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331783+0000", 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3598999999999999e-05 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331906+0000", 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012282300000000001 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332168+0000", 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026144100000000001 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332408+0000", 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024071499999999999 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.345166+0000", 2024-04-17T15:39:47.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012757961 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350543+0000", 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053770720000000001 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350728+0000", 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018468599999999999 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350804+0000", 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6066e-05 2024-04-17T15:39:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.253331066000001, 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.894 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:39:47.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 55.125474852000004, 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.899 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:39:47.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2655 3.3b 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.899687834000002, 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027395325000000002, 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2655 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927594+0000", 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931218+0000", 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036242679999999999 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931243+0000", 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5072e-05 2024-04-17T15:39:47.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931254+0000", 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931332+0000", 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8238999999999994e-05 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931477+0000", 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014441599999999999 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931605+0000", 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128959 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.937946+0000", 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063408049999999997 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954869+0000", 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016922554999999999 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954921+0000", 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2250999999999998e-05 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954986+0000", 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4843000000000002e-05 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2689 3.2d 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.126678989999998, 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029047231999999999, 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.909 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2689 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:47.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700603+0000", 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1480000000000002e-06 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704578+0000", 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039753929999999998 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704621+0000", 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2707999999999998e-05 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704638+0000", 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7711999999999999e-05 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704752+0000", 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113894 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704982+0000", 2024-04-17T15:39:47.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022947700000000001 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.705211+0000", 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022907099999999999 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.713505+0000", 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082936940000000008 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729431+0000", 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015926419000000001 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729539+0000", 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108517 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729647+0000", 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107199 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2717 3.11 3:8a343ec0:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:47.914 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.731507404999999, 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022786449, 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2717 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095773+0000", 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3460000000000001e-06 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099572+0000", 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037990350000000001 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099595+0000", 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2194000000000001e-05 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099605+0000", 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0125999999999999e-05 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099676+0000", 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1738999999999999e-05 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099813+0000", 2024-04-17T15:39:47.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013640899999999999 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099941+0000", 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012855700000000001 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.105972+0000", 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060307570000000003 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118437+0000", 2024-04-17T15:39:47.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012464761 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118491+0000", 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4240000000000002e-05 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118557+0000", 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6285000000000007e-05 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2741 3.39 3:9f26ba31:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:47.919 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.447951375999999, 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027414362000000001, 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2741 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379330+0000", 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1599999999999998e-06 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383931+0000", 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046010790000000001 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383974+0000", 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2700000000000001e-05 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383993+0000", 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8938999999999999e-05 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384090+0000", 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7207000000000006e-05 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384097+0000", 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4309999999999999e-06 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388621+0000", 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045244179999999997 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388822+0000", 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020077199999999999 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:47.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388956+0000", 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013419500000000001 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.394950+0000", 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059936980000000004 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406560+0000", 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011610448000000001 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406665+0000", 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104949 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406741+0000", 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6365999999999994e-05 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2744 3.11 3:88cda062:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.412174690000001, 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024291046, 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2744 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415108+0000", 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5399999999999997e-06 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.418996+0000", 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038875849999999998 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419040+0000", 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3696999999999999e-05 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419059+0000", 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.897e-05 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419168+0000", 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010971 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419367+0000", 2024-04-17T15:39:47.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019839900000000001 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419540+0000", 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017327799999999999 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.436287+0000", 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016746727999999999 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439104+0000", 2024-04-17T15:39:47.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028172520000000001 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439275+0000", 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017058500000000001 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439395+0000", 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120302 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2767 3.f 3:f0d8e033:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.14717289, 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024335816999999999, 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2767 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:47.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680108+0000", 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7640000000000001e-06 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:47.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684062+0000", 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039540349999999998 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684097+0000", 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4517000000000002e-05 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684114+0000", 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7469000000000002e-05 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684225+0000", 2024-04-17T15:39:47.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110746 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684469+0000", 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243911 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684718+0000", 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024909800000000001 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:47.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.701761+0000", 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017042486999999999 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704218+0000", 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024576820000000001 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704315+0000", 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6482000000000002e-05 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704441+0000", 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012662599999999999 2024-04-17T15:39:47.935 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:47.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:47.936 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:47.937 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:47.937+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:47.937 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:48.039 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:48.037+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:48.061 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:48.061 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:48.074 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:48.140 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:48.140+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:48.203 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:48.203 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:48.203 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:48.203 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:48.203 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:48.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:48.260 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:48.260+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:48.342 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:48.341+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:48.376 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:39:48.388 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2198 3.3a e76/18 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.265826263000001, 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019644212000000001, 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9499999999999998e-07 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129524+0000", 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067742130000000003 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129550+0000", 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5395999999999999e-05 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129565+0000", 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5064e-05 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129665+0000", 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100381 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129688+0000", 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3479999999999999e-05 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142322+0000", 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012633287999999999 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142394+0000", 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2094999999999993e-05 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2202 3.30 e76/18 3:0ddb5c69:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_21:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.219463423000001, 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017043618999999999, 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.393 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169112+0000", 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.169115+0000", 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0990000000000001e-06 2024-04-17T15:39:48.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174068+0000", 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049531810000000001 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174103+0000", 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4885000000000002e-05 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174119+0000", 2024-04-17T15:39:48.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6263999999999999e-05 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174216+0000", 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7578000000000007e-05 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.174246+0000", 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9810000000000001e-05 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186092+0000", 2024-04-17T15:39:48.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011845496 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.186156+0000", 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4306000000000004e-05 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2205 3.17 3:ea2615d0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.194322495999998, 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017729135, 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.397 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2205 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194257+0000", 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1470000000000001e-06 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196293+0000", 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020363099999999999 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196318+0000", 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5194999999999998e-05 2024-04-17T15:39:48.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196331+0000", 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2977e-05 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196416+0000", 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5049000000000005e-05 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196543+0000", 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012732100000000001 2024-04-17T15:39:48.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196639+0000", 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5302000000000003e-05 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.202228+0000", 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055891480000000004 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211895+0000", 2024-04-17T15:39:48.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096668139999999993 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211941+0000", 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6783999999999998e-05 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211983+0000", 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1087999999999997e-05 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2208 3.1b 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.164374422999998, 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021369764999999999, 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2208 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224204+0000", 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6259999999999999e-06 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226060+0000", 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001855766 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226089+0000", 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8806000000000002e-05 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226103+0000", 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.483e-05 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226194+0000", 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0162999999999997e-05 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226364+0000", 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017058399999999999 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226515+0000", 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000150493 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236552+0000", 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010037107999999999 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245450+0000", 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088980710000000005 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245517+0000", 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7325999999999999e-05 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245571+0000", 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3992000000000001e-05 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2230 3.3a e76/18 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.933284985, 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018369284999999999, 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.408 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455293+0000", 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.841e-06 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460234+0000", 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049411330000000003 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460257+0000", 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3159999999999998e-05 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460268+0000", 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1056000000000001e-05 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460336+0000", 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7595000000000006e-05 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460368+0000", 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2205000000000001e-05 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473473+0000", 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013105314 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473660+0000", 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698099999999999 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2232 3.1b 3:da25f619:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.919019540999997, 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017288061, 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.412 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2232 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469556+0000", 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.469559+0000", 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.649e-06 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.471972+0000", 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002412862 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472008+0000", 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5945999999999998e-05 2024-04-17T15:39:48.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472023+0000", 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5122e-05 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472113+0000", 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0183e-05 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472254+0000", 2024-04-17T15:39:48.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014096900000000001 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472363+0000", 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010873499999999999 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.482529+0000", 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010166019 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486718+0000", 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041890080000000001 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486790+0000", 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1953999999999996e-05 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.486844+0000", 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4614000000000003e-05 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2234 3.17 3:eb70e137:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.898367063000002, 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017531280999999999, 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2234 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490209+0000", 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.490212+0000", 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3749999999999999e-06 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492617+0000", 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024048540000000001 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492639+0000", 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1472e-05 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492648+0000", 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9870000000000005e-06 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492729+0000", 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1034999999999999e-05 2024-04-17T15:39:48.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.492870+0000", 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014136800000000001 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.493035+0000", 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016558 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.497649+0000", 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046137119999999998 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507638+0000", 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099891249999999997 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507687+0000", 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8869000000000003e-05 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.507740+0000", 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2904e-05 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.422 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2240 3.1f 3:f8ad20ec:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.835074802000001, 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018806135000000002, 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2240 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553505+0000", 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.715e-06 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556184+0000", 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026795149999999999 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556217+0000", 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2323000000000002e-05 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556231+0000", 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4662e-05 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.425 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556329+0000", 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7598999999999998e-05 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556493+0000", 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016452900000000001 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556649+0000", 2024-04-17T15:39:48.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000155291 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.564664+0000", 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080152699999999997 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572214+0000", 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00754991 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572260+0000", 2024-04-17T15:39:48.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6526000000000001e-05 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572307+0000", 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6795000000000002e-05 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2241 3.12 3:4bb118b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.823092850000002, 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018446299999999999, 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.428 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2241 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:48.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565485+0000", 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566940+0000", 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001454718 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566971+0000", 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0550999999999999e-05 2024-04-17T15:39:48.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566996+0000", 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5537999999999998e-05 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567065+0000", 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9153999999999996e-05 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567197+0000", 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013143200000000001 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567298+0000", 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101488 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.573358+0000", 2024-04-17T15:39:48.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060601309999999999 2024-04-17T15:39:48.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583838+0000", 2024-04-17T15:39:48.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010479197000000001 2024-04-17T15:39:48.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583890+0000", 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2117999999999998e-05 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583929+0000", 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9530000000000003e-05 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2245 3.17 3:e9b13e02:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.785354451000003, 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018296036000000002, 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2245 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603225+0000", 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1379999999999999e-06 2024-04-17T15:39:48.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604941+0000", 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001716595 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604968+0000", 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7137000000000001e-05 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604980+0000", 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1704e-05 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605056+0000", 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6265000000000002e-05 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605181+0000", 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012499399999999999 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605283+0000", 2024-04-17T15:39:48.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102027 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.613207+0000", 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079242050000000001 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621395+0000", 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081871159999999995 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621463+0000", 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8354000000000003e-05 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621517+0000", 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4500999999999999e-05 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2249 3.20 e76/18 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:48.440 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.735437431000001, 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021006212999999999, 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653140+0000", 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-06 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658320+0000", 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051792610000000001 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658379+0000", 2024-04-17T15:39:48.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8829999999999997e-05 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658398+0000", 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9193000000000001e-05 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658487+0000", 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9685999999999995e-05 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658514+0000", 2024-04-17T15:39:48.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6818999999999999e-05 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674073+0000", 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015559078 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674145+0000", 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1360999999999997e-05 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2258 3.17 3:e8df4510:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.648138011, 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017321514, 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2258 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740438+0000", 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.740440+0000", 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4609999999999998e-06 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742267+0000", 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018265239999999999 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742291+0000", 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3787000000000001e-05 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742301+0000", 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0253e-05 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742388+0000", 2024-04-17T15:39:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.7157000000000006e-05 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742592+0000", 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020355699999999999 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.742772+0000", 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018084399999999999 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.748426+0000", 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056539870000000001 2024-04-17T15:39:48.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757641+0000", 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092143060000000002 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757693+0000", 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1916999999999998e-05 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.757759+0000", 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6721e-05 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.449 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2278 3.1b 3:d8a1e895:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 55.437492526, 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017298622, 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2278 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.450 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951083+0000", 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951086+0000", 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9459999999999998e-06 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952905+0000", 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001818442 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952936+0000", 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1260000000000002e-05 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.952950+0000", 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3658e-05 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953031+0000", 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1593000000000003e-05 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953143+0000", 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011195400000000001 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.953266+0000", 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012241500000000001 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.961279+0000", 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080132980000000003 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968256+0000", 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006977507 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968326+0000", 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9251999999999994e-05 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.968382+0000", 2024-04-17T15:39:48.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6297e-05 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2658 3.12 3:4af6eaf9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.390844255000001, 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022170373, 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.455 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2658 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997736+0000", 2024-04-17T15:39:48.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2699999999999998e-06 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002164+0000", 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044277179999999998 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002223+0000", 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8977000000000001e-05 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002245+0000", 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-05 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002392+0000", 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014651000000000001 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002690+0000", 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029813000000000002 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002969+0000", 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027968200000000001 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.014066+0000", 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011096415 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019790+0000", 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057241410000000003 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019854+0000", 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3875999999999996e-05 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019902+0000", 2024-04-17T15:39:48.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8093999999999997e-05 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2661 3.1f 3:fb74984d:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.315919533999999, 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019684444999999998, 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.460 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2661 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072660+0000", 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999999e-06 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075792+0000", 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003131778 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075850+0000", 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8428999999999999e-05 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075871+0000", 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076025+0000", 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000154516 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076299+0000", 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000273808 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076562+0000", 2024-04-17T15:39:48.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000262718 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.087909+0000", 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011347411999999999 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092100+0000", 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041911700000000001 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092207+0000", 2024-04-17T15:39:48.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010683600000000001 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092341+0000", 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133685 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2662 3.1b 3:db91a7d5:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.290664294999999, 2024-04-17T15:39:48.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017881869000000002, 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2662 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:48.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097915+0000", 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.977e-06 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101097+0000", 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181967 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101143+0000", 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6186000000000001e-05 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101162+0000", 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9639999999999998e-05 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101303+0000", 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014092900000000001 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101603+0000", 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029994499999999998 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101842+0000", 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023849099999999999 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.113214+0000", 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011372372 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.469 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115477+0000", 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022628879999999998 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115665+0000", 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018835799999999999 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115793+0000", 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000128116 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2684 3.6 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.793229728, 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024322572000000001, 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2684 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595350+0000", 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7400000000000002e-06 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598310+0000", 2024-04-17T15:39:48.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029596589999999999 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598365+0000", 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5748999999999998e-05 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598388+0000", 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2986999999999999e-05 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598582+0000", 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000193356 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598920+0000", 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033823700000000002 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599274+0000", 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000353798 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.608957+0000", 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096830800000000002 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619432+0000", 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010475728 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619528+0000", 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5241999999999994e-05 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619669+0000", 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000140996 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.475 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2695 3.17 3:e967dc33:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.553569280000001, 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021609239999999998, 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2695 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.476 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835010+0000", 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.337e-06 2024-04-17T15:39:48.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838483+0000", 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003473313 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838529+0000", 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5291999999999999e-05 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838550+0000", 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1469000000000001e-05 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838660+0000", 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011021 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838795+0000", 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013448099999999999 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838907+0000", 2024-04-17T15:39:48.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847213+0000", 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0083057990000000009 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856478+0000", 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092645430000000001 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856557+0000", 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9178000000000007e-05 2024-04-17T15:39:48.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856616+0000", 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8872999999999997e-05 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2733 3.6 3:600adf99:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.099158781, 2024-04-17T15:39:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017400448999999998, 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2733 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289417+0000", 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.289420+0000", 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6230000000000001e-06 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292197+0000", 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027770009999999999 2024-04-17T15:39:48.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292217+0000", 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0322999999999998e-05 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292232+0000", 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5265999999999999e-05 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292321+0000", 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8782999999999993e-05 2024-04-17T15:39:48.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292509+0000", 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000187531 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.292680+0000", 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017115500000000001 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.303287+0000", 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010606743 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306704+0000", 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034175030000000001 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306775+0000", 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0533999999999999e-05 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.306818+0000", 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2987e-05 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2734 3.1 3:80804e22:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.086884496, 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017781458, 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2734 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301694+0000", 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0769999999999999e-06 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304665+0000", 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029708960000000002 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304697+0000", 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1906999999999998e-05 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304709+0000", 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1793e-05 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304795+0000", 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6108999999999998e-05 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304985+0000", 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019023900000000001 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.305095+0000", 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010995800000000001 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314807+0000", 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097112610000000005 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319324+0000", 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045170770000000004 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319409+0000", 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5587999999999994e-05 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319473+0000", 2024-04-17T15:39:48.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3553000000000006e-05 2024-04-17T15:39:48.492 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.492 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.492 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.492 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.492 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.492 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:48.494 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:48.494 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:48.492+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:48.594 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:48.592+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:48.667 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:48.667 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:48.667 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:48.668 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:48.681 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:48.695 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:48.697+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:48.796 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:48.797+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:48.838 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:48.838 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:48.838 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:48.838 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:48.838 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:48.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:48.897 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:48.897+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2192 3.0 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.918139021999998, 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016712945, 2024-04-17T15:39:48.974 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2192 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056609+0000", 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8192000000000002e-05 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058326+0000", 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017167980000000001 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058354+0000", 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8469000000000001e-05 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058368+0000", 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3567000000000001e-05 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058448+0000", 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9943000000000004e-05 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058629+0000", 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018072100000000001 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058790+0000", 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016184000000000001 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.069821+0000", 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011030629 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073138+0000", 2024-04-17T15:39:48.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033164679999999999 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073206+0000", 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8324999999999994e-05 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073274+0000", 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7992999999999998e-05 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:48.979 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.899936285000003, 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.896569782999997, 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:39:48.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.988 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2231 3.3e 3:7e08bf39:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.516454807000002, 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016293021000000001, 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2231 2024-04-17T15:39:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458245+0000", 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.458262+0000", 2024-04-17T15:39:48.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6534000000000001e-05 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460097+0000", 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001835298 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460124+0000", 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7359e-05 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460140+0000", 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5241e-05 2024-04-17T15:39:48.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460208+0000", 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8579999999999997e-05 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460333+0000", 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012509500000000001 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460467+0000", 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013373599999999999 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.472830+0000", 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012363486 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474285+0000", 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014549669999999999 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474416+0000", 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013019099999999999 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.474538+0000", 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012253399999999999 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.319370024999998, 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:48.994 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:39:48.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.997 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2252 3.25 3:a447a9ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 56.296440552, 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014955945, 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:48.999 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2252 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678259+0000", 2024-04-17T15:39:49.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.678262+0000", 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0639999999999998e-06 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680355+0000", 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020922559999999998 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680381+0000", 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6437000000000001e-05 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680395+0000", 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3653e-05 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680498+0000", 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103486 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680682+0000", 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018336700000000001 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.680824+0000", 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014226399999999999 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.692441+0000", 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011617331 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693055+0000", 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000614092 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693133+0000", 2024-04-17T15:39:49.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7996000000000003e-05 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.693215+0000", 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1998999999999999e-05 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2646 3.8 e89/18 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head v 89'5, mlcod=76'3)", 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 20.234174302, 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018982274, 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.004 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740529+0000", 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9660000000000001e-06 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745823+0000", 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052946060000000003 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745886+0000", 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3251999999999997e-05 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745910+0000", 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3964e-05 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746063+0000", 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015276100000000001 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746089+0000", 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6180999999999999e-05 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759412+0000", 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013322387999999999 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759508+0000", 2024-04-17T15:39:49.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6156000000000006e-05 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2663 3.0 3:00b68c77:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.851067879999999, 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020648330999999999, 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2663 2024-04-17T15:39:49.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123635+0000", 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:39:49.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126602+0000", 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029664679999999999 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126640+0000", 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.82e-05 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126654+0000", 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4440000000000001e-05 2024-04-17T15:39:49.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126752+0000", 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7879000000000003e-05 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126948+0000", 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000195983 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.127139+0000", 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019063500000000001 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.143125+0000", 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015986416999999999 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144087+0000", 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00096153799999999995 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144196+0000", 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010974199999999999 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144280+0000", 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3962999999999996e-05 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2669 3.4 3:2238a661:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.709420251000001, 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020392082999999998, 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.013 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2669 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265285+0000", 2024-04-17T15:39:49.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4729999999999999e-06 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268400+0000", 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003114618 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268449+0000", 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9462999999999997e-05 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268477+0000", 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7440000000000002e-05 2024-04-17T15:39:49.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268646+0000", 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016956299999999999 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268970+0000", 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032326799999999998 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.269256+0000", 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028625100000000001 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.278736+0000", 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094797909999999996 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285472+0000", 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067364429999999999 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285588+0000", 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116452 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285672+0000", 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3320999999999997e-05 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2673 3.3e 3:7c55c310:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.609631728, 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020262019999999999, 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.018 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2673 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365073+0000", 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7999999999999998e-06 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368449+0000", 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003376146 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368509+0000", 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0312999999999997e-05 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368541+0000", 2024-04-17T15:39:49.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1803e-05 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368708+0000", 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016662099999999999 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369022+0000", 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031360099999999999 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:49.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369297+0000", 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027513 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.378587+0000", 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092898990000000008 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385219+0000", 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066324770000000003 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385281+0000", 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1766000000000005e-05 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385330+0000", 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9463999999999999e-05 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2684 3.6 e89/18 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head v 89'3, mlcod=76'1)", 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.375198589, 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019575401999999999, 2024-04-17T15:39:49.023 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599504+0000", 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604610+0000", 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051064400000000003 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604655+0000", 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4943e-05 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604679+0000", 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3572999999999999e-05 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604878+0000", 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019935600000000001 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604944+0000", 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5869000000000002e-05 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.618945+0000", 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014001095999999999 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619077+0000", 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131765 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2686 3.3e 3:7c7e4e92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.336611816000001, 2024-04-17T15:39:49.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024025214999999999, 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2686 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638092+0000", 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643705+0000", 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056133939999999998 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643768+0000", 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2983000000000003e-05 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643797+0000", 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8656000000000001e-05 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643979+0000", 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018241199999999999 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644258+0000", 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000278848 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644492+0000", 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023429200000000001 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.658683+0000", 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014190408 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.661860+0000", 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031772839999999998 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662022+0000", 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016153900000000001 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662113+0000", 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1656000000000005e-05 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2687 3.1a e89/18 3:5bebffce:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_42:head v 89'6, mlcod=76'4)", 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.665690+0000", 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.309009766999999, 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015857297999999999, 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.665690+0000", 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.665690+0000", 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.665692+0000", 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.984e-06 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672045+0000", 2024-04-17T15:39:49.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063525609999999996 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672091+0000", 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6215999999999999e-05 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672109+0000", 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.842e-05 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672257+0000", 2024-04-17T15:39:49.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014734599999999999 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.672302+0000", 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5352999999999998e-05 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.681461+0000", 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091589340000000005 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.681547+0000", 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6483999999999994e-05 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2691 3.3e 3:7c0d9124:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.229214837000001, 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018482157999999999, 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.037 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2691 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:49.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745489+0000", 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.703e-06 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748279+0000", 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027905669999999999 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748329+0000", 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9353e-05 2024-04-17T15:39:49.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748357+0000", 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8575999999999999e-05 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748540+0000", 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018234300000000001 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748940+0000", 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040061699999999998 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.749226+0000", 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028620000000000002 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.762456+0000", 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013229925999999999 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763785+0000", 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00132825 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763889+0000", 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104616 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763967+0000", 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8007e-05 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2696 3.31 3:8e0a861b:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:49.042 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.127234727000001, 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019128764999999999, 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2696 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847469+0000", 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4249999999999998e-06 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849776+0000", 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023068659999999999 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849808+0000", 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2363000000000002e-05 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849823+0000", 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5238e-05 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849950+0000", 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012710600000000001 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850228+0000", 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000277915 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850487+0000", 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025900899999999999 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.858273+0000", 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077861379999999997 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866446+0000", 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081723060000000007 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866526+0000", 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0242999999999997e-05 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866594+0000", 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8156000000000003e-05 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2731 3.25 3:a7c57b71:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.712626159999999, 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022381027000000001, 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2731 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262078+0000", 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8940000000000003e-06 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264600+0000", 2024-04-17T15:39:49.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025222119999999998 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264637+0000", 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6875000000000002e-05 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264652+0000", 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4908e-05 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264756+0000", 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104163 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264918+0000", 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016187100000000001 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.265111+0000", 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019296999999999999 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.275063+0000", 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099523719999999993 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284321+0000", 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092580249999999996 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284399+0000", 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7761000000000003e-05 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284455+0000", 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5976000000000001e-05 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.052 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2735 3.4 3:2183b4e5:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.312798+0000", 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.661901646, 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015261830000000001, 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2735 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.312798+0000", 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.312798+0000", 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.312801+0000", 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3939999999999999e-06 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314314+0000", 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015136349999999999 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314351+0000", 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6637000000000002e-05 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314367+0000", 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5951999999999999e-05 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314475+0000", 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108529 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314652+0000", 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017694799999999999 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314778+0000", 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012603399999999999 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.325154+0000", 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010375545999999999 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.327966+0000", 2024-04-17T15:39:49.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028125030000000001 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.328017+0000", 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0039e-05 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.328060+0000", 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3612999999999997e-05 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2737 3.8 e90/18 3:1044985e:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_92:head v 90'7, mlcod=89'5)", 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.339916+0000", 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.634784060000001, 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014835179, 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339916+0000", 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339916+0000", 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339916+0000", 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.89e-07 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342261+0000", 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023448039999999998 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342289+0000", 2024-04-17T15:39:49.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8249999999999999e-05 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342304+0000", 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5021999999999999e-05 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342420+0000", 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115691 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.342452+0000", 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2225999999999999e-05 2024-04-17T15:39:49.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354680+0000", 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012228121 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354751+0000", 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0675999999999999e-05 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2747 3.3e 3:7f3f09e9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.445776+0000", 2024-04-17T15:39:49.061 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.528923500000001, 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014928067, 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2747 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.445776+0000", 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.445776+0000", 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.445780+0000", 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.117e-06 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.447965+0000", 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021856800000000002 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.447999+0000", 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3399000000000003e-05 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.448010+0000", 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1639e-05 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.448085+0000", 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4763000000000002e-05 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.448236+0000", 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000151316 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.448371+0000", 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013494700000000001 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.456507+0000", 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081359940000000006 2024-04-17T15:39:49.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.460587+0000", 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040795029999999999 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.460652+0000", 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5345000000000005e-05 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.460705+0000", 2024-04-17T15:39:49.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2364000000000002e-05 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2749 3.31 3:8ffe76ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.50531282, 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019338203000000002, 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:49.067 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2749 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:49.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469390+0000", 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.402e-06 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471361+0000", 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019715980000000002 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471390+0000", 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9351000000000001e-05 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471405+0000", 2024-04-17T15:39:49.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4346e-05 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471500+0000", 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4970999999999996e-05 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471683+0000", 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018349600000000001 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471860+0000", 2024-04-17T15:39:49.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017656400000000001 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.479403+0000", 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075432010000000002 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488606+0000", 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092024670000000006 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488673+0000", 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7230999999999994e-05 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:49.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488725+0000", 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2575999999999999e-05 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:49.072 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:49.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:49.074 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:49.072+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:49.103 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:49.174 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:49.172+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:49.232 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:49.232 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:49.232 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:49.232 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:49.246 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:49.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:49.266 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:49.266 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:49.275 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:49.273+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:49.284 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:49.284 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:49.302 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:49.302 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:49.322 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:49.323 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:49.343 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:49.343 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:49.362 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:49.362 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:49.364 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:49.365 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:49.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:49.377 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:49.377+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:49.389 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:49.476 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:49.476+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:49.503 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:49.503 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:49.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:49.604 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:49.604+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:49.678 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:49.676+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:49.680 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:49.680 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:49.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:49.779 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:49.781+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:49.857 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:49.857 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:49.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:49.916 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:49.916+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:49.981 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:49.981+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:49.998 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:49.998 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:50.012 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:50.082 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:50.080+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:50.146 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:50.146 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:50.160 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:50.207 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:50.209+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:50.283 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:50.284 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:50.284 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:50.285+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:50.299 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:50.385 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:50.384+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:50.467 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:50.467 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:50.482 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:50.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:39:50.531 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:50.533+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:50.586 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:50.584+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:50.625 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:50.625 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:50.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:50.687 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:50.689+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:50.788 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:50.788+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:50.834 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:50.834 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:50.852 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:50.889 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:50.888+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:50.990 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:50.988+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:50.999 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:50.999 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:51.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:51.091 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:51.088+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:51.148 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:51.148 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:51.163 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:51.193 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:51.192+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:51.293 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:51.293+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:51.305 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:51.305 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:51.322 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:51.394 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:51.392+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:51.397 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:39:51.407 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:51.496 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:51.496+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:51.522 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:51.522 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:51.542 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:51.598 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:51.596+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:51.601 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:51.601 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:51.623 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:51.623 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:51.643 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:51.665 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:51.665 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:51.691 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:51.691 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:51.696 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:51.696 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:51.700 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:51.700+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:51.713 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:51.718 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:51.741 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:51.763 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:51.763 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:51.840 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:51.840+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:51.858 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:51.858 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:51.858 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:51.859 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:51.859 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:51.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:51.901 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:51.900+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:52.002 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:52.000+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 183.95078048299999, 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:39:52.023 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:39:52.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 183.45874731200001, 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023207728, 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 114 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564685+0000", 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564686+0000", 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6700000000000003e-07 2024-04-17T15:39:52.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564693+0000", 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6960000000000005e-06 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564704+0000", 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0494e-05 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564711+0000", 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4159999999999998e-06 2024-04-17T15:39:52.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583119+0000", 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018408292 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583250+0000", 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013100300000000001 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.583453+0000", 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020264099999999999 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587586+0000", 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041330589999999997 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587629+0000", 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2867000000000001e-05 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587768+0000", 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000138675 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.587893+0000", 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012481800000000001 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 183.45870838900001, 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.02376062, 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.035 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 115 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564724+0000", 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564725+0000", 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7000000000000003e-07 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564868+0000", 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014373500000000001 2024-04-17T15:39:52.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564882+0000", 2024-04-17T15:39:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3317e-05 2024-04-17T15:39:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564894+0000", 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.206e-05 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584163+0000", 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019269397000000001 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584411+0000", 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024771 2024-04-17T15:39:52.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.584778+0000", 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036686999999999999 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588006+0000", 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032281649999999999 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588204+0000", 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019843500000000001 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588348+0000", 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014379200000000001 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588484+0000", 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013626900000000001 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.041 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 183.45850880699999, 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.042 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:39:52.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:52.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:39:52.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 183.458463575, 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:52.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:52.054 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 60.055359359000001, 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:52.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.059 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2191 3.3b 3:dd429dad:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.976401527999997, 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024079896999999999, 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.060 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2191 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047031+0000", 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.047034+0000", 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051686+0000", 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046523550000000004 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051729+0000", 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3032999999999999e-05 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051748+0000", 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9148999999999999e-05 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.051911+0000", 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016241300000000001 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052338+0000", 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000427549 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.052584+0000", 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000245861 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.059685+0000", 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071007229999999998 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070946+0000", 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011261136 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071036+0000", 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0066000000000001e-05 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.071110+0000", 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4609000000000003e-05 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:52.065 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.925237418999998, 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:39:52.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.915032594000003, 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:39:52.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:39:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:39:52.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:39:52.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:39:52.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.076 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2214 3.2f e76/45 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head v 76'3, mlcod=72'1)", 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.734296452000002, 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022854762000000001, 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289136+0000", 2024-04-17T15:39:52.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.289138+0000", 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9829999999999999e-06 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293890+0000", 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047525909999999996 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293918+0000", 2024-04-17T15:39:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7742999999999998e-05 2024-04-17T15:39:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.293933+0000", 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4623e-05 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294082+0000", 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000149662 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.294148+0000", 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5345999999999994e-05 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311863+0000", 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017715564999999999 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.311990+0000", 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012724899999999999 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.081 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2218 3.39 3:9d9d4055:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.696108397000003, 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023480399999999998, 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.082 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2218 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327324+0000", 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.327327+0000", 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8660000000000002e-06 2024-04-17T15:39:52.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331723+0000", 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043962680000000001 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331760+0000", 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6903000000000002e-05 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331783+0000", 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3598999999999999e-05 2024-04-17T15:39:52.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.331906+0000", 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012282300000000001 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332168+0000", 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026144100000000001 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.332408+0000", 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024071499999999999 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.345166+0000", 2024-04-17T15:39:52.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012757961 2024-04-17T15:39:52.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350543+0000", 2024-04-17T15:39:52.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053770720000000001 2024-04-17T15:39:52.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350728+0000", 2024-04-17T15:39:52.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018468599999999999 2024-04-17T15:39:52.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.350804+0000", 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6066e-05 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.449484714999997, 2024-04-17T15:39:52.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:39:52.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:39:52.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:39:52.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.094 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.321628500999999, 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2655 3.3b 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.095841483000001, 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027395325000000002, 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2655 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927594+0000", 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931218+0000", 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036242679999999999 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931243+0000", 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5072e-05 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931254+0000", 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931332+0000", 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8238999999999994e-05 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931477+0000", 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014441599999999999 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931605+0000", 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128959 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.937946+0000", 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063408049999999997 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954869+0000", 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016922554999999999 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954921+0000", 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2250999999999998e-05 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954986+0000", 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4843000000000002e-05 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2689 3.2d 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.322832639000001, 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029047231999999999, 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2689 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700603+0000", 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1480000000000002e-06 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704578+0000", 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039753929999999998 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704621+0000", 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2707999999999998e-05 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704638+0000", 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7711999999999999e-05 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704752+0000", 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113894 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704982+0000", 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022947700000000001 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.705211+0000", 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022907099999999999 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.713505+0000", 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082936940000000008 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729431+0000", 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015926419000000001 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729539+0000", 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108517 2024-04-17T15:39:52.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729647+0000", 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107199 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2717 3.11 3:8a343ec0:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.927661054000001, 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022786449, 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.112 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2717 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095771+0000", 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.095773+0000", 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3460000000000001e-06 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099572+0000", 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037990350000000001 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099595+0000", 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2194000000000001e-05 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099605+0000", 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0125999999999999e-05 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099676+0000", 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1738999999999999e-05 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099813+0000", 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013640899999999999 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.099941+0000", 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012855700000000001 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.105972+0000", 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060307570000000003 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118437+0000", 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012464761 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118491+0000", 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4240000000000002e-05 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.118557+0000", 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6285000000000007e-05 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2741 3.39 3:9f26ba31:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:52.117 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.644105025000002, 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027414362000000001, 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2741 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:52.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379330+0000", 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1599999999999998e-06 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383931+0000", 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046010790000000001 2024-04-17T15:39:52.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383974+0000", 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2700000000000001e-05 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383993+0000", 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8938999999999999e-05 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384090+0000", 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7207000000000006e-05 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384097+0000", 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4309999999999999e-06 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388621+0000", 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045244179999999997 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388822+0000", 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020077199999999999 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388956+0000", 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013419500000000001 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.394950+0000", 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059936980000000004 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406560+0000", 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011610448000000001 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406665+0000", 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104949 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406741+0000", 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6365999999999994e-05 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2744 3.11 3:88cda062:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:52.123 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.608328339, 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024291046, 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2744 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415104+0000", 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.415108+0000", 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5399999999999997e-06 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.418996+0000", 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038875849999999998 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419040+0000", 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3696999999999999e-05 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419059+0000", 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.897e-05 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419168+0000", 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010971 2024-04-17T15:39:52.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419367+0000", 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019839900000000001 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.419540+0000", 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017327799999999999 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.436287+0000", 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016746727999999999 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439104+0000", 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028172520000000001 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439275+0000", 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017058500000000001 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439395+0000", 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120302 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2767 3.f 3:f0d8e033:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.343326539, 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024335816999999999, 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2767 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680108+0000", 2024-04-17T15:39:52.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7640000000000001e-06 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684062+0000", 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039540349999999998 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684097+0000", 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4517000000000002e-05 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684114+0000", 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7469000000000002e-05 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684225+0000", 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110746 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684469+0000", 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243911 2024-04-17T15:39:52.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684718+0000", 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024909800000000001 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.701761+0000", 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017042486999999999 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704218+0000", 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024576820000000001 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704315+0000", 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6482000000000002e-05 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704441+0000", 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012662599999999999 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3172 3.3f 3:fca23071:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:51.819775+0000", 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.20365749, 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028954601999999999, 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3172 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:52.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.819775+0000", 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.819775+0000", 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.819779+0000", 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.823958+0000", 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004179299 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824011+0000", 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3069999999999998e-05 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824039+0000", 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.794e-05 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824159+0000", 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120037 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824358+0000", 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000198996 2024-04-17T15:39:52.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824532+0000", 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000174112 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.835726+0000", 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011193237 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.848596+0000", 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012870032 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.848670+0000", 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4680999999999999e-05 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.848729+0000", 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8897999999999998e-05 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:52.140 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:52.142 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:52.142 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:52.140+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:52.242 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:52.241+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:52.315 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:52.316 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:52.316 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:52.339 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:52.384 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:52.384+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:52.445 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:52.445+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:52.490 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:52.490 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:52.490 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:52.490 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:52.490 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:52.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:52.556 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:52.556+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:52.647 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:52.645+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:52.747 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:52.744+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:52.765 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2198 3.3a e76/18 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.644161166000004, 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019644212000000001, 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9499999999999998e-07 2024-04-17T15:39:52.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129524+0000", 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067742130000000003 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129550+0000", 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5395999999999999e-05 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129565+0000", 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5064e-05 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129665+0000", 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100381 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129688+0000", 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3479999999999999e-05 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142322+0000", 2024-04-17T15:39:52.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012633287999999999 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142394+0000", 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2094999999999993e-05 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2205 3.17 3:ea2615d0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.572657399000001, 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017729135, 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.770 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2205 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194253+0000", 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.194257+0000", 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1470000000000001e-06 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196293+0000", 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020363099999999999 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196318+0000", 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5194999999999998e-05 2024-04-17T15:39:52.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196331+0000", 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2977e-05 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196416+0000", 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5049000000000005e-05 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196543+0000", 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012732100000000001 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.196639+0000", 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5302000000000003e-05 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.202228+0000", 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0055891480000000004 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211895+0000", 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096668139999999993 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211941+0000", 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6783999999999998e-05 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.211983+0000", 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1087999999999997e-05 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2208 3.1b 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.542709326000001, 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021369764999999999, 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2208 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224204+0000", 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6259999999999999e-06 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226060+0000", 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001855766 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226089+0000", 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8806000000000002e-05 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226103+0000", 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.483e-05 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226194+0000", 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0162999999999997e-05 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226364+0000", 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017058399999999999 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226515+0000", 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000150493 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236552+0000", 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010037107999999999 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245450+0000", 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088980710000000005 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245517+0000", 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7325999999999999e-05 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245571+0000", 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3992000000000001e-05 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2230 3.3a e76/18 3:5c7bf807:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_49:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.311619888000003, 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018369284999999999, 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455291+0000", 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.455293+0000", 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.841e-06 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460234+0000", 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049411330000000003 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460257+0000", 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3159999999999998e-05 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460268+0000", 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1056000000000001e-05 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460336+0000", 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7595000000000006e-05 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.460368+0000", 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2205000000000001e-05 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473473+0000", 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013105314 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.473660+0000", 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018698099999999999 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2240 3.1f 3:f8ad20ec:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.213409704999997, 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018806135000000002, 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.785 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2240 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553501+0000", 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.553505+0000", 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.715e-06 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556184+0000", 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026795149999999999 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556217+0000", 2024-04-17T15:39:52.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2323000000000002e-05 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556231+0000", 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4662e-05 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556329+0000", 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7598999999999998e-05 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556493+0000", 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016452900000000001 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.556649+0000", 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000155291 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.564664+0000", 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080152699999999997 2024-04-17T15:39:52.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572214+0000", 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00754991 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572260+0000", 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6526000000000001e-05 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.572307+0000", 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6795000000000002e-05 2024-04-17T15:39:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2241 3.12 3:4bb118b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.201427752999997, 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018446299999999999, 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.791 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2241 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565483+0000", 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.565485+0000", 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4430000000000002e-06 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566940+0000", 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001454718 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566971+0000", 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0550999999999999e-05 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.566996+0000", 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5537999999999998e-05 2024-04-17T15:39:52.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567065+0000", 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9153999999999996e-05 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567197+0000", 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013143200000000001 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.567298+0000", 2024-04-17T15:39:52.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101488 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.573358+0000", 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060601309999999999 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583838+0000", 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010479197000000001 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583890+0000", 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2117999999999998e-05 2024-04-17T15:39:52.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.583929+0000", 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9530000000000003e-05 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2245 3.17 3:e9b13e02:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.163689353999999, 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018296036000000002, 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.796 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2245 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603221+0000", 2024-04-17T15:39:52.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.603225+0000", 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1379999999999999e-06 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604941+0000", 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001716595 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604968+0000", 2024-04-17T15:39:52.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7137000000000001e-05 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.604980+0000", 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1704e-05 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605056+0000", 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.6265000000000002e-05 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605181+0000", 2024-04-17T15:39:52.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012499399999999999 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.605283+0000", 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102027 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.613207+0000", 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079242050000000001 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621395+0000", 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081871159999999995 2024-04-17T15:39:52.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621463+0000", 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8354000000000003e-05 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.621517+0000", 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4500999999999999e-05 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2249 3.20 e76/18 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:52.801 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.113772333999997, 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021006212999999999, 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:52.802 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653140+0000", 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-06 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658320+0000", 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051792610000000001 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.803 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658379+0000", 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8829999999999997e-05 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658398+0000", 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9193000000000001e-05 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658487+0000", 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9685999999999995e-05 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.804 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658514+0000", 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6818999999999999e-05 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674073+0000", 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015559078 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674145+0000", 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1360999999999997e-05 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.805 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2658 3.12 3:4af6eaf9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.769179158, 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022170373, 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.806 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2658 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.807 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997736+0000", 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2699999999999998e-06 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002164+0000", 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044277179999999998 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002223+0000", 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8977000000000001e-05 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.808 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002245+0000", 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-05 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002392+0000", 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014651000000000001 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002690+0000", 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029813000000000002 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002969+0000", 2024-04-17T15:39:52.809 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027968200000000001 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.014066+0000", 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011096415 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019790+0000", 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057241410000000003 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019854+0000", 2024-04-17T15:39:52.810 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3875999999999996e-05 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019902+0000", 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8093999999999997e-05 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2661 3.1f 3:fb74984d:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.694254437000001, 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019684444999999998, 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.811 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2661 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.812 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072660+0000", 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999999e-06 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075792+0000", 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003131778 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075850+0000", 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8428999999999999e-05 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.813 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075871+0000", 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076025+0000", 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000154516 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076299+0000", 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000273808 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.814 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076562+0000", 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000262718 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.087909+0000", 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011347411999999999 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092100+0000", 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041911700000000001 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.815 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092207+0000", 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010683600000000001 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092341+0000", 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133685 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2662 3.1b 3:db91a7d5:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.816 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.668999198000002, 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017881869000000002, 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2662 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.817 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097912+0000", 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.097915+0000", 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.977e-06 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101097+0000", 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003181967 2024-04-17T15:39:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101143+0000", 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6186000000000001e-05 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101162+0000", 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9639999999999998e-05 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101303+0000", 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014092900000000001 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101603+0000", 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029994499999999998 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.101842+0000", 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023849099999999999 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.113214+0000", 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011372372 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.820 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115477+0000", 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022628879999999998 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115665+0000", 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018835799999999999 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.115793+0000", 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000128116 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.821 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2684 3.6 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.171564630999999, 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024322572000000001, 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2684 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.822 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595350+0000", 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7400000000000002e-06 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598310+0000", 2024-04-17T15:39:52.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029596589999999999 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598365+0000", 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5748999999999998e-05 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598388+0000", 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2986999999999999e-05 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598582+0000", 2024-04-17T15:39:52.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000193356 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598920+0000", 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033823700000000002 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599274+0000", 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000353798 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.608957+0000", 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096830800000000002 2024-04-17T15:39:52.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619432+0000", 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010475728 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619528+0000", 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5241999999999994e-05 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619669+0000", 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000140996 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.826 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2695 3.17 3:e967dc33:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.931904183, 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021609239999999998, 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2695 2024-04-17T15:39:52.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835010+0000", 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.337e-06 2024-04-17T15:39:52.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838483+0000", 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003473313 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838529+0000", 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5291999999999999e-05 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838550+0000", 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1469000000000001e-05 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.829 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838660+0000", 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011021 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838795+0000", 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013448099999999999 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838907+0000", 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.830 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847213+0000", 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0083057990000000009 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856478+0000", 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092645430000000001 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856557+0000", 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9178000000000007e-05 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856616+0000", 2024-04-17T15:39:52.831 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8872999999999997e-05 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2734 3.1 3:80804e22:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.465219398999999, 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017781458, 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2734 2024-04-17T15:39:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301691+0000", 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.301694+0000", 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0769999999999999e-06 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.833 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304665+0000", 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029708960000000002 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304697+0000", 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1906999999999998e-05 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304709+0000", 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1793e-05 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304795+0000", 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6108999999999998e-05 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.304985+0000", 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019023900000000001 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.305095+0000", 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010995800000000001 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.314807+0000", 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0097112610000000005 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319324+0000", 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0045170770000000004 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319409+0000", 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5587999999999994e-05 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.319473+0000", 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3553000000000006e-05 2024-04-17T15:39:52.836 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3176 3.1f 3:fb16ea6e:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.90153382299999996, 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.026820266999999998, 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3176 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.837 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865379+0000", 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.137e-06 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.838 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867517+0000", 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002138184 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867546+0000", 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.87e-05 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867559+0000", 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3471e-05 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867642+0000", 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2381999999999998e-05 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867802+0000", 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016007599999999999 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867912+0000", 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110037 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.840 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.874253+0000", 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063411350000000003 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892047+0000", 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017793653 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892131+0000", 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4290999999999996e-05 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892197+0000", 2024-04-17T15:39:52.841 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6200999999999999e-05 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3197 3.2b 3:d678ab30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.58565045999999998, 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019324241999999998, 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.842 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3197 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.843 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181263+0000", 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.649e-06 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183567+0000", 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002303898 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183597+0000", 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9790000000000001e-05 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183612+0000", 2024-04-17T15:39:52.844 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.508e-05 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183692+0000", 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9857000000000005e-05 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183852+0000", 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016003400000000001 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.184004+0000", 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152065 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.845 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.190207+0000", 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062035390000000001 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200441+0000", 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010233453 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200517+0000", 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.64e-05 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.846 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200585+0000", 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7477000000000005e-05 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3199 3.12 3:4a134478:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.56112094099999998, 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021778110999999999, 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.847 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3199 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.848 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205793+0000", 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.106e-06 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207557+0000", 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017638109999999999 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.849 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207589+0000", 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2425999999999998e-05 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207605+0000", 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5508000000000001e-05 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207702+0000", 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7022999999999996e-05 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.850 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207901+0000", 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019892400000000001 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.208083+0000", 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018239299999999999 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219998+0000", 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011915113999999999 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.851 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227485+0000", 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074870020000000004 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227532+0000", 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6405e-05 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227568+0000", 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6399000000000002e-05 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.852 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3223 3.1f 3:f91ef8b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.29534310699999999, 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019879661, 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3223 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.853 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471570+0000", 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6419999999999999e-06 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473467+0000", 2024-04-17T15:39:52.854 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018962479999999999 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473502+0000", 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5184000000000001e-05 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473517+0000", 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5466000000000001e-05 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473613+0000", 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6157999999999997e-05 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.855 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473822+0000", 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020855 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473982+0000", 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016035800000000001 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.481723+0000", 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.007740958 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.856 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491344+0000", 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096207069999999992 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491395+0000", 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0855e-05 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491447+0000", 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2534999999999998e-05 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.857 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3227 3.17 3:e96f9c96:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.519357+0000", 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.247553298, 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019068313, 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3227 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.858 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.519357+0000", 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.519357+0000", 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.519360+0000", 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0029999999999999e-06 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.521180+0000", 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018195679999999999 2024-04-17T15:39:52.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.521213+0000", 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2601000000000002e-05 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.521228+0000", 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4938e-05 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.521330+0000", 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000102231 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.521529+0000", 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000198743 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.521680+0000", 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015158200000000001 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.529736+0000", 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080553610000000005 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.861 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.538333+0000", 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085977099999999997 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.538388+0000", 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4361999999999999e-05 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.538426+0000", 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8213999999999997e-05 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.862 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3241 3.30 e97/18 3:0c163819:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_186:head v 97'17, mlcod=96'15)", 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.079346664999999997, 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019499885000000002, 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:52.863 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687565+0000", 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2219999999999999e-06 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692794+0000", 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052283090000000004 2024-04-17T15:39:52.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692813+0000", 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9656999999999998e-05 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692826+0000", 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.235e-05 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692911+0000", 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5655000000000006e-05 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.865 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692932+0000", 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0845000000000001e-05 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.706998+0000", 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014065618 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.707064+0000", 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6229000000000006e-05 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.866 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.867 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:52.867 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:52.867 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:52.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:52.868 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:52.869+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:52.968 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:52.968+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:53.069 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:53.069+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:53.089 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:53.090 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:53.114 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:53.170 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:53.169+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:53.271 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:53.273+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:53.307 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:53.307 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:53.307 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:53.307 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:53.307 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:53.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:53.380 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:53.380+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:53.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:39:53.484 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:53.484+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:53.512 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:53.512 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:53.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:53.512 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:53.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2192 3.0 3:00ae7cf2:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.455698752000004, 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016712945, 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2192 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056561+0000", 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.056609+0000", 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8192000000000002e-05 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058326+0000", 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017167980000000001 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058354+0000", 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8469000000000001e-05 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058368+0000", 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3567000000000001e-05 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058448+0000", 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9943000000000004e-05 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058629+0000", 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018072100000000001 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.058790+0000", 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016184000000000001 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.069821+0000", 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011030629 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073138+0000", 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0033164679999999999 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073206+0000", 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8324999999999994e-05 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.073274+0000", 2024-04-17T15:39:53.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7992999999999998e-05 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.437496015000001, 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:39:53.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:39:53.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 61.434129513000002, 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:39:53.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 60.856929755000003, 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:39:53.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:39:53.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2646 3.8 e89/18 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head v 89'5, mlcod=76'3)", 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 24.771734032000001, 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018982274, 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740529+0000", 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9660000000000001e-06 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745823+0000", 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052946060000000003 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745886+0000", 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3251999999999997e-05 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745910+0000", 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3964e-05 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746063+0000", 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015276100000000001 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746089+0000", 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6180999999999999e-05 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759412+0000", 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013322387999999999 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759508+0000", 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6156000000000006e-05 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2663 3.0 3:00b68c77:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 24.38862761, 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020648330999999999, 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.536 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2663 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123635+0000", 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126602+0000", 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029664679999999999 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126640+0000", 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.82e-05 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126654+0000", 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4440000000000001e-05 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126752+0000", 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7879000000000003e-05 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126948+0000", 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000195983 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.127139+0000", 2024-04-17T15:39:53.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019063500000000001 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.143125+0000", 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015986416999999999 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144087+0000", 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00096153799999999995 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144196+0000", 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010974199999999999 2024-04-17T15:39:53.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144280+0000", 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3962999999999996e-05 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2669 3.4 3:2238a661:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 24.246979980999999, 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020392082999999998, 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.541 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2669 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265285+0000", 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4729999999999999e-06 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268400+0000", 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003114618 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268449+0000", 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9462999999999997e-05 2024-04-17T15:39:53.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268477+0000", 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7440000000000002e-05 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268646+0000", 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016956299999999999 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268970+0000", 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032326799999999998 2024-04-17T15:39:53.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.269256+0000", 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028625100000000001 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.278736+0000", 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094797909999999996 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285472+0000", 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067364429999999999 2024-04-17T15:39:53.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285588+0000", 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116452 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285672+0000", 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3320999999999997e-05 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.546 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2673 3.3e 3:7c55c310:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 24.147191458000002, 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020262019999999999, 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2673 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365073+0000", 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7999999999999998e-06 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368449+0000", 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003376146 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368509+0000", 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0312999999999997e-05 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368541+0000", 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1803e-05 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368708+0000", 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016662099999999999 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369022+0000", 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031360099999999999 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369297+0000", 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027513 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.378587+0000", 2024-04-17T15:39:53.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092898990000000008 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385219+0000", 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066324770000000003 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385281+0000", 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1766000000000005e-05 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385330+0000", 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9463999999999999e-05 2024-04-17T15:39:53.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2684 3.6 e89/18 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head v 89'3, mlcod=76'1)", 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.912758319000002, 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019575401999999999, 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599504+0000", 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604610+0000", 2024-04-17T15:39:53.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051064400000000003 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604655+0000", 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4943e-05 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604679+0000", 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3572999999999999e-05 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604878+0000", 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019935600000000001 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604944+0000", 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5869000000000002e-05 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.618945+0000", 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014001095999999999 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619077+0000", 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131765 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2686 3.3e 3:7c7e4e92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.874171545999999, 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024025214999999999, 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.556 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2686 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638092+0000", 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643705+0000", 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056133939999999998 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643768+0000", 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2983000000000003e-05 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643797+0000", 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8656000000000001e-05 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643979+0000", 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018241199999999999 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644258+0000", 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000278848 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644492+0000", 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023429200000000001 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.658683+0000", 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014190408 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.661860+0000", 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031772839999999998 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662022+0000", 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016153900000000001 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662113+0000", 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1656000000000005e-05 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2691 3.3e 3:7c0d9124:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:53.561 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.766774566999999, 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018482157999999999, 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2691 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745489+0000", 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.703e-06 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748279+0000", 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027905669999999999 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748329+0000", 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9353e-05 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748357+0000", 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8575999999999999e-05 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748540+0000", 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018234300000000001 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748940+0000", 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040061699999999998 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.749226+0000", 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028620000000000002 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.762456+0000", 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013229925999999999 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763785+0000", 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00132825 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763889+0000", 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104616 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763967+0000", 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8007e-05 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.566 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2696 3.31 3:8e0a861b:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.664794456999999, 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019128764999999999, 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2696 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.567 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847469+0000", 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4249999999999998e-06 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849776+0000", 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023068659999999999 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849808+0000", 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2363000000000002e-05 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849823+0000", 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5238e-05 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849950+0000", 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012710600000000001 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850228+0000", 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000277915 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850487+0000", 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025900899999999999 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.858273+0000", 2024-04-17T15:39:53.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077861379999999997 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866446+0000", 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081723060000000007 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866526+0000", 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0242999999999997e-05 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866594+0000", 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8156000000000003e-05 2024-04-17T15:39:53.571 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2731 3.25 3:a7c57b71:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.250185890000001, 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022381027000000001, 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.572 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2731 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262078+0000", 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8940000000000003e-06 2024-04-17T15:39:53.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264600+0000", 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025222119999999998 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264637+0000", 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6875000000000002e-05 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264652+0000", 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4908e-05 2024-04-17T15:39:53.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264756+0000", 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104163 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264918+0000", 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016187100000000001 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.265111+0000", 2024-04-17T15:39:53.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019296999999999999 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.275063+0000", 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099523719999999993 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284321+0000", 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092580249999999996 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284399+0000", 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7761000000000003e-05 2024-04-17T15:39:53.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284455+0000", 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5976000000000001e-05 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2749 3.31 3:8ffe76ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.042872549999998, 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019338203000000002, 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.577 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2749 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469390+0000", 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.402e-06 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471361+0000", 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019715980000000002 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471390+0000", 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9351000000000001e-05 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471405+0000", 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4346e-05 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471500+0000", 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4970999999999996e-05 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471683+0000", 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018349600000000001 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471860+0000", 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017656400000000001 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.479403+0000", 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075432010000000002 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488606+0000", 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092024670000000006 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488673+0000", 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7230999999999994e-05 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488725+0000", 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2575999999999999e-05 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3191 3.19 3:995acef5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:53.582 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.433922248, 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023716885, 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3191 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078341+0000", 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0269999999999997e-06 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081493+0000", 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031513700000000001 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081523+0000", 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.027e-05 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081539+0000", 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6379999999999999e-05 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081612+0000", 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2286000000000006e-05 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081757+0000", 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014521799999999999 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081891+0000", 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013438799999999999 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.089902+0000", 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080110170000000005 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.101929+0000", 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012026714000000001 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102002+0000", 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2972999999999994e-05 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102054+0000", 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2241999999999999e-05 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3194 3.31 3:8d6d9ccc:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.388312102, 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019551065999999999, 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3194 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123951+0000", 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6049999999999998e-06 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127418+0000", 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003467206 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127479+0000", 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1056000000000006e-05 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127509+0000", 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9796999999999999e-05 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127642+0000", 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013244400000000001 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127865+0000", 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022359999999999999 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.128070+0000", 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000204234 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.136260+0000", 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081904179999999997 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143325+0000", 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070648309999999997 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143424+0000", 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9182e-05 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143499+0000", 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4692999999999998e-05 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.593 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3207 3.37 e97/45 3:ef393eb2:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_152:head v 97'8, mlcod=96'6)", 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.300269+0000", 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.2119909120000001, 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016937401000000001, 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.300269+0000", 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.300269+0000", 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.300270+0000", 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0470000000000001e-06 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.306073+0000", 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058033859999999998 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.306104+0000", 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.044e-05 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.306118+0000", 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4168999999999999e-05 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.306215+0000", 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7442999999999995e-05 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.306241+0000", 2024-04-17T15:39:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5432999999999999e-05 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.317131+0000", 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010890182999999999 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.317206+0000", 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5300000000000001e-05 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3214 3.1a e97/18 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head v 97'17, mlcod=96'15)", 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.1350705059999999, 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019376285, 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377191+0000", 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6449999999999999e-06 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383962+0000", 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067710490000000003 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383992+0000", 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9745000000000001e-05 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384007+0000", 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5573000000000002e-05 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384103+0000", 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5511000000000001e-05 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384130+0000", 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7755000000000001e-05 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396497+0000", 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012366769999999999 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396565+0000", 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8237000000000004e-05 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3246 3.25 3:a59a480d:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.75506903400000003, 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020455952999999999, 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3246 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.602 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757194+0000", 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0000000000000001e-06 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760651+0000", 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034570289999999999 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760693+0000", 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2763999999999999e-05 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760716+0000", 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2467e-05 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760894+0000", 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000177775 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761181+0000", 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028763399999999999 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761473+0000", 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029150999999999998 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.772290+0000", 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010816698 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777506+0000", 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052165019999999996 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777587+0000", 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1228000000000002e-05 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777647+0000", 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9345999999999997e-05 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3292 3.19 3:9a68834c:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.183378454, 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018305169999999999, 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:53.607 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3292 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328885+0000", 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4939999999999999e-06 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331134+0000", 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022493460000000002 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331171+0000", 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7119000000000002e-05 2024-04-17T15:39:53.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331188+0000", 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7252e-05 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331289+0000", 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100369 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331483+0000", 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000194286 2024-04-17T15:39:53.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331665+0000", 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018169099999999999 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.341800+0000", 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0101356 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347049+0000", 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052490499999999999 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347125+0000", 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5731999999999999e-05 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347186+0000", 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1230999999999997e-05 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.612 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:53.614 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:53.614 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:53.613+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:53.714 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:53.713+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:53.796 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:53.816 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:53.817+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:53.822 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:53.822 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3343 3.16 3:6ae5c866:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_278:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.014841890999999999, 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01488856, 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "waiting for sub ops", 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3343 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.823 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810546+0000", 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.357e-06 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.824 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812931+0000", 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023841180000000002 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812960+0000", 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9677999999999999e-05 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812971+0000", 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1259e-05 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.825 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813071+0000", 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9406000000000003e-05 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813247+0000", 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000176429 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813415+0000", 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016733000000000001 2024-04-17T15:39:53.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.824091+0000", 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010676296 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 1 2024-04-17T15:39:53.827 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:53.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:53.940 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:53.940+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:53.988 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:39:53.998 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:53.999 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:54.018 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:54.016+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:54.034 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:54.035 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:54.062 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:54.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:54.063 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:54.063 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:54.063 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:54.070 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:54.070 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:54.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:54.091 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:54.091 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:54.118 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:54.119 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:54.117+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:54.152 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:54.152 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:54.199 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:54.200 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:54.220 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:54.220+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:54.229 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:54.229 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:54.239 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:54.239 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:54.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:54.351 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:54.352+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:54.421 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:54.421+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:54.458 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:54.458 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:54.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:54.522 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:54.521+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:54.622 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:54.621+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:54.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:54.723 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:54.721+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:54.819 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:54.819 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:54.824 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:54.825+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:54.840 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:54.925 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:54.924+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:54.997 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:54.997 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:55.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:55.025 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:55.024+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:55.125 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:55.124+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:55.162 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:55.162 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:55.179 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:55.226 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:55.224+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:55.315 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:55.315 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:55.327 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:55.324+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:55.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:55.428 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:55.429+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:55.467 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:55.467 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:55.485 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:55.528 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:55.528+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:55.629 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:55.628+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:55.665 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:55.665 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:55.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:39:55.730 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:55.729+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:55.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:39:55.831 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:55.828+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:55.932 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:55.932+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:56.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:39:56.022 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:39:56.067 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:56.069+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:56.133 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:56.133+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:56.163 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:56.163 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:56.178 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:39:56.233 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:56.232+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:56.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:39:56.334 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:56.333+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:56.370 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:56.370 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:56.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:39:56.435 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:56.437+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:56.456 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:56.456 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:56.479 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:56.479 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:56.501 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:56.501 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:56.524 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:56.524 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:56.536 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:56.537+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:56.546 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:56.546 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:56.571 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:56.571 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:56.587 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:56.587 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:56.594 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:56.594 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:56.598 INFO:tasks.workunit.client.0.smithi044.stdout:quota disabled for the bucket: buck_2024_03_17_15_39_46 2024-04-17T15:39:56.599 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 2Gb. 2024-04-17T15:39:56.599 INFO:tasks.workunit.client.0.smithi044.stdout:upload file successful 2024-04-17T15:39:56.599 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:39:56.599 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-04-17T15:39:56.599 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:39:56.603 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:39:56.615 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:56.616 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:56.647 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:56.649+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:56.738 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:56.736+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:56.786 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:56.786 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:39:56.786 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:39:56.786 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:39:56.786 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:56.804 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:39:56.837 INFO:tasks.workunit.client.0.smithi044.stdout:user qa_user deleted 2024-04-17T15:39:56.837 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:39:56.847 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:56.849+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:56.930 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:39:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:39:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:39:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:39:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 188.85597661400001, 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.21589735700000001, 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072652+0000", 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072656+0000", 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2169999999999996e-06 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072676+0000", 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072702+0000", 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5829999999999998e-05 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072719+0000", 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6393e-05 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072981+0000", 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026203700000000001 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for peered", 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.072995+0000", 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.383e-05 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.281971+0000", 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.20897640300000001 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282519+0000", 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000547595 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.282950+0000", 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043188200000000002 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.285173+0000", 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022228130000000001 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288359+0000", 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031853419999999999 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288479+0000", 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120066 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.288549+0000", 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0339000000000005e-05 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 188.36370493800001, 2024-04-17T15:39:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0247199, 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 116 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564923+0000", 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564925+0000", 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5030000000000001e-06 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564934+0000", 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0529999999999996e-06 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564946+0000", 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2439999999999999e-05 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564954+0000", 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1499999999999999e-06 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586419+0000", 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021464855000000001 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586610+0000", 2024-04-17T15:39:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019037200000000001 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.586821+0000", 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021183399999999999 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588160+0000", 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001338131 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589384+0000", 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001224775 2024-04-17T15:39:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589525+0000", 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140591 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589643+0000", 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118196 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 188.36365970599999, 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025330135, 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4176", 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/2149812035", 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 117 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564969+0000", 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564975+0000", 2024-04-17T15:39:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8329999999999999e-06 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564987+0000", 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1756999999999999e-05 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.564994+0000", 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5399999999999998e-06 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588530+0000", 2024-04-17T15:39:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023535482 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588659+0000", 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129426 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.588865+0000", 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020553800000000001 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.589943+0000", 2024-04-17T15:39:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001078566 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590030+0000", 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6749000000000006e-05 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590179+0000", 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000148438 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:36:48.590299+0000", 2024-04-17T15:39:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120146 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2184 3.f 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.960555490000004, 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032611818000000001, 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2184 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968073+0000", 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.968077+0000", 2024-04-17T15:39:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7190000000000001e-06 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975449+0000", 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073715780000000002 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975491+0000", 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1659999999999998e-05 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975509+0000", 2024-04-17T15:39:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8499999999999999e-05 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.975695+0000", 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186088 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976064+0000", 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036826699999999998 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976320+0000", 2024-04-17T15:39:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025634399999999998 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.993926+0000", 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017606419000000002 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000506+0000", 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065794479999999999 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000603+0000", 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7372000000000002e-05 2024-04-17T15:39:56.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000685+0000", 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1422999999999996e-05 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2196 3.d 3:b0ec29ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.830433549999995, 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024624976, 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.952 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2196 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098195+0000", 2024-04-17T15:39:56.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.098237+0000", 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2132999999999998e-05 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102870+0000", 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046327809999999999 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102908+0000", 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8654e-05 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.102927+0000", 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.844e-05 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103102+0000", 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175561 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103535+0000", 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043285900000000001 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.103967+0000", 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043222699999999998 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121333+0000", 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017365504 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122667+0000", 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013346549999999999 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122753+0000", 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5833000000000003e-05 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122820+0000", 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6328999999999995e-05 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2197 3.39 3:9d08fc83:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.820228725000007, 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027642292999999998, 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2197 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108400+0000", 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.108403+0000", 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6770000000000001e-06 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118850+0000", 2024-04-17T15:39:56.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010446867 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.118988+0000", 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013793200000000001 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119007+0000", 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8983000000000001e-05 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119413+0000", 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040565600000000001 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119652+0000", 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023943799999999999 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.119899+0000", 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024727800000000003 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.129800+0000", 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099007750000000005 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135872+0000", 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060720319999999998 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.135964+0000", 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1534999999999997e-05 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.136042+0000", 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8120000000000004e-05 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2242 3.f 3:f01d4cb0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.354680845999994, 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027358255000000001, 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2242 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573947+0000", 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.573950+0000", 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8770000000000002e-06 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582601+0000", 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086508360000000003 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582637+0000", 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5445999999999999e-05 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582655+0000", 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8073000000000001e-05 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.582827+0000", 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017205899999999999 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583288+0000", 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000461166 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.583772+0000", 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048462199999999998 2024-04-17T15:39:56.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.594962+0000", 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011189279999999999 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601055+0000", 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060936790000000003 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601229+0000", 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017317799999999999 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.601306+0000", 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7039000000000006e-05 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2254 3.11 3:8a743935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.226824632000003, 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026345134999999999, 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2254 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701804+0000", 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.701834+0000", 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0686999999999999e-05 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706599+0000", 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047647499999999999 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706638+0000", 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8773000000000003e-05 2024-04-17T15:39:56.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706657+0000", 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9023999999999999e-05 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.706855+0000", 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019834799999999999 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707187+0000", 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033184700000000002 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.707430+0000", 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024284799999999999 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727645+0000", 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020215369 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.727839+0000", 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019385499999999999 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728067+0000", 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000228228 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.728149+0000", 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1406e-05 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2655 3.3b 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.001037614000001, 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027395325000000002, 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.973 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2655 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927591+0000", 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.927594+0000", 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1130000000000001e-06 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931218+0000", 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036242679999999999 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931243+0000", 2024-04-17T15:39:56.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5072e-05 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931254+0000", 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931332+0000", 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8238999999999994e-05 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931477+0000", 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014441599999999999 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.931605+0000", 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128959 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.937946+0000", 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063408049999999997 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954869+0000", 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016922554999999999 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954921+0000", 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2250999999999998e-05 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:28.954986+0000", 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4843000000000002e-05 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2689 3.2d 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.228028770000002, 2024-04-17T15:39:56.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029047231999999999, 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2689 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700599+0000", 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.700603+0000", 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1480000000000002e-06 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704578+0000", 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039753929999999998 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704621+0000", 2024-04-17T15:39:56.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2707999999999998e-05 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704638+0000", 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7711999999999999e-05 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704752+0000", 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113894 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.704982+0000", 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022947700000000001 2024-04-17T15:39:56.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.705211+0000", 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022907099999999999 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.713505+0000", 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082936940000000008 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729431+0000", 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015926419000000001 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729539+0000", 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108517 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.729647+0000", 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000107199 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2741 3.39 3:9f26ba31:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.549301155999999, 2024-04-17T15:39:56.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027414362000000001, 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2741 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379327+0000", 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.379330+0000", 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1599999999999998e-06 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383931+0000", 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046010790000000001 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383974+0000", 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2700000000000001e-05 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.383993+0000", 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8938999999999999e-05 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384090+0000", 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7207000000000006e-05 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.384097+0000", 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4309999999999999e-06 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388621+0000", 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045244179999999997 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388822+0000", 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020077199999999999 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.388956+0000", 2024-04-17T15:39:56.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013419500000000001 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.394950+0000", 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059936980000000004 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406560+0000", 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011610448000000001 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406665+0000", 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104949 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.406741+0000", 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6365999999999994e-05 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2767 3.f 3:f0d8e033:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 26.24852267, 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024335816999999999, 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.989 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2767 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680106+0000", 2024-04-17T15:39:56.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.680108+0000", 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7640000000000001e-06 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684062+0000", 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039540349999999998 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684097+0000", 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4517000000000002e-05 2024-04-17T15:39:56.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684114+0000", 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7469000000000002e-05 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684225+0000", 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110746 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684469+0000", 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243911 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.684718+0000", 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024909800000000001 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.701761+0000", 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017042486999999999 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704218+0000", 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024576820000000001 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704315+0000", 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6482000000000002e-05 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.704441+0000", 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012662599999999999 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.994 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3172 3.3f 3:fca23071:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:51.819775+0000", 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1088536209999997, 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028954601999999999, 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3172 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.819775+0000", 2024-04-17T15:39:56.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.819775+0000", 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.819779+0000", 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3000000000000003e-06 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.823958+0000", 2024-04-17T15:39:56.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004179299 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824011+0000", 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3069999999999998e-05 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824039+0000", 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.794e-05 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824159+0000", 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120037 2024-04-17T15:39:56.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824358+0000", 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000198996 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.824532+0000", 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000174112 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.835726+0000", 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011193237 2024-04-17T15:39:56.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.848596+0000", 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012870032 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.848670+0000", 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4680999999999999e-05 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.848729+0000", 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8897999999999998e-05 2024-04-17T15:39:56.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3206 3.13 3:cb5f32d6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.283081+0000", 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.6455473400000002, 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028136044999999998, 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3206 2024-04-17T15:39:57.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.283081+0000", 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.283081+0000", 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.283083+0000", 2024-04-17T15:39:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4399999999999999e-06 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.287271+0000", 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041875740000000003 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.287302+0000", 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0895999999999997e-05 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.287318+0000", 2024-04-17T15:39:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6492999999999999e-05 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.287461+0000", 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000142352 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.287782+0000", 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032118099999999997 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.288019+0000", 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023745799999999999 2024-04-17T15:39:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.300455+0000", 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012435918000000001 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.311049+0000", 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010593698 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.311147+0000", 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7608999999999993e-05 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.311217+0000", 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0426000000000006e-05 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3248 3.14 e97/18 3:2bd8a3aa:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_193:head v 97'9, mlcod=96'7)", 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.801246+0000", 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.127381991, 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027773117, 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.005 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.801246+0000", 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.801246+0000", 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.801249+0000", 2024-04-17T15:39:57.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4499999999999998e-06 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.805917+0000", 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046678359999999999 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.805970+0000", 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3056000000000002e-05 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.805990+0000", 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0013999999999998e-05 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.806161+0000", 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171101 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.806230+0000", 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9083000000000002e-05 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.828894+0000", 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022663981 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829019+0000", 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012559600000000001 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3249 3.d 3:b2a54492:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.801554+0000", 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1270747139999999, 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032243043999999998, 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:57.009 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3249 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.801554+0000", 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.801554+0000", 2024-04-17T15:39:57.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.801557+0000", 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5899999999999999e-06 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.807492+0000", 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059352559999999999 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.807558+0000", 2024-04-17T15:39:57.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5585000000000003e-05 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.807586+0000", 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8206999999999999e-05 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.807860+0000", 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027405700000000002 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.808127+0000", 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000266378 2024-04-17T15:39:57.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.808354+0000", 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022725100000000001 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.833118+0000", 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024763998999999998 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.833574+0000", 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045578900000000001 2024-04-17T15:39:57.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.833687+0000", 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113848 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.833797+0000", 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109084 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3253 3.d 3:b00c8de2:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.853332+0000", 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.0752966710000003, 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024370917999999998, 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3253 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.015 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.853332+0000", 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.853332+0000", 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.853335+0000", 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8139999999999998e-06 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.858335+0000", 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050000469999999997 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.858399+0000", 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4041999999999994e-05 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.858418+0000", 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8919999999999998e-05 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.858588+0000", 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000169292 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.858878+0000", 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029005699999999998 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.859146+0000", 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026832800000000002 2024-04-17T15:39:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.876768+0000", 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01762205 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.877403+0000", 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00063493499999999999 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.877576+0000", 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017290799999999999 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.877702+0000", 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126525 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3291 3.15 3:a958fb66:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.317929+0000", 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.6106993530000002, 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025949439000000001, 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:57.020 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3291 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.317929+0000", 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.317929+0000", 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.317932+0000", 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.932e-06 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.321858+0000", 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039258139999999997 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.321895+0000", 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7861999999999998e-05 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.321913+0000", 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7079999999999999e-05 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.322072+0000", 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015970700000000001 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.322390+0000", 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031749000000000002 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:57.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.322625+0000", 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023545200000000001 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.331406+0000", 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087812299999999992 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.343708+0000", 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012301123000000001 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:57.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.343808+0000", 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010082900000000001 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.343878+0000", 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9919999999999995e-05 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3336 3.3f 3:fdc599fe:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_271:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.722650+0000", 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.2059783359999998, 2024-04-17T15:39:57.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025018397000000001, 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3336 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.722650+0000", 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.722650+0000", 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.722654+0000", 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.194e-06 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.726837+0000", 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004182954 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.726890+0000", 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2496e-05 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.726914+0000", 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4406e-05 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.727126+0000", 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021218100000000001 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:57.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.727592+0000", 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046540999999999998 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.728026+0000", 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043484600000000002 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.743173+0000", 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015146255000000001 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.747361+0000", 2024-04-17T15:39:57.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041881770000000004 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.747538+0000", 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017692900000000001 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.747668+0000", 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013054900000000001 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3361 3.2d 3:b4301b30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_296:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.019748+0000", 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.9088803269999999, 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028746603999999999, 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3361 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.019748+0000", 2024-04-17T15:39:57.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.019748+0000", 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.019752+0000", 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0960000000000003e-06 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.024435+0000", 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004682917 2024-04-17T15:39:57.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.024490+0000", 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5025000000000003e-05 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.024535+0000", 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5170000000000003e-05 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.024715+0000", 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017965799999999999 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.024735+0000", 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9956999999999999e-05 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.031836+0000", 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071016550000000001 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.032048+0000", 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021134499999999999 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.032373+0000", 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032556700000000002 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.043691+0000", 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011318059 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.048167+0000", 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044755239999999998 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.048371+0000", 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204425 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.048495+0000", 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123206 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:39:57.036 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:39:57.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:39:57.038 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:57.036+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:57.138 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:57.136+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:57.162 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:57.162 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:57.162 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:57.162 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:57.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:39:57.239 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:57.241+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:57.340 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:57.340+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:57.343 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:57.343 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:57.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:39:57.364 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:39:57.442 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:57.441+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:57.482 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:57.482 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2198 3.3a e76/18 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head v 76'1, mlcod=0'0)", 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.360812545000002, 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019644212000000001, 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9499999999999998e-07 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129524+0000", 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067742130000000003 2024-04-17T15:39:57.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129550+0000", 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5395999999999999e-05 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129565+0000", 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5064e-05 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129665+0000", 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100381 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129688+0000", 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3479999999999999e-05 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142322+0000", 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012633287999999999 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142394+0000", 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2094999999999993e-05 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2208 3.1b 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.259360705000006, 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021369764999999999, 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2208 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:57.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224204+0000", 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6259999999999999e-06 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226060+0000", 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001855766 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226089+0000", 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8806000000000002e-05 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226103+0000", 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.483e-05 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226194+0000", 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0162999999999997e-05 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226364+0000", 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017058399999999999 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226515+0000", 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000150493 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236552+0000", 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010037107999999999 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245450+0000", 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088980710000000005 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245517+0000", 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7325999999999999e-05 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245571+0000", 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3992000000000001e-05 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2249 3.20 e76/18 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 64.830423713000002, 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021006212999999999, 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653140+0000", 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-06 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658320+0000", 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051792610000000001 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658379+0000", 2024-04-17T15:39:57.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8829999999999997e-05 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658398+0000", 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9193000000000001e-05 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658487+0000", 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9685999999999995e-05 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658514+0000", 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6818999999999999e-05 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674073+0000", 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015559078 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674145+0000", 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1360999999999997e-05 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2658 3.12 3:4af6eaf9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.485830536999998, 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022170373, 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2658 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997736+0000", 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2699999999999998e-06 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002164+0000", 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044277179999999998 2024-04-17T15:39:57.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002223+0000", 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8977000000000001e-05 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002245+0000", 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-05 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002392+0000", 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014651000000000001 2024-04-17T15:39:57.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002690+0000", 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029813000000000002 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002969+0000", 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027968200000000001 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.014066+0000", 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011096415 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019790+0000", 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057241410000000003 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019854+0000", 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3875999999999996e-05 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019902+0000", 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8093999999999997e-05 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.500 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2661 3.1f 3:fb74984d:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.410905816, 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019684444999999998, 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2661 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072660+0000", 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999999e-06 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075792+0000", 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003131778 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075850+0000", 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8428999999999999e-05 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075871+0000", 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076025+0000", 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000154516 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076299+0000", 2024-04-17T15:39:57.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000273808 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076562+0000", 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000262718 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.087909+0000", 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011347411999999999 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092100+0000", 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041911700000000001 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092207+0000", 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010683600000000001 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092341+0000", 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133685 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2684 3.6 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:57.505 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.888216010000001, 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024322572000000001, 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2684 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:57.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595350+0000", 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7400000000000002e-06 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598310+0000", 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029596589999999999 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598365+0000", 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5748999999999998e-05 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598388+0000", 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2986999999999999e-05 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598582+0000", 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000193356 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598920+0000", 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033823700000000002 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599274+0000", 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000353798 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.608957+0000", 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096830800000000002 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619432+0000", 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010475728 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619528+0000", 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5241999999999994e-05 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619669+0000", 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000140996 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2695 3.17 3:e967dc33:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.648555561999999, 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021609239999999998, 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2695 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835010+0000", 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.337e-06 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838483+0000", 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003473313 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838529+0000", 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5291999999999999e-05 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838550+0000", 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1469000000000001e-05 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838660+0000", 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011021 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838795+0000", 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013448099999999999 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838907+0000", 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847213+0000", 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0083057990000000009 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856478+0000", 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092645430000000001 2024-04-17T15:39:57.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856557+0000", 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9178000000000007e-05 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856616+0000", 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8872999999999997e-05 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3176 3.1f 3:fb16ea6e:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.515 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.6181852020000003, 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.026820266999999998, 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3176 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865379+0000", 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.137e-06 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867517+0000", 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002138184 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867546+0000", 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.87e-05 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867559+0000", 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3471e-05 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867642+0000", 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2381999999999998e-05 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867802+0000", 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016007599999999999 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867912+0000", 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110037 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.874253+0000", 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063411350000000003 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892047+0000", 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017793653 2024-04-17T15:39:57.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892131+0000", 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4290999999999996e-05 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892197+0000", 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6200999999999999e-05 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3197 3.2b 3:d678ab30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.520 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.3023018390000001, 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019324241999999998, 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3197 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181263+0000", 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.649e-06 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183567+0000", 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002303898 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183597+0000", 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9790000000000001e-05 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183612+0000", 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.508e-05 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183692+0000", 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9857000000000005e-05 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183852+0000", 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016003400000000001 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.184004+0000", 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152065 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.190207+0000", 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062035390000000001 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200441+0000", 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010233453 2024-04-17T15:39:57.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200517+0000", 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.64e-05 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200585+0000", 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7477000000000005e-05 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.525 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3199 3.12 3:4a134478:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.2777723200000004, 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021778110999999999, 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3199 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:39:57.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205793+0000", 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.106e-06 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207557+0000", 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017638109999999999 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207589+0000", 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2425999999999998e-05 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207605+0000", 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5508000000000001e-05 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207702+0000", 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7022999999999996e-05 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207901+0000", 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019892400000000001 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.208083+0000", 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018239299999999999 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219998+0000", 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011915113999999999 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227485+0000", 2024-04-17T15:39:57.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074870020000000004 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227532+0000", 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6405e-05 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227568+0000", 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6399000000000002e-05 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3223 3.1f 3:f91ef8b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.0119944859999999, 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019879661, 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3223 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471570+0000", 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6419999999999999e-06 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473467+0000", 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018962479999999999 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473502+0000", 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5184000000000001e-05 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473517+0000", 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5466000000000001e-05 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473613+0000", 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6157999999999997e-05 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473822+0000", 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020855 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473982+0000", 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016035800000000001 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.481723+0000", 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.007740958 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491344+0000", 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096207069999999992 2024-04-17T15:39:57.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491395+0000", 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0855e-05 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491447+0000", 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2534999999999998e-05 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.535 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3241 3.30 e97/18 3:0c163819:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_186:head v 97'17, mlcod=96'15)", 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.7959980440000001, 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019499885000000002, 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:39:57.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687565+0000", 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2219999999999999e-06 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692794+0000", 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052283090000000004 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692813+0000", 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9656999999999998e-05 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692826+0000", 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.235e-05 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692911+0000", 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5655000000000006e-05 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692932+0000", 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0845000000000001e-05 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.706998+0000", 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014065618 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.707064+0000", 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6229000000000006e-05 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3256 3.3d 3:bd900344:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.896008+0000", 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.5875542979999997, 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019134215, 2024-04-17T15:39:57.539 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3256 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.896008+0000", 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.896008+0000", 2024-04-17T15:39:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.896012+0000", 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9829999999999998e-06 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.900654+0000", 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046419599999999997 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.900701+0000", 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7443e-05 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.900721+0000", 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9720000000000001e-05 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.900843+0000", 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012214699999999999 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.901069+0000", 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022590300000000001 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:57.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.901267+0000", 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019767799999999999 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.909273+0000", 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080063770000000003 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.914915+0000", 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056418400000000004 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.915048+0000", 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132645 2024-04-17T15:39:57.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.915142+0000", 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4518999999999994e-05 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3263 3.2b 3:d54106b9:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.999025+0000", 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.4845376349999997, 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019596654000000002, 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3263 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.999025+0000", 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.999025+0000", 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.999027+0000", 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5799999999999999e-06 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001257+0000", 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022298869999999998 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001288+0000", 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1306999999999997e-05 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001302+0000", 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3837e-05 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001389+0000", 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6774000000000006e-05 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001527+0000", 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013835599999999999 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001679+0000", 2024-04-17T15:39:57.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000151955 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011891+0000", 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010211892 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.018513+0000", 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066218309999999999 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.018565+0000", 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1768000000000003e-05 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.018621+0000", 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6467e-05 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3300 3.3a e97/18 3:5ca58b68:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_245:head v 97'8, mlcod=97'6)", 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.426462+0000", 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.0571005060000003, 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019516374, 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.426462+0000", 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.426462+0000", 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.426464+0000", 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-06 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430353+0000", 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003889666 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430395+0000", 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1527999999999999e-05 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430413+0000", 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7611000000000001e-05 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430520+0000", 2024-04-17T15:39:57.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106988 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430567+0000", 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7534000000000003e-05 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.445897+0000", 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015329712000000001 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.445978+0000", 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1242999999999994e-05 2024-04-17T15:39:57.552 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3331 3.32 3:4c2afbd5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_266:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.668616+0000", 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.8149460409999998, 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019198695000000002, 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3331 2024-04-17T15:39:57.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.668616+0000", 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.668616+0000", 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.668619+0000", 2024-04-17T15:39:57.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2100000000000002e-06 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670389+0000", 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017696299999999999 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670413+0000", 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4392e-05 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670427+0000", 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3658e-05 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670525+0000", 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7577000000000004e-05 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670743+0000", 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000218299 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670921+0000", 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000177858 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.677222+0000", 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006301058 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.687670+0000", 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010448107 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.687750+0000", 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0374e-05 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.687815+0000", 2024-04-17T15:39:57.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4531999999999998e-05 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3341 3.12 3:4a0d0169:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_276:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.786710+0000", 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.6968524899999999, 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022044162999999999, 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.558 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3341 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.786710+0000", 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.786710+0000", 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.786712+0000", 2024-04-17T15:39:57.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.818e-06 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.789842+0000", 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031290570000000002 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.789873+0000", 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1010999999999998e-05 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.789884+0000", 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1273e-05 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.789959+0000", 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5063999999999998e-05 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.790121+0000", 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016213999999999999 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.790283+0000", 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016157500000000001 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.795909+0000", 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056265849999999999 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.808630+0000", 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012720728000000001 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.808704+0000", 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4048999999999995e-05 2024-04-17T15:39:57.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.808754+0000", 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9863e-05 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3349 3.17 3:e8365c51:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_284:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.881620+0000", 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.601941719, 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.031626392000000003, 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3349 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.881620+0000", 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.881620+0000", 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.881623+0000", 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.74e-06 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883341+0000", 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00171828 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883368+0000", 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6409000000000001e-05 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883382+0000", 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4268e-05 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883464+0000", 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1531000000000003e-05 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883594+0000", 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013065 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883697+0000", 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010310399999999999 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.890101+0000", 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064032639999999997 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913143+0000", 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023042615999999998 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913195+0000", 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1555999999999999e-05 2024-04-17T15:39:57.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913247+0000", 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1974000000000001e-05 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3351 3.17 3:ea9731d6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_286:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.902378+0000", 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.58118465, 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.030561992, 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3351 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.902378+0000", 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.902378+0000", 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.902380+0000", 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9239999999999999e-06 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905057+0000", 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026761689999999999 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905077+0000", 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0358999999999999e-05 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905092+0000", 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4637999999999999e-05 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905226+0000", 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013402299999999999 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905335+0000", 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010968600000000001 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905449+0000", 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011319600000000001 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.920266+0000", 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014817568 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.932819+0000", 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012552472 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.932883+0000", 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4362999999999993e-05 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.932940+0000", 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6594000000000001e-05 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3352 3.17 3:e98004da:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_287:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.913817+0000", 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.5697455300000001, 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021242748999999998, 2024-04-17T15:39:57.573 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3352 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913817+0000", 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913817+0000", 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913819+0000", 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.492e-06 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.915699+0000", 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001879538 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.915717+0000", 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8442999999999999e-05 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.915727+0000", 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4599999999999992e-06 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.915856+0000", 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012975899999999999 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.916020+0000", 2024-04-17T15:39:57.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016348999999999999 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.916177+0000", 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015742999999999999 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.925352+0000", 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091744429999999991 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.934929+0000", 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095777959999999995 2024-04-17T15:39:57.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.935007+0000", 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7695999999999996e-05 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.935059+0000", 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2201999999999999e-05 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:57.578 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:57.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:39:57.580 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:57.581+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:57.680 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:57.681+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:57.697 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:57.697 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:57.697 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:57.697 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:57.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:39:57.781 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:39:57.780+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:39:57.831 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:57.832 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:57.832 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:57.832 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:57.832 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:57.848 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:39:57.882 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:57.881+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:57.982 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:57.980+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:58.011 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.936855446999999, 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:58.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:39:58.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.933488944999993, 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:39:58.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.356289187000002, 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:39:58.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2646 3.8 e89/18 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head v 89'5, mlcod=76'3)", 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.271093464, 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018982274, 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.027 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740529+0000", 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9660000000000001e-06 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745823+0000", 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052946060000000003 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745886+0000", 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3251999999999997e-05 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745910+0000", 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3964e-05 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746063+0000", 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015276100000000001 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746089+0000", 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6180999999999999e-05 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759412+0000", 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013322387999999999 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759508+0000", 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6156000000000006e-05 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2663 3.0 3:00b68c77:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.887987041999999, 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020648330999999999, 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.031 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2663 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123635+0000", 2024-04-17T15:39:58.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126602+0000", 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029664679999999999 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126640+0000", 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.82e-05 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126654+0000", 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4440000000000001e-05 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126752+0000", 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7879000000000003e-05 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126948+0000", 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000195983 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.127139+0000", 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019063500000000001 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.143125+0000", 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015986416999999999 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144087+0000", 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00096153799999999995 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144196+0000", 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010974199999999999 2024-04-17T15:39:58.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144280+0000", 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3962999999999996e-05 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2669 3.4 3:2238a661:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.746339413000001, 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020392082999999998, 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.036 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2669 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265285+0000", 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4729999999999999e-06 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268400+0000", 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003114618 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268449+0000", 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9462999999999997e-05 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268477+0000", 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7440000000000002e-05 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268646+0000", 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016956299999999999 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.039 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268970+0000", 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032326799999999998 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.269256+0000", 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028625100000000001 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.278736+0000", 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094797909999999996 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285472+0000", 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067364429999999999 2024-04-17T15:39:58.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285588+0000", 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116452 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285672+0000", 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3320999999999997e-05 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2673 3.3e 3:7c55c310:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:58.041 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.64655089, 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020262019999999999, 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2673 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:58.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365073+0000", 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7999999999999998e-06 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368449+0000", 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003376146 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368509+0000", 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0312999999999997e-05 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368541+0000", 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1803e-05 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368708+0000", 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016662099999999999 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369022+0000", 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031360099999999999 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369297+0000", 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027513 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.378587+0000", 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092898990000000008 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385219+0000", 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066324770000000003 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385281+0000", 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1766000000000005e-05 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385330+0000", 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9463999999999999e-05 2024-04-17T15:39:58.046 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2684 3.6 e89/18 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head v 89'3, mlcod=76'1)", 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.412117751, 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019575401999999999, 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:58.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599504+0000", 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604610+0000", 2024-04-17T15:39:58.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051064400000000003 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604655+0000", 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4943e-05 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604679+0000", 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3572999999999999e-05 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.049 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604878+0000", 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019935600000000001 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604944+0000", 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5869000000000002e-05 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.618945+0000", 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014001095999999999 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619077+0000", 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131765 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2686 3.3e 3:7c7e4e92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.373530978000002, 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024025214999999999, 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.051 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2686 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638092+0000", 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643705+0000", 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056133939999999998 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643768+0000", 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2983000000000003e-05 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643797+0000", 2024-04-17T15:39:58.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8656000000000001e-05 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643979+0000", 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018241199999999999 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644258+0000", 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000278848 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644492+0000", 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023429200000000001 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.658683+0000", 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014190408 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.661860+0000", 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031772839999999998 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662022+0000", 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016153900000000001 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662113+0000", 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1656000000000005e-05 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2691 3.3e 3:7c0d9124:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.056 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.266133999000001, 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018482157999999999, 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2691 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:58.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745489+0000", 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.703e-06 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748279+0000", 2024-04-17T15:39:58.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027905669999999999 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748329+0000", 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9353e-05 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748357+0000", 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8575999999999999e-05 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748540+0000", 2024-04-17T15:39:58.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018234300000000001 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748940+0000", 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040061699999999998 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.749226+0000", 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028620000000000002 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.762456+0000", 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013229925999999999 2024-04-17T15:39:58.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763785+0000", 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00132825 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763889+0000", 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104616 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763967+0000", 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8007e-05 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.061 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2696 3.31 3:8e0a861b:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.164153889000001, 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019128764999999999, 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2696 2024-04-17T15:39:58.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847469+0000", 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4249999999999998e-06 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849776+0000", 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023068659999999999 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849808+0000", 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2363000000000002e-05 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849823+0000", 2024-04-17T15:39:58.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5238e-05 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849950+0000", 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012710600000000001 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850228+0000", 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000277915 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850487+0000", 2024-04-17T15:39:58.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025900899999999999 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.858273+0000", 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077861379999999997 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866446+0000", 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081723060000000007 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866526+0000", 2024-04-17T15:39:58.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0242999999999997e-05 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866594+0000", 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8156000000000003e-05 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2731 3.25 3:a7c57b71:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.749545321999999, 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022381027000000001, 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2731 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:39:58.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262078+0000", 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8940000000000003e-06 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264600+0000", 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025222119999999998 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264637+0000", 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6875000000000002e-05 2024-04-17T15:39:58.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264652+0000", 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4908e-05 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264756+0000", 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104163 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264918+0000", 2024-04-17T15:39:58.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016187100000000001 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.265111+0000", 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019296999999999999 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.275063+0000", 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099523719999999993 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284321+0000", 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092580249999999996 2024-04-17T15:39:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284399+0000", 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7761000000000003e-05 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284455+0000", 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5976000000000001e-05 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.072 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2749 3.31 3:8ffe76ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.542231982000001, 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019338203000000002, 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2749 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469390+0000", 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.402e-06 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471361+0000", 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019715980000000002 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471390+0000", 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9351000000000001e-05 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471405+0000", 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4346e-05 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471500+0000", 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4970999999999996e-05 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471683+0000", 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018349600000000001 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471860+0000", 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017656400000000001 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.479403+0000", 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075432010000000002 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488606+0000", 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092024670000000006 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488673+0000", 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7230999999999994e-05 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488725+0000", 2024-04-17T15:39:58.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2575999999999999e-05 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3191 3.19 3:995acef5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.9332816800000003, 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023716885, 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.078 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3191 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078341+0000", 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0269999999999997e-06 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081493+0000", 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031513700000000001 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081523+0000", 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.027e-05 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081539+0000", 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6379999999999999e-05 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081612+0000", 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2286000000000006e-05 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081757+0000", 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014521799999999999 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081891+0000", 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013438799999999999 2024-04-17T15:39:58.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.089902+0000", 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080110170000000005 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.101929+0000", 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012026714000000001 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102002+0000", 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2972999999999994e-05 2024-04-17T15:39:58.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102054+0000", 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2241999999999999e-05 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3194 3.31 3:8d6d9ccc:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.8876715339999999, 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019551065999999999, 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.083 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3194 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123951+0000", 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6049999999999998e-06 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127418+0000", 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003467206 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127479+0000", 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1056000000000006e-05 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127509+0000", 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9796999999999999e-05 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127642+0000", 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013244400000000001 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127865+0000", 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022359999999999999 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.128070+0000", 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000204234 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.136260+0000", 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081904179999999997 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143325+0000", 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070648309999999997 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143424+0000", 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9182e-05 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143499+0000", 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4692999999999998e-05 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3214 3.1a e97/18 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head v 97'17, mlcod=96'15)", 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.6344299380000002, 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019376285, 2024-04-17T15:39:58.088 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377191+0000", 2024-04-17T15:39:58.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6449999999999999e-06 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383962+0000", 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067710490000000003 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383992+0000", 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9745000000000001e-05 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384007+0000", 2024-04-17T15:39:58.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5573000000000002e-05 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384103+0000", 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5511000000000001e-05 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384130+0000", 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7755000000000001e-05 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396497+0000", 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012366769999999999 2024-04-17T15:39:58.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396565+0000", 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8237000000000004e-05 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3246 3.25 3:a59a480d:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.2544284660000002, 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020455952999999999, 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.092 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3246 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757194+0000", 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0000000000000001e-06 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760651+0000", 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034570289999999999 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760693+0000", 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2763999999999999e-05 2024-04-17T15:39:58.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760716+0000", 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2467e-05 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760894+0000", 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000177775 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761181+0000", 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028763399999999999 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761473+0000", 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029150999999999998 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.772290+0000", 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010816698 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777506+0000", 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052165019999999996 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777587+0000", 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1228000000000002e-05 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777647+0000", 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9345999999999997e-05 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.097 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3292 3.19 3:9a68834c:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.682737886, 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018305169999999999, 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3292 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328885+0000", 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4939999999999999e-06 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331134+0000", 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022493460000000002 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331171+0000", 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7119000000000002e-05 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331188+0000", 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7252e-05 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331289+0000", 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100369 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331483+0000", 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000194286 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331665+0000", 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018169099999999999 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.341800+0000", 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0101356 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347049+0000", 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052490499999999999 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347125+0000", 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5731999999999999e-05 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347186+0000", 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1230999999999997e-05 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3327 3.25 3:a5e282f6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_262:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.3853561890000003, 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018341494, 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.103 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3327 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626267+0000", 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:39:58.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628501+0000", 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339870000000002 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628532+0000", 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1730000000000003e-05 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628545+0000", 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3176999999999999e-05 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628614+0000", 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8384000000000001e-05 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628732+0000", 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117927 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628864+0000", 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013266600000000001 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.641855+0000", 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012990431 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644472+0000", 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026173619999999998 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644543+0000", 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1144999999999997e-05 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644604+0000", 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1068999999999994e-05 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3355 3.4 3:2266acf0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.062078756, 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021132874999999999, 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.108 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3355 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949543+0000", 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8720000000000002e-06 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951012+0000", 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014686160000000001 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951044+0000", 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1951e-05 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951056+0000", 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2502e-05 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951139+0000", 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3190999999999997e-05 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951312+0000", 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017254799999999999 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:39:58.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951475+0000", 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016339800000000001 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.956582+0000", 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051069840000000002 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970578+0000", 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013995914999999999 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970625+0000", 2024-04-17T15:39:58.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6487999999999999e-05 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970673+0000", 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8409999999999999e-05 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.113 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:58.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:39:58.115 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:39:58.113+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:39:58.215 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:58.217+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:58.284 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:58.284 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:58.284 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:58.284 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:58.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:39:58.316 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:58.317+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:58.413 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:58.413 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:58.414 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:39:58.414 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:39:58.414 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:58.417 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:58.416+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:58.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:39:58.518 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:58.516+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:58.582 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:58.582 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.294687920000001, 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.583 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:39:58.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.164228534000003, 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:39:58.588 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:39:58.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.069590202000001, 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.594 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:39:58.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:39:58.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 66.050133763000005, 2024-04-17T15:39:58.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 65.863638551999998, 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:39:58.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2655 3.3b e89/18 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head v 89'7, mlcod=76'5)", 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.649128248, 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022625060999999998, 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.610 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:39:58.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5600000000000004e-07 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.937998+0000", 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059469739999999998 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938039+0000", 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0113e-05 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938062+0000", 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3807000000000001e-05 2024-04-17T15:39:58.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938236+0000", 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403500000000001 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938303+0000", 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6190000000000002e-05 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954503+0000", 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016200763999999999 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954676+0000", 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017232200000000001 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2656 3.16 3:6ad2ad56:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.629944945999998, 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022969676000000001, 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.614 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2656 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:39:58.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951237+0000", 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.264e-06 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956406+0000", 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051685460000000004 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956439+0000", 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2959000000000001e-05 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956456+0000", 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7217000000000001e-05 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956609+0000", 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015330899999999999 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956880+0000", 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027084100000000002 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.957130+0000", 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025006900000000001 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.966230+0000", 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009099434 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974022+0000", 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077925549999999996 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974126+0000", 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103706 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974204+0000", 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7775999999999995e-05 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2664 3.21 3:84c31c70:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 29.433013037999999, 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019486428, 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2664 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.620 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148169+0000", 2024-04-17T15:39:58.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0070000000000002e-06 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151347+0000", 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031786599999999998 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151397+0000", 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9317000000000002e-05 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151417+0000", 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.012e-05 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151540+0000", 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012354900000000001 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151802+0000", 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026111400000000001 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151955+0000", 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015302 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.159770+0000", 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078157350000000007 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167530+0000", 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077592989999999999 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167595+0000", 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5320999999999993e-05 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167652+0000", 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7286e-05 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2689 3.2d e89/18 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head v 89'5, mlcod=77'3)", 2024-04-17T15:39:58.625 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.875547623999999, 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023548848000000001, 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:39:58.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705634+0000", 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0929999999999999e-06 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711102+0000", 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054679810000000002 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711146+0000", 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3940000000000003e-05 2024-04-17T15:39:58.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711170+0000", 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4283000000000001e-05 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711304+0000", 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013349999999999999 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711341+0000", 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6803e-05 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729020+0000", 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017679553000000001 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729180+0000", 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015969500000000001 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3161 3.2e 3:77c0c5b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:39:58.629 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.8812754140000001, 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018746992000000001, 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3161 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699907+0000", 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3390000000000001e-06 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702202+0000", 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022948840000000001 2024-04-17T15:39:58.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702230+0000", 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8513999999999998e-05 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702241+0000", 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1083999999999999e-05 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702340+0000", 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8443000000000006e-05 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702543+0000", 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020311 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702723+0000", 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000180235 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.714838+0000", 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012114583 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718506+0000", 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036683530000000001 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718587+0000", 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1254999999999994e-05 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718650+0000", 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3192000000000001e-05 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.634 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3174 3.21 3:84a9f215:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.7392982379999999, 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018361252000000002, 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3174 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.635 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841884+0000", 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2490000000000001e-06 2024-04-17T15:39:58.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844049+0000", 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021650620000000001 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844073+0000", 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3893999999999999e-05 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844085+0000", 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1963e-05 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844179+0000", 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4195000000000002e-05 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844385+0000", 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206331 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844583+0000", 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019758899999999999 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.857179+0000", 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012595705 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860113+0000", 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029346950000000002 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860184+0000", 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0852999999999994e-05 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860242+0000", 2024-04-17T15:39:58.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7716000000000001e-05 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3188 3.2f 3:f4860977:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.5690023049999997, 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019398723999999999, 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.640 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3188 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012181+0000", 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4129999999999999e-06 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014461+0000", 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022799539999999998 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014506+0000", 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5529999999999999e-05 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014526+0000", 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9542999999999999e-05 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014635+0000", 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010869700000000001 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014813+0000", 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178128 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.015010+0000", 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000197111 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.023029+0000", 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080189619999999993 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031512+0000", 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084828179999999996 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031549+0000", 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6944999999999999e-05 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031575+0000", 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6622999999999999e-05 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.645 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3195 3.16 3:6892fdae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.4343280649999999, 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021725749999999999, 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3195 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146855+0000", 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8800000000000001e-06 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150499+0000", 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036446019999999998 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150530+0000", 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1099999999999997e-05 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150543+0000", 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2847000000000001e-05 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150617+0000", 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4294000000000004e-05 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150741+0000", 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123731 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150854+0000", 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.157302+0000", 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064475870000000003 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168431+0000", 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011129847 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168516+0000", 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4331000000000003e-05 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168577+0000", 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0785999999999997e-05 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3215 3.16 3:69d29e25:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.1993140139999996, 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020347908000000001, 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3215 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381869+0000", 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8070000000000001e-06 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384172+0000", 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002302957 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384202+0000", 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0704000000000003e-05 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384216+0000", 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3376e-05 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384299+0000", 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3622000000000007e-05 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384481+0000", 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182086 2024-04-17T15:39:58.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384646+0000", 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016434199999999999 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396642+0000", 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011996079 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402122+0000", 2024-04-17T15:39:58.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054798360000000001 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402169+0000", 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7664000000000003e-05 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402213+0000", 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3435e-05 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3232 3.2e 3:77f4f650:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 6.0045014700000001, 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020894309, 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3232 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.657 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576681+0000", 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3060000000000002e-06 2024-04-17T15:39:58.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578598+0000", 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001917799 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578637+0000", 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8884000000000002e-05 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578654+0000", 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6578999999999998e-05 2024-04-17T15:39:58.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578752+0000", 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8412000000000006e-05 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578884+0000", 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131359 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.579029+0000", 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014510799999999999 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.584890+0000", 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058607679999999997 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597433+0000", 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012543642000000001 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597513+0000", 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9538999999999999e-05 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597572+0000", 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8913000000000003e-05 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3243 3.21 3:86efebb2:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.8723823209999999, 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018171970999999999, 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.662 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3243 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708799+0000", 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711223+0000", 2024-04-17T15:39:58.664 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024239690000000002 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711252+0000", 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9176999999999999e-05 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711263+0000", 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1269e-05 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711334+0000", 2024-04-17T15:39:58.665 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0891999999999998e-05 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711467+0000", 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133306 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711580+0000", 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112734 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.666 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.719664+0000", 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080840129999999993 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726888+0000", 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072236660000000001 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726932+0000", 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4709000000000002e-05 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.667 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726968+0000", 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6109000000000003e-05 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3245 3.24 3:26e56b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.8406936119999999, 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020901084, 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.668 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3245 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740501+0000", 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5823000000000001e-05 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742689+0000", 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021879009999999999 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742737+0000", 2024-04-17T15:39:58.670 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8519000000000001e-05 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742759+0000", 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.173e-05 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742848+0000", 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9116000000000005e-05 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743031+0000", 2024-04-17T15:39:58.671 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018237599999999999 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743192+0000", 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000161461 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.749847+0000", 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066546610000000001 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.672 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761259+0000", 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011411813999999999 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761330+0000", 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1481000000000002e-05 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761386+0000", 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6202000000000002e-05 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.673 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3254 3.21 3:86770de1:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.7171357660000002, 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022547540000000001, 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3254 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.674 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864046+0000", 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.004e-06 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.675 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865763+0000", 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017173360000000001 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865809+0000", 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5519999999999998e-05 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865827+0000", 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7716000000000001e-05 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.676 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865933+0000", 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010629 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866093+0000", 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000159946 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866220+0000", 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127164 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.677 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.873221+0000", 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070009570000000004 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886373+0000", 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013151891000000001 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886502+0000", 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012948500000000001 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886591+0000", 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8231000000000003e-05 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3264 3.24 3:26cd557b:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.5714481510000002, 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020478857, 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.679 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3264 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009734+0000", 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011450+0000", 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017157369999999999 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011475+0000", 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5151999999999999e-05 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011488+0000", 2024-04-17T15:39:58.681 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3740000000000001e-05 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011581+0000", 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.255e-05 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011705+0000", 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012390900000000001 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011811+0000", 2024-04-17T15:39:58.682 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106111 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.019611+0000", 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077997359999999998 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030126+0000", 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010514977999999999 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030173+0000", 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7451999999999999e-05 2024-04-17T15:39:58.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030210+0000", 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6294000000000002e-05 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3343 3.16 3:6ae5c866:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_278:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.77063478, 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019911570999999999, 2024-04-17T15:39:58.684 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3343 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810546+0000", 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.357e-06 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812931+0000", 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023841180000000002 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812960+0000", 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9677999999999999e-05 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812971+0000", 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1259e-05 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813071+0000", 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9406000000000003e-05 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813247+0000", 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000176429 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813415+0000", 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016733000000000001 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.824091+0000", 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010676296 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830354+0000", 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006263294 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830402+0000", 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8155999999999998e-05 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830456+0000", 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3248000000000002e-05 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:39:58.689 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:39:58.690 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:58.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:39:58.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:39:58.692 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:58.688+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:58.791 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:39:58.792+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:39:58.857 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:39:58.857 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:39:58.857 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:39:58.857 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:39:58.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:39:58.890 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:39:58.890 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:39:58.892 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:58.893+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:58.906 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:39:58.906 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:39:58.922 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:39:58.922 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:39:58.939 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:39:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:39:58.960 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:39:58.960 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:39:58.981 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:39:58.981 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:39:58.993 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:39:58.993+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:39:58.997 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:58.997 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:59.003 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:39:59.003 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:39:59.011 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:39:59.025 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:39:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:39:59.093 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:59.092+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:59.136 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:59.136 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:59.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:39:59.195 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:59.197+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:59.288 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:59.288 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:59.295 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:59.296+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:59.302 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:39:59.396 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:39:59.396+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:39:59.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:39:59.462 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:59.463 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:59.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:39:59.523 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:59.525+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:59.596 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:59.596 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:59.597 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:59.597+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:59.611 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:39:59.698 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:39:59.696+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:39:59.769 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:59.769 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:59.782 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:39:59.827 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:39:59.829+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:39:59.897 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:39:59.897 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:39:59.900 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:39:59.901+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:39:59.911 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:40:00.001 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:00.000+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:00.076 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:00.076 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:00.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:40:00.102 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:00.100+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:00.203 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:00.200+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:00.216 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:00.217 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:00.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:40:00.304 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:00.304+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:00.347 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:00.347 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:00.360 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:40:00.375 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:40:00.407 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:00.409+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:00.477 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:00.477 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:00.490 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:40:00.505 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:00.504+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:00.606 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:00.605+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:00.650 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:00.650 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:00.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:40:00.707 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:00.709+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:00.807 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:00.809+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:00.818 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:00.818 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:00.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:40:00.908 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:00.908+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:01.002 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:01.002 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:01.009 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:01.008+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:01.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:40:01.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:40:01.110 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:01.109+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:01.154 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:01.154 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:01.169 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:40:01.211 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:01.212 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:01.212 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:01.212+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:01.229 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:01.229 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:01.246 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:01.246 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:01.263 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:01.264 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:01.284 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:01.285 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:01.289 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:01.290 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:01.290 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:01.290 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:01.290 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:01.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:40:01.306 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:01.311 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:01.313+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:01.328 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:01.348 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:01.412 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:01.412+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:01.435 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:01.435 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:01.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:01.435 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:01.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.435 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2198 3.3a e76/18 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head v 76'1, mlcod=0'0)", 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 69.313344637, 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019644212000000001, 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.436 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.122750+0000", 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9499999999999998e-07 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129524+0000", 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067742130000000003 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129550+0000", 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5395999999999999e-05 2024-04-17T15:40:01.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129565+0000", 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5064e-05 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129665+0000", 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100381 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129688+0000", 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3479999999999999e-05 2024-04-17T15:40:01.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142322+0000", 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012633287999999999 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142394+0000", 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2094999999999993e-05 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2208 3.1b 3:da648524:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:40:01.439 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 69.211892797000004, 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021369764999999999, 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2208 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224201+0000", 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.224204+0000", 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6259999999999999e-06 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226060+0000", 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001855766 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226089+0000", 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8806000000000002e-05 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226103+0000", 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.483e-05 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226194+0000", 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0162999999999997e-05 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226364+0000", 2024-04-17T15:40:01.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017058399999999999 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.226515+0000", 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000150493 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.236552+0000", 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010037107999999999 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245450+0000", 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088980710000000005 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245517+0000", 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7325999999999999e-05 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.245571+0000", 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3992000000000001e-05 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2249 3.20 e76/18 3:05232b31:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_68:head v 76'2, mlcod=0'0)", 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 68.782955805, 2024-04-17T15:40:01.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021006212999999999, 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653138+0000", 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.653140+0000", 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-06 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658320+0000", 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051792610000000001 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658379+0000", 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8829999999999997e-05 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658398+0000", 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9193000000000001e-05 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658487+0000", 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9685999999999995e-05 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.658514+0000", 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6818999999999999e-05 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.447 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674073+0000", 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015559078 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674145+0000", 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1360999999999997e-05 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2658 3.12 3:4af6eaf9:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.438362628999997, 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022170373, 2024-04-17T15:40:01.448 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2658 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997732+0000", 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.997736+0000", 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2699999999999998e-06 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002164+0000", 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0044277179999999998 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002223+0000", 2024-04-17T15:40:01.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8977000000000001e-05 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002245+0000", 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2560000000000001e-05 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002392+0000", 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014651000000000001 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002690+0000", 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029813000000000002 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.002969+0000", 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027968200000000001 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.014066+0000", 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011096415 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019790+0000", 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0057241410000000003 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019854+0000", 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3875999999999996e-05 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.019902+0000", 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8093999999999997e-05 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2661 3.1f 3:fb74984d:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.363437908000002, 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019684444999999998, 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.453 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2661 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.454 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072656+0000", 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.072660+0000", 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4829999999999999e-06 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075792+0000", 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003131778 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.455 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075850+0000", 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8428999999999999e-05 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.075871+0000", 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0610000000000001e-05 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076025+0000", 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000154516 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.456 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076299+0000", 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000273808 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.076562+0000", 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000262718 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.087909+0000", 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011347411999999999 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092100+0000", 2024-04-17T15:40:01.457 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041911700000000001 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092207+0000", 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010683600000000001 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.092341+0000", 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133685 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.458 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2684 3.6 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.840748101999999, 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024322572000000001, 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2684 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.459 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595346+0000", 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.595350+0000", 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7400000000000002e-06 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.460 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598310+0000", 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029596589999999999 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598365+0000", 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5748999999999998e-05 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598388+0000", 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2986999999999999e-05 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.461 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598582+0000", 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000193356 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.598920+0000", 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00033823700000000002 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599274+0000", 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000353798 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.462 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.608957+0000", 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096830800000000002 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619432+0000", 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010475728 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619528+0000", 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5241999999999994e-05 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619669+0000", 2024-04-17T15:40:01.463 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000140996 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2695 3.17 3:e967dc33:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.601087654000001, 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021609239999999998, 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2695 2024-04-17T15:40:01.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835007+0000", 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.835010+0000", 2024-04-17T15:40:01.465 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.337e-06 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838483+0000", 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003473313 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838529+0000", 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5291999999999999e-05 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838550+0000", 2024-04-17T15:40:01.466 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1469000000000001e-05 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838660+0000", 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011021 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838795+0000", 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013448099999999999 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.838907+0000", 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:40:01.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847213+0000", 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0083057990000000009 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856478+0000", 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092645430000000001 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856557+0000", 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9178000000000007e-05 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.468 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.856616+0000", 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8872999999999997e-05 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3176 3.1f 3:fb16ea6e:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.5707172939999996, 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.026820266999999998, 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.469 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3176 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865377+0000", 2024-04-17T15:40:01.470 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.865379+0000", 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.137e-06 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867517+0000", 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002138184 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867546+0000", 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.87e-05 2024-04-17T15:40:01.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867559+0000", 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3471e-05 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867642+0000", 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.2381999999999998e-05 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867802+0000", 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016007599999999999 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.867912+0000", 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000110037 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.874253+0000", 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0063411350000000003 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892047+0000", 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017793653 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.473 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892131+0000", 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4290999999999996e-05 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.892197+0000", 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6200999999999999e-05 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3197 3.2b 3:d678ab30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.474 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.2548339310000003, 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019324241999999998, 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3197 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181260+0000", 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.181263+0000", 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.649e-06 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183567+0000", 2024-04-17T15:40:01.476 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002303898 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183597+0000", 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9790000000000001e-05 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183612+0000", 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.508e-05 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183692+0000", 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9857000000000005e-05 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.477 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.183852+0000", 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016003400000000001 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.184004+0000", 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152065 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.190207+0000", 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062035390000000001 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.478 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200441+0000", 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010233453 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200517+0000", 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.64e-05 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.200585+0000", 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7477000000000005e-05 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.479 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3199 3.12 3:4a134478:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.2303044120000006, 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021778110999999999, 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3199 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.480 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205790+0000", 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.205793+0000", 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.106e-06 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.481 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207557+0000", 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017638109999999999 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207589+0000", 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2425999999999998e-05 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207605+0000", 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5508000000000001e-05 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207702+0000", 2024-04-17T15:40:01.482 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7022999999999996e-05 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.207901+0000", 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019892400000000001 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.208083+0000", 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018239299999999999 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219998+0000", 2024-04-17T15:40:01.483 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011915113999999999 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227485+0000", 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0074870020000000004 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227532+0000", 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6405e-05 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.227568+0000", 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6399000000000002e-05 2024-04-17T15:40:01.484 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3223 3.1f 3:f91ef8b3:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.9645265779999992, 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019879661, 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3223 2024-04-17T15:40:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471568+0000", 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.471570+0000", 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6419999999999999e-06 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473467+0000", 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018962479999999999 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473502+0000", 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5184000000000001e-05 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473517+0000", 2024-04-17T15:40:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5466000000000001e-05 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473613+0000", 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6157999999999997e-05 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473822+0000", 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020855 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.473982+0000", 2024-04-17T15:40:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016035800000000001 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.481723+0000", 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.007740958 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491344+0000", 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096207069999999992 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491395+0000", 2024-04-17T15:40:01.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0855e-05 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.491447+0000", 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2534999999999998e-05 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3241 3.30 e97/18 3:0c163819:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_186:head v 97'17, mlcod=96'15)", 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.7485301359999994, 2024-04-17T15:40:01.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019499885000000002, 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687564+0000", 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.687565+0000", 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2219999999999999e-06 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692794+0000", 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052283090000000004 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692813+0000", 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9656999999999998e-05 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692826+0000", 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.235e-05 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692911+0000", 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5655000000000006e-05 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.692932+0000", 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0845000000000001e-05 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.706998+0000", 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014065618 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.707064+0000", 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6229000000000006e-05 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3256 3.3d 3:bd900344:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.896008+0000", 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.5400863900000008, 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019134215, 2024-04-17T15:40:01.494 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3256 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.896008+0000", 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.896008+0000", 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.896012+0000", 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9829999999999998e-06 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.900654+0000", 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046419599999999997 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.900701+0000", 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7443e-05 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.900721+0000", 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9720000000000001e-05 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.900843+0000", 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012214699999999999 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.901069+0000", 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022590300000000001 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.901267+0000", 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019767799999999999 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.909273+0000", 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080063770000000003 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.914915+0000", 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056418400000000004 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.915048+0000", 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000132645 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.915142+0000", 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4518999999999994e-05 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3263 3.2b 3:d54106b9:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.999025+0000", 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.4370697270000008, 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019596654000000002, 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3263 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.999025+0000", 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.999025+0000", 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.999027+0000", 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5799999999999999e-06 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.501 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001257+0000", 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022298869999999998 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001288+0000", 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1306999999999997e-05 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001302+0000", 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3837e-05 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001389+0000", 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6774000000000006e-05 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001527+0000", 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013835599999999999 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.001679+0000", 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000151955 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011891+0000", 2024-04-17T15:40:01.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010211892 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.018513+0000", 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066218309999999999 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.018565+0000", 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1768000000000003e-05 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.018621+0000", 2024-04-17T15:40:01.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6467e-05 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3300 3.3a e97/18 3:5ca58b68:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_245:head v 97'8, mlcod=97'6)", 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.426462+0000", 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.0096325979999996, 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019516374, 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.426462+0000", 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.426462+0000", 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.426464+0000", 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.092e-06 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430353+0000", 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003889666 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430395+0000", 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1527999999999999e-05 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430413+0000", 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7611000000000001e-05 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430520+0000", 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106988 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.430567+0000", 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7534000000000003e-05 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.445897+0000", 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015329712000000001 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.445978+0000", 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1242999999999994e-05 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3331 3.32 3:4c2afbd5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_266:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.668616+0000", 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.767478133, 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019198695000000002, 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.509 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3331 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.668616+0000", 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.668616+0000", 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.668619+0000", 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2100000000000002e-06 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670389+0000", 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017696299999999999 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670413+0000", 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4392e-05 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670427+0000", 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3658e-05 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670525+0000", 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7577000000000004e-05 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670743+0000", 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000218299 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.670921+0000", 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000177858 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.677222+0000", 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006301058 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.687670+0000", 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010448107 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.687750+0000", 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0374e-05 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.687815+0000", 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4531999999999998e-05 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3341 3.12 3:4a0d0169:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_276:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.786710+0000", 2024-04-17T15:40:01.514 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.6493845819999997, 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022044162999999999, 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3341 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.786710+0000", 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.786710+0000", 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.786712+0000", 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.818e-06 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.789842+0000", 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031290570000000002 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.789873+0000", 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1010999999999998e-05 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.789884+0000", 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1273e-05 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.789959+0000", 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5063999999999998e-05 2024-04-17T15:40:01.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.790121+0000", 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016213999999999999 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.790283+0000", 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016157500000000001 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.795909+0000", 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056265849999999999 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.808630+0000", 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012720728000000001 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.808704+0000", 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4048999999999995e-05 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.808754+0000", 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9863e-05 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3349 3.17 3:e8365c51:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_284:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.881620+0000", 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.5544738110000003, 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.031626392000000003, 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3349 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.881620+0000", 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.881620+0000", 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.881623+0000", 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.74e-06 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883341+0000", 2024-04-17T15:40:01.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00171828 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883368+0000", 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6409000000000001e-05 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883382+0000", 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4268e-05 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.522 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883464+0000", 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1531000000000003e-05 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883594+0000", 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013065 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.883697+0000", 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010310399999999999 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.890101+0000", 2024-04-17T15:40:01.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064032639999999997 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913143+0000", 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023042615999999998 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913195+0000", 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1555999999999999e-05 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913247+0000", 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.1974000000000001e-05 2024-04-17T15:40:01.524 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3351 3.17 3:ea9731d6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_286:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.902378+0000", 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.5337167420000002, 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.030561992, 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.525 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3351 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.902378+0000", 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.902378+0000", 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.902380+0000", 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9239999999999999e-06 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905057+0000", 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026761689999999999 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905077+0000", 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0358999999999999e-05 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905092+0000", 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4637999999999999e-05 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905226+0000", 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013402299999999999 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905335+0000", 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010968600000000001 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.905449+0000", 2024-04-17T15:40:01.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011319600000000001 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.920266+0000", 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014817568 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.932819+0000", 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012552472 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.932883+0000", 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4362999999999993e-05 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.932940+0000", 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6594000000000001e-05 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3352 3.17 3:e98004da:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_287:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.913817+0000", 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 7.5222776219999998, 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021242748999999998, 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:01.530 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3352 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913817+0000", 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913817+0000", 2024-04-17T15:40:01.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.913819+0000", 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.492e-06 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.915699+0000", 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001879538 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.915717+0000", 2024-04-17T15:40:01.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8442999999999999e-05 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.915727+0000", 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4599999999999992e-06 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.915856+0000", 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012975899999999999 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.916020+0000", 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016348999999999999 2024-04-17T15:40:01.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.916177+0000", 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015742999999999999 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.925352+0000", 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091744429999999991 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.934929+0000", 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095777959999999995 2024-04-17T15:40:01.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.935007+0000", 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7695999999999996e-05 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.935059+0000", 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2201999999999999e-05 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:01.535 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:01.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:40:01.537 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:01.537+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:01.579 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-17T15:40:01.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-17T15:40:01.637 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:01.636+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:01.708 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:01.708 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:01.709 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:01.709 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:01.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:40:01.768 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:01.768+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:01.839 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:01.836+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:01.890 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:01.890 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:01.890 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:01.890 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:01.890 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:01.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:40:01.940 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:01.941+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:02.041 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:02.040+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:02.062 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:02.062 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:02.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 69.988463694999993, 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:02.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:40:02.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 69.985097193000001, 2024-04-17T15:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 69.407897434999995, 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:40:02.073 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:40:02.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.076 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:40:02.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2646 3.8 e89/18 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head v 89'5, mlcod=76'3)", 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:02.079 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.322701711999997, 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018982274, 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740529+0000", 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9660000000000001e-06 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745823+0000", 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052946060000000003 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745886+0000", 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3251999999999997e-05 2024-04-17T15:40:02.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745910+0000", 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3964e-05 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746063+0000", 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015276100000000001 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746089+0000", 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6180999999999999e-05 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759412+0000", 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013322387999999999 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759508+0000", 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6156000000000006e-05 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2663 3.0 3:00b68c77:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.93959529, 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020648330999999999, 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2663 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123635+0000", 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126602+0000", 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029664679999999999 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126640+0000", 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.82e-05 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126654+0000", 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4440000000000001e-05 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126752+0000", 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7879000000000003e-05 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126948+0000", 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000195983 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.127139+0000", 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019063500000000001 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.087 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.143125+0000", 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015986416999999999 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144087+0000", 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00096153799999999995 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144196+0000", 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010974199999999999 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144280+0000", 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3962999999999996e-05 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2669 3.4 3:2238a661:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.797947661000002, 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020392082999999998, 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.089 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2669 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265285+0000", 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4729999999999999e-06 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268400+0000", 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003114618 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268449+0000", 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9462999999999997e-05 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268477+0000", 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7440000000000002e-05 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268646+0000", 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016956299999999999 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268970+0000", 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032326799999999998 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.269256+0000", 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028625100000000001 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.278736+0000", 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094797909999999996 2024-04-17T15:40:02.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285472+0000", 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067364429999999999 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285588+0000", 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116452 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285672+0000", 2024-04-17T15:40:02.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3320999999999997e-05 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2673 3.3e 3:7c55c310:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.698159138000001, 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020262019999999999, 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.095 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2673 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365073+0000", 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7999999999999998e-06 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368449+0000", 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003376146 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368509+0000", 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0312999999999997e-05 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368541+0000", 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1803e-05 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368708+0000", 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016662099999999999 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369022+0000", 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031360099999999999 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:02.098 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369297+0000", 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027513 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.378587+0000", 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092898990000000008 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385219+0000", 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066324770000000003 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385281+0000", 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1766000000000005e-05 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385330+0000", 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9463999999999999e-05 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2684 3.6 e89/18 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head v 89'3, mlcod=76'1)", 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:02.100 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.463725998999998, 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019575401999999999, 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599504+0000", 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604610+0000", 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051064400000000003 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604655+0000", 2024-04-17T15:40:02.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4943e-05 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604679+0000", 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3572999999999999e-05 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604878+0000", 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019935600000000001 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604944+0000", 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5869000000000002e-05 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.618945+0000", 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014001095999999999 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619077+0000", 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131765 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.104 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2686 3.3e 3:7c7e4e92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.425139225999999, 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024025214999999999, 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2686 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.105 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638092+0000", 2024-04-17T15:40:02.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643705+0000", 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056133939999999998 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643768+0000", 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2983000000000003e-05 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643797+0000", 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8656000000000001e-05 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643979+0000", 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018241199999999999 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644258+0000", 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000278848 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644492+0000", 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023429200000000001 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.658683+0000", 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014190408 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.661860+0000", 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031772839999999998 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.109 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662022+0000", 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016153900000000001 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662113+0000", 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1656000000000005e-05 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2691 3.3e 3:7c0d9124:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.110 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.317742246999998, 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018482157999999999, 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2691 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.111 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745489+0000", 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.703e-06 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.112 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748279+0000", 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027905669999999999 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748329+0000", 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9353e-05 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748357+0000", 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8575999999999999e-05 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.113 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748540+0000", 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018234300000000001 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748940+0000", 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040061699999999998 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.749226+0000", 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028620000000000002 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.762456+0000", 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013229925999999999 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763785+0000", 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00132825 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763889+0000", 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104616 2024-04-17T15:40:02.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763967+0000", 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8007e-05 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2696 3.31 3:8e0a861b:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.215762136999999, 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019128764999999999, 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.116 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2696 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:02.117 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847469+0000", 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4249999999999998e-06 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849776+0000", 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023068659999999999 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.118 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849808+0000", 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2363000000000002e-05 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849823+0000", 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5238e-05 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849950+0000", 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012710600000000001 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.119 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850228+0000", 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000277915 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850487+0000", 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025900899999999999 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.858273+0000", 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077861379999999997 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866446+0000", 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081723060000000007 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866526+0000", 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0242999999999997e-05 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866594+0000", 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8156000000000003e-05 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.121 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2731 3.25 3:a7c57b71:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.80115357, 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022381027000000001, 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2731 2024-04-17T15:40:02.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262078+0000", 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8940000000000003e-06 2024-04-17T15:40:02.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264600+0000", 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025222119999999998 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264637+0000", 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6875000000000002e-05 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264652+0000", 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4908e-05 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264756+0000", 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104163 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264918+0000", 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016187100000000001 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.265111+0000", 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019296999999999999 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.125 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.275063+0000", 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099523719999999993 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284321+0000", 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092580249999999996 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284399+0000", 2024-04-17T15:40:02.126 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7761000000000003e-05 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284455+0000", 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5976000000000001e-05 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2749 3.31 3:8ffe76ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 31.593840230000001, 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019338203000000002, 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.127 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2749 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:02.128 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469390+0000", 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.402e-06 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471361+0000", 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019715980000000002 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471390+0000", 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9351000000000001e-05 2024-04-17T15:40:02.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471405+0000", 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4346e-05 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471500+0000", 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4970999999999996e-05 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471683+0000", 2024-04-17T15:40:02.130 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018349600000000001 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471860+0000", 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017656400000000001 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.479403+0000", 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075432010000000002 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.131 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488606+0000", 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092024670000000006 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488673+0000", 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7230999999999994e-05 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488725+0000", 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2575999999999999e-05 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.132 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3191 3.19 3:995acef5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.9848899279999994, 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023716885, 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3191 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:02.133 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078341+0000", 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0269999999999997e-06 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.134 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081493+0000", 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031513700000000001 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081523+0000", 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.027e-05 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081539+0000", 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6379999999999999e-05 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.135 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081612+0000", 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2286000000000006e-05 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081757+0000", 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014521799999999999 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081891+0000", 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013438799999999999 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.089902+0000", 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080110170000000005 2024-04-17T15:40:02.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.101929+0000", 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012026714000000001 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102002+0000", 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2972999999999994e-05 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102054+0000", 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2241999999999999e-05 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.137 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3194 3.31 3:8d6d9ccc:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.9392797819999998, 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019551065999999999, 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.138 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3194 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123951+0000", 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6049999999999998e-06 2024-04-17T15:40:02.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127418+0000", 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003467206 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127479+0000", 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1056000000000006e-05 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127509+0000", 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9796999999999999e-05 2024-04-17T15:40:02.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127642+0000", 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013244400000000001 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127865+0000", 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022359999999999999 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.128070+0000", 2024-04-17T15:40:02.141 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000204234 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.136260+0000", 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081904179999999997 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143325+0000", 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070648309999999997 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.142 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143424+0000", 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9182e-05 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143499+0000", 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4692999999999998e-05 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3214 3.1a e97/18 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head v 97'17, mlcod=96'15)", 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:02.143 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.6860381859999993, 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019376285, 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377191+0000", 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6449999999999999e-06 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383962+0000", 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067710490000000003 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383992+0000", 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9745000000000001e-05 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.145 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384007+0000", 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5573000000000002e-05 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384103+0000", 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5511000000000001e-05 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384130+0000", 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7755000000000001e-05 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.146 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396497+0000", 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012366769999999999 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396565+0000", 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8237000000000004e-05 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3246 3.25 3:a59a480d:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:02.147 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.3060367139999993, 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020455952999999999, 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3246 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.148 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757194+0000", 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0000000000000001e-06 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760651+0000", 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034570289999999999 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.149 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760693+0000", 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2763999999999999e-05 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760716+0000", 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2467e-05 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760894+0000", 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000177775 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.150 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761181+0000", 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028763399999999999 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761473+0000", 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029150999999999998 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.772290+0000", 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010816698 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777506+0000", 2024-04-17T15:40:02.151 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052165019999999996 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777587+0000", 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1228000000000002e-05 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777647+0000", 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9345999999999997e-05 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.152 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3292 3.19 3:9a68834c:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.7343461340000008, 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018305169999999999, 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3292 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328885+0000", 2024-04-17T15:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4939999999999999e-06 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331134+0000", 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022493460000000002 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331171+0000", 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7119000000000002e-05 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331188+0000", 2024-04-17T15:40:02.155 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7252e-05 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331289+0000", 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100369 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331483+0000", 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000194286 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331665+0000", 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018169099999999999 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.156 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.341800+0000", 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0101356 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347049+0000", 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052490499999999999 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347125+0000", 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5731999999999999e-05 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.157 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347186+0000", 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1230999999999997e-05 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3327 3.25 3:a5e282f6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_262:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.4369644370000003, 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018341494, 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.158 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3327 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626267+0000", 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628501+0000", 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339870000000002 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628532+0000", 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1730000000000003e-05 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.160 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628545+0000", 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3176999999999999e-05 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628614+0000", 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8384000000000001e-05 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628732+0000", 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117927 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628864+0000", 2024-04-17T15:40:02.161 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013266600000000001 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.641855+0000", 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012990431 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644472+0000", 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026173619999999998 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644543+0000", 2024-04-17T15:40:02.162 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1144999999999997e-05 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644604+0000", 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1068999999999994e-05 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3355 3.4 3:2266acf0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.1136870040000009, 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021132874999999999, 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.163 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3355 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949543+0000", 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8720000000000002e-06 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951012+0000", 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014686160000000001 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951044+0000", 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1951e-05 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.165 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951056+0000", 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2502e-05 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951139+0000", 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3190999999999997e-05 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951312+0000", 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017254799999999999 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951475+0000", 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016339800000000001 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.956582+0000", 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051069840000000002 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970578+0000", 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013995914999999999 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970625+0000", 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6487999999999999e-05 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970673+0000", 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8409999999999999e-05 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.168 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:02.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:40:02.170 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:02.168+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:02.271 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:02.269+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:02.347 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:02.347 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:02.347 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:02.347 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:02.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:40:02.388 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-17T15:40:02.388 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:02.388+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:02.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:40:02.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-17T15:40:02.471 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:02.473+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:02.495 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:02.495 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:02.495 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:02.495 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:02.495 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:02.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:40:02.572 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:02.573+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:02.673 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:02.672+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.395950053000007, 2024-04-17T15:40:02.683 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:02.684 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.685 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.686 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.687 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:40:02.688 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.265490666999995, 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.689 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.690 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.691 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:02.692 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.693 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.694 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.170852335000006, 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.695 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:40:02.696 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.697 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.699 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:02.700 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.151395895999997, 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.701 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.702 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.703 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:40:02.704 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 69.964900685000003, 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.706 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:02.707 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.708 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.709 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:40:02.710 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:40:02.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2655 3.3b e89/18 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head v 89'7, mlcod=76'5)", 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.750390381000003, 2024-04-17T15:40:02.712 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022625060999999998, 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.713 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5600000000000004e-07 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.937998+0000", 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059469739999999998 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938039+0000", 2024-04-17T15:40:02.714 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0113e-05 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938062+0000", 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3807000000000001e-05 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938236+0000", 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403500000000001 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938303+0000", 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6190000000000002e-05 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954503+0000", 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016200763999999999 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954676+0000", 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017232200000000001 2024-04-17T15:40:02.716 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2656 3.16 3:6ad2ad56:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.731207079000001, 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022969676000000001, 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2656 2024-04-17T15:40:02.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.718 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951237+0000", 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.264e-06 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956406+0000", 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051685460000000004 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956439+0000", 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2959000000000001e-05 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.719 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956456+0000", 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7217000000000001e-05 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956609+0000", 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015330899999999999 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956880+0000", 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027084100000000002 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:02.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.957130+0000", 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025006900000000001 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.966230+0000", 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009099434 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974022+0000", 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077925549999999996 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.721 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974126+0000", 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103706 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974204+0000", 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7775999999999995e-05 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2664 3.21 3:84c31c70:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:02.722 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.534275170999997, 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019486428, 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2664 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148169+0000", 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0070000000000002e-06 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151347+0000", 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031786599999999998 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.724 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151397+0000", 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9317000000000002e-05 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151417+0000", 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.012e-05 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151540+0000", 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012354900000000001 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.725 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151802+0000", 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026111400000000001 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151955+0000", 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015302 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.159770+0000", 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078157350000000007 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.726 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167530+0000", 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077592989999999999 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167595+0000", 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5320999999999993e-05 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167652+0000", 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7286e-05 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2689 3.2d e89/18 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head v 89'5, mlcod=77'3)", 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.976809756999998, 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023548848000000001, 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:02.728 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705634+0000", 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0929999999999999e-06 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711102+0000", 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054679810000000002 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711146+0000", 2024-04-17T15:40:02.729 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3940000000000003e-05 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711170+0000", 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4283000000000001e-05 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711304+0000", 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013349999999999999 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711341+0000", 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6803e-05 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729020+0000", 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017679553000000001 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729180+0000", 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015969500000000001 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3161 3.2e 3:77c0c5b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:02.731 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.982537547, 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018746992000000001, 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3161 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.732 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699907+0000", 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3390000000000001e-06 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702202+0000", 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022948840000000001 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702230+0000", 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8513999999999998e-05 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702241+0000", 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1083999999999999e-05 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702340+0000", 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8443000000000006e-05 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702543+0000", 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020311 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702723+0000", 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000180235 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.735 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.714838+0000", 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012114583 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718506+0000", 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036683530000000001 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718587+0000", 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1254999999999994e-05 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718650+0000", 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3192000000000001e-05 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3174 3.21 3:84a9f215:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.840560371, 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018361252000000002, 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.737 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3174 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841884+0000", 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2490000000000001e-06 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844049+0000", 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021650620000000001 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844073+0000", 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3893999999999999e-05 2024-04-17T15:40:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844085+0000", 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1963e-05 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844179+0000", 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4195000000000002e-05 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844385+0000", 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206331 2024-04-17T15:40:02.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844583+0000", 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019758899999999999 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.857179+0000", 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012595705 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860113+0000", 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029346950000000002 2024-04-17T15:40:02.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860184+0000", 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0852999999999994e-05 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860242+0000", 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7716000000000001e-05 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3188 3.2f 3:f4860977:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.742 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.670264438, 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019398723999999999, 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3188 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:02.743 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012181+0000", 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4129999999999999e-06 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.744 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014461+0000", 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022799539999999998 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014506+0000", 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5529999999999999e-05 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.745 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014526+0000", 2024-04-17T15:40:02.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9542999999999999e-05 2024-04-17T15:40:02.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.746 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.746 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014635+0000", 2024-04-17T15:40:02.746 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010869700000000001 2024-04-17T15:40:02.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.746 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014813+0000", 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178128 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.015010+0000", 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000197111 2024-04-17T15:40:02.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.023029+0000", 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080189619999999993 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031512+0000", 2024-04-17T15:40:02.748 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084828179999999996 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031549+0000", 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6944999999999999e-05 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031575+0000", 2024-04-17T15:40:02.750 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6622999999999999e-05 2024-04-17T15:40:02.750 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.750 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.750 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.750 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3195 3.16 3:6892fdae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.750 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:02.751 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.535590198, 2024-04-17T15:40:02.751 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021725749999999999, 2024-04-17T15:40:02.751 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.751 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.751 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.751 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.751 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.751 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3195 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:02.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.753 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.753 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146855+0000", 2024-04-17T15:40:02.753 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8800000000000001e-06 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150499+0000", 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036446019999999998 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.754 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150530+0000", 2024-04-17T15:40:02.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1099999999999997e-05 2024-04-17T15:40:02.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.755 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.755 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.755 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150543+0000", 2024-04-17T15:40:02.755 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2847000000000001e-05 2024-04-17T15:40:02.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150617+0000", 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4294000000000004e-05 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150741+0000", 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123731 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.756 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150854+0000", 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.157302+0000", 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064475870000000003 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168431+0000", 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011129847 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.757 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168516+0000", 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4331000000000003e-05 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168577+0000", 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0785999999999997e-05 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3215 3.16 3:69d29e25:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:02.758 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.300576146999999, 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020347908000000001, 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3215 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.759 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381869+0000", 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8070000000000001e-06 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384172+0000", 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002302957 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384202+0000", 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0704000000000003e-05 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384216+0000", 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3376e-05 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.761 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384299+0000", 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3622000000000007e-05 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384481+0000", 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182086 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.762 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:02.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384646+0000", 2024-04-17T15:40:02.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016434199999999999 2024-04-17T15:40:02.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.763 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.763 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396642+0000", 2024-04-17T15:40:02.763 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011996079 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402122+0000", 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054798360000000001 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.764 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402169+0000", 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7664000000000003e-05 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402213+0000", 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3435e-05 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.765 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3232 3.2e 3:77f4f650:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.105763603, 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020894309, 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3232 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.766 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576681+0000", 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3060000000000002e-06 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578598+0000", 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001917799 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578637+0000", 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8884000000000002e-05 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578654+0000", 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6578999999999998e-05 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.768 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578752+0000", 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8412000000000006e-05 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578884+0000", 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131359 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.579029+0000", 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014510799999999999 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.769 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.584890+0000", 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058607679999999997 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597433+0000", 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012543642000000001 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597513+0000", 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9538999999999999e-05 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.770 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597572+0000", 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8913000000000003e-05 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3243 3.21 3:86efebb2:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.9736444540000004, 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018171970999999999, 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.771 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3243 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.772 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708799+0000", 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711223+0000", 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024239690000000002 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.773 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711252+0000", 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9176999999999999e-05 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711263+0000", 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1269e-05 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711334+0000", 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0891999999999998e-05 2024-04-17T15:40:02.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711467+0000", 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133306 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711580+0000", 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112734 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.719664+0000", 2024-04-17T15:40:02.775 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080840129999999993 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726888+0000", 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072236660000000001 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726932+0000", 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4709000000000002e-05 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726968+0000", 2024-04-17T15:40:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6109000000000003e-05 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3245 3.24 3:26e56b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.9419557449999996, 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020901084, 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.777 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3245 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.778 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740501+0000", 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5823000000000001e-05 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742689+0000", 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021879009999999999 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742737+0000", 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8519000000000001e-05 2024-04-17T15:40:02.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742759+0000", 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.173e-05 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742848+0000", 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9116000000000005e-05 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743031+0000", 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018237599999999999 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.780 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743192+0000", 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000161461 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.749847+0000", 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066546610000000001 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761259+0000", 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011411813999999999 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.781 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761330+0000", 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1481000000000002e-05 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761386+0000", 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6202000000000002e-05 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3254 3.21 3:86770de1:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:02.782 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.8183978990000007, 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022547540000000001, 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3254 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.783 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864046+0000", 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.004e-06 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.784 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865763+0000", 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017173360000000001 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865809+0000", 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5519999999999998e-05 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865827+0000", 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7716000000000001e-05 2024-04-17T15:40:02.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865933+0000", 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010629 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866093+0000", 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000159946 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866220+0000", 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127164 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.873221+0000", 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070009570000000004 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886373+0000", 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013151891000000001 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886502+0000", 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012948500000000001 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.787 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886591+0000", 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8231000000000003e-05 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3264 3.24 3:26cd557b:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.6727102840000008, 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020478857, 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.788 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3264 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009734+0000", 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011450+0000", 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017157369999999999 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.790 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011475+0000", 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5151999999999999e-05 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011488+0000", 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3740000000000001e-05 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011581+0000", 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.255e-05 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011705+0000", 2024-04-17T15:40:02.791 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012390900000000001 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011811+0000", 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106111 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.019611+0000", 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077997359999999998 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030126+0000", 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010514977999999999 2024-04-17T15:40:02.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030173+0000", 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7451999999999999e-05 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030210+0000", 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6294000000000002e-05 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3343 3.16 3:6ae5c866:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_278:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:02.793 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 8.8718969130000005, 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019911570999999999, 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3343 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.794 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810546+0000", 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.357e-06 2024-04-17T15:40:02.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812931+0000", 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023841180000000002 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812960+0000", 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9677999999999999e-05 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812971+0000", 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1259e-05 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813071+0000", 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9406000000000003e-05 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813247+0000", 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000176429 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:02.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813415+0000", 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016733000000000001 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.824091+0000", 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010676296 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830354+0000", 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006263294 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:02.798 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830402+0000", 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8155999999999998e-05 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830456+0000", 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3248000000000002e-05 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:02.799 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:02.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:40:02.801 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:02.800+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:02.901 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:02.900+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:02.977 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:02.977 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:02.977 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:02.977 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:02.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:40:03.002 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:03.001+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:03.103 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:03.100+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:03.161 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:03.162 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:03.162 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:03.162 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:03.162 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:03.176 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:40:03.204 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:03.205+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:03.305 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:03.304+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:03.341 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:03.341 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:03.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:03.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:03.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.213271355000003, 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.342 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:40:03.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:40:03.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:40:03.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 71.201495434999998, 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.347 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.352 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.759751761999993, 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:40:03.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:40:03.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:40:03.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:40:03.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.633107797999998, 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.358 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2276 3.2 3:413eb100:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 70.411135931000004, 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020329113999999999, 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2276 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931295+0000", 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6189999999999998e-06 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936287+0000", 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049920559999999999 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936310+0000", 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3538000000000001e-05 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936322+0000", 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1739000000000001e-05 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936395+0000", 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2521000000000006e-05 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936512+0000", 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117872 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936622+0000", 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010926599999999999 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942455+0000", 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058337099999999998 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951496+0000", 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090407899999999999 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951571+0000", 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4361000000000002e-05 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951621+0000", 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0642000000000001e-05 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2646 3.8 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 34.607863047000002, 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025266311, 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.369 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2646 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734569+0000", 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739260+0000", 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046916730000000004 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739303+0000", 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2799000000000001e-05 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739322+0000", 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8389999999999998e-05 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739489+0000", 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167016 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739896+0000", 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040707699999999999 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740309+0000", 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041348699999999998 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.754426+0000", 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014117002 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759750+0000", 2024-04-17T15:40:03.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053237900000000001 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759800+0000", 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0405000000000003e-05 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759831+0000", 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0861999999999997e-05 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2688 3.18 3:1b829d89:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.658627449999997, 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023433995999999999, 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2688 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683806+0000", 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2000000000000002e-06 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688730+0000", 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049237680000000002 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688789+0000", 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9469999999999998e-05 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688813+0000", 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4253e-05 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688955+0000", 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014158899999999999 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689247+0000", 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029219100000000002 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689484+0000", 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023730499999999999 2024-04-17T15:40:03.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705954+0000", 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016469461000000001 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707072+0000", 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001118427 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707163+0000", 2024-04-17T15:40:03.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1199999999999994e-05 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707235+0000", 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1131999999999996e-05 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2737 3.8 3:1044985e:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.008436144000001, 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024601553000000002, 2024-04-17T15:40:03.380 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2737 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333996+0000", 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8929999999999998e-06 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335595+0000", 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015994550000000001 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335629+0000", 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335645+0000", 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6597999999999999e-05 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335729+0000", 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3633000000000004e-05 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op must wait for map", 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335735+0000", 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339342+0000", 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036071340000000001 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339550+0000", 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020780199999999999 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339728+0000", 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178734 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354941+0000", 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015212356 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358485+0000", 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035443250000000001 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358544+0000", 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8888000000000003e-05 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358593+0000", 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9557e-05 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2736 3.5 e90/18 3:a18cd429:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_91:head v 90'5, mlcod=76'3)", 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:03.386 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 33.006695964999999, 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020182848, 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:03.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335733+0000", 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5799999999999999e-07 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339776+0000", 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040432940000000002 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339787+0000", 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0671e-05 2024-04-17T15:40:03.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339795+0000", 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0639999999999994e-06 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339845+0000", 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0086000000000001e-05 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339891+0000", 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5849000000000001e-05 2024-04-17T15:40:03.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.355857+0000", 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015966774999999999 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.355915+0000", 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7451000000000003e-05 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2757 3.7 3:e214b53f:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 32.778053206999999, 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020206643999999999, 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2757 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564377+0000", 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2510000000000001e-06 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566069+0000", 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001691981 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566102+0000", 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3061000000000001e-05 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566118+0000", 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6045999999999998e-05 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566256+0000", 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137527 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566449+0000", 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019308500000000001 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566611+0000", 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016235500000000001 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.573412+0000", 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068006849999999999 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584453+0000", 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011041146 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584525+0000", 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2512e-05 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584581+0000", 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5995000000000002e-05 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3200 3.33 3:cc4ca667:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 11.125102042, 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020688749999999999, 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.396 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3200 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217328+0000", 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6920000000000001e-06 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219299+0000", 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019712150000000001 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219323+0000", 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4076000000000001e-05 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219337+0000", 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3767e-05 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219426+0000", 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9279999999999999e-05 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219636+0000", 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021027400000000001 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219804+0000", 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167629 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.228577+0000", 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0087731679999999996 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.237862+0000", 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092845170000000008 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.237943+0000", 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1642000000000002e-05 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.238015+0000", 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1489999999999995e-05 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3208 3.1e 3:7bf3f1fd:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 11.03671473, 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024643996000000001, 2024-04-17T15:40:03.402 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3208 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305716+0000", 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8609999999999998e-06 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307655+0000", 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001938546 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307680+0000", 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5238000000000001e-05 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307695+0000", 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5133000000000001e-05 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307786+0000", 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0728000000000003e-05 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.405 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307955+0000", 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016871400000000001 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.308078+0000", 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012391 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.317113+0000", 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090349109999999996 2024-04-17T15:40:03.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330212+0000", 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013098344 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330292+0000", 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0183000000000001e-05 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330357+0000", 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5427999999999998e-05 2024-04-17T15:40:03.407 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3237 3.33 3:cc5684ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.711479795000001, 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022846793000000001, 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.408 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3237 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.409 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630950+0000", 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7039999999999999e-06 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632791+0000", 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018406119999999999 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632820+0000", 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9380999999999999e-05 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.410 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632834+0000", 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4345000000000001e-05 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632926+0000", 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2145999999999995e-05 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633056+0000", 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012976700000000001 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633198+0000", 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000141342 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.639250+0000", 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006052605 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653695+0000", 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014444988000000001 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653741+0000", 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5556000000000002e-05 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653795+0000", 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4347e-05 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3242 3.33 3:cc808c01:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.646859666999999, 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020918729, 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3242 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.414 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695572+0000", 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5769999999999998e-06 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697488+0000", 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001916189 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697516+0000", 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8093999999999999e-05 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697529+0000", 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3158e-05 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697639+0000", 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109227 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697845+0000", 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206226 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.698025+0000", 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179987 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.705449+0000", 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.007424445 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716350+0000", 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010900734 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716426+0000", 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5622000000000002e-05 2024-04-17T15:40:03.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716487+0000", 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1470000000000006e-05 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3250 3.7 3:e148f750:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.525145011999999, 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021674067000000002, 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.419 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3250 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817288+0000", 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7299999999999996e-06 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820832+0000", 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035441740000000002 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820870+0000", 2024-04-17T15:40:03.421 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7565999999999999e-05 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820885+0000", 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5132e-05 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821009+0000", 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124475 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.422 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821146+0000", 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013711600000000001 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821247+0000", 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010072400000000001 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.827312+0000", 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060654389999999997 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.423 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838765+0000", 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011452208 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838888+0000", 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123771 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838957+0000", 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8732000000000005e-05 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.424 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3252 3.2 3:40c9ca30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.505653174000001, 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022557901000000002, 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3252 2024-04-17T15:40:03.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836777+0000", 2024-04-17T15:40:03.426 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4949999999999998e-06 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843566+0000", 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067891239999999997 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843599+0000", 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2002999999999998e-05 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.427 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843614+0000", 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5957e-05 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843705+0000", 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0276000000000001e-05 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843902+0000", 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019734200000000001 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.844063+0000", 2024-04-17T15:40:03.428 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160512 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.854965+0000", 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010902593 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859208+0000", 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0042428580000000004 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.429 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859279+0000", 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0858000000000005e-05 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859333+0000", 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3882999999999999e-05 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3257 3.29 3:97b19dae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:03.430 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.429820747999999, 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021952833000000001, 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3257 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912611+0000", 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0330000000000002e-06 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916649+0000", 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040378489999999996 2024-04-17T15:40:03.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916685+0000", 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5646999999999999e-05 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916701+0000", 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6328e-05 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916812+0000", 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011056 2024-04-17T15:40:03.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917015+0000", 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020336400000000001 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917200+0000", 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018441900000000001 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.926337+0000", 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091371060000000007 2024-04-17T15:40:03.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934459+0000", 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081220489999999992 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934506+0000", 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7534999999999998e-05 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934560+0000", 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3943000000000002e-05 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.435 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3259 3.29 3:97b435f0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.396539249, 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021828215000000002, 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.436 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3259 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.437 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945892+0000", 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9679999999999998e-06 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.947986+0000", 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020939650000000001 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948032+0000", 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6180999999999997e-05 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.438 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948055+0000", 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3031999999999999e-05 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948167+0000", 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011191700000000001 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948370+0000", 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020330599999999999 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:03.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948569+0000", 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019869199999999999 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.956337+0000", 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077678039999999997 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967491+0000", 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011154393 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967620+0000", 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012935299999999999 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967717+0000", 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6603999999999999e-05 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3274 3.38 3:1c6c0b46:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 10.209380796, 2024-04-17T15:40:03.441 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020992581999999999, 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3274 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133050+0000", 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.88e-06 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135292+0000", 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022414240000000001 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135324+0000", 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000002e-05 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135342+0000", 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8808e-05 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135460+0000", 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118107 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.444 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135621+0000", 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016069599999999999 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135814+0000", 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000192793 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.142834+0000", 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070204389999999998 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.445 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.153823+0000", 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010988639999999999 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.153932+0000", 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010886400000000001 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.154040+0000", 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107951 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.446 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3297 3.2 3:4392bec4:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 9.9542405089999999, 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020524942000000001, 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3297 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.447 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388191+0000", 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2009999999999999e-06 2024-04-17T15:40:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390093+0000", 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019019110000000001 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390128+0000", 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5043000000000003e-05 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390143+0000", 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5319999999999999e-05 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390237+0000", 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4327000000000007e-05 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390421+0000", 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018346500000000001 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390590+0000", 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169257 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.397780+0000", 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071894719999999997 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408577+0000", 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010797899999999999 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408651+0000", 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3208999999999997e-05 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:03.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408712+0000", 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1836999999999998e-05 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:03.452 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:03.452 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:40:03.454 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:40:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:40:03.455 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-17T15:40:03.456 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-17T15:40:03.457 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:03.453+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:03.555 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:03.552+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:03.592 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:03.593 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:03.593 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:40:03.593 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:03.607 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:40:03.644 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:03.644 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:03.656 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:03.656+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:03.661 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:03.662 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:03.678 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:03.679 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:03.695 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:03.696 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:03.716 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:03.735 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:03.735 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:03.737 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:03.750 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:40:03.756 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:03.756+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:03.757 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:03.778 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:03.857 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:03.857+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:03.876 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:03.876 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:03.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:40:03.975 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:03.977+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:04.058 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:04.058 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:04.059 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:04.057+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:04.072 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:40:04.164 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:04.161+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:04.245 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:04.245 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:04.260 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:04.261+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:04.260 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:40:04.360 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:04.360+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-17T15:40:04.428 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:04.428 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:04.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-17T15:40:04.443 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:40:04.492 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:04.493+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:04.562 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:04.562 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:04.563 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:04.561+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:04.576 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:40:04.663 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:04.664+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:04.746 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:04.747 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:04.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:40:04.764 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:04.765+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:04.865 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:04.864+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:04.880 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:04.880 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:04.894 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:40:04.965 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:04.964+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:05.016 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:05.016 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:05.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:40:05.079 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:05.081+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:05.157 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:05.157 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:05.167 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:05.165+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:05.171 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:40:05.267 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:05.268+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:05.348 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:05.348 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:05.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:40:05.368 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:05.369+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:05.415 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.3 to 1 (10000) 2024-04-17T15:40:05.439 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-17T15:40:05.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:40:05.469 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:05.469+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:05.505 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:05.505 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:05.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:40:05.612 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:05.612+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:05.671 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:05.673+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:05.682 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:05.682 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:05.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:40:05.788 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:05.788+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:05.796 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:40:05.873 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:05.873 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:05.874 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:05.873+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:05.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:40:05.935 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:05.936 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:05.953 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:05.969 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:05.970 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:05.974 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:05.972+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:05.986 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:06.007 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:06.008 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:06.008 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:06.008 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:06.008 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:06.008 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:06.022 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:40:06.028 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:06.051 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:06.051 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:06.072 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:06.072 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:06.075 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:06.073+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:06.146 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:06.146 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:06.146 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:06.146 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:06.146 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:06.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:40:06.208 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:06.208+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:06.276 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:06.277+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:06.293 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:06.293 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:06.293 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.218378928999996, 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.294 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.295 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:40:06.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.215012427000005, 2024-04-17T15:40:06.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:40:06.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 73.637812668999999, 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:40:06.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.308 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2646 3.8 e89/18 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head v 89'5, mlcod=76'3)", 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.552616946000001, 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018982274, 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740529+0000", 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9660000000000001e-06 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745823+0000", 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052946060000000003 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745886+0000", 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3251999999999997e-05 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745910+0000", 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3964e-05 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746063+0000", 2024-04-17T15:40:06.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015276100000000001 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746089+0000", 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6180999999999999e-05 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759412+0000", 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013322387999999999 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759508+0000", 2024-04-17T15:40:06.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6156000000000006e-05 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2663 3.0 3:00b68c77:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.169510524000003, 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020648330999999999, 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.313 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2663 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123635+0000", 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126602+0000", 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029664679999999999 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126640+0000", 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.82e-05 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126654+0000", 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4440000000000001e-05 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126752+0000", 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7879000000000003e-05 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126948+0000", 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000195983 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:06.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.127139+0000", 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019063500000000001 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.143125+0000", 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015986416999999999 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144087+0000", 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00096153799999999995 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144196+0000", 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010974199999999999 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144280+0000", 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3962999999999996e-05 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2669 3.4 3:2238a661:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:06.318 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.027862894999998, 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020392082999999998, 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2669 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265285+0000", 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4729999999999999e-06 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268400+0000", 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003114618 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268449+0000", 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9462999999999997e-05 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268477+0000", 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7440000000000002e-05 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268646+0000", 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016956299999999999 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268970+0000", 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032326799999999998 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.269256+0000", 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028625100000000001 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.278736+0000", 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094797909999999996 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285472+0000", 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067364429999999999 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285588+0000", 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116452 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285672+0000", 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3320999999999997e-05 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2673 3.3e 3:7c55c310:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 36.928074371999998, 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020262019999999999, 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2673 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365073+0000", 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7999999999999998e-06 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368449+0000", 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003376146 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368509+0000", 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0312999999999997e-05 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368541+0000", 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1803e-05 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368708+0000", 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016662099999999999 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369022+0000", 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031360099999999999 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369297+0000", 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027513 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.378587+0000", 2024-04-17T15:40:06.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092898990000000008 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385219+0000", 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066324770000000003 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385281+0000", 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1766000000000005e-05 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385330+0000", 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9463999999999999e-05 2024-04-17T15:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2684 3.6 e89/18 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head v 89'3, mlcod=76'1)", 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 36.693641233000001, 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019575401999999999, 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599504+0000", 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604610+0000", 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051064400000000003 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604655+0000", 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4943e-05 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604679+0000", 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3572999999999999e-05 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604878+0000", 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019935600000000001 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604944+0000", 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5869000000000002e-05 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.618945+0000", 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014001095999999999 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619077+0000", 2024-04-17T15:40:06.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131765 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2686 3.3e 3:7c7e4e92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 36.655054460000002, 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024025214999999999, 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.333 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2686 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638092+0000", 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643705+0000", 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056133939999999998 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643768+0000", 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2983000000000003e-05 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.335 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643797+0000", 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8656000000000001e-05 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643979+0000", 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018241199999999999 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644258+0000", 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000278848 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:06.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644492+0000", 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023429200000000001 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.658683+0000", 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014190408 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.661860+0000", 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031772839999999998 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662022+0000", 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016153900000000001 2024-04-17T15:40:06.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662113+0000", 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1656000000000005e-05 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2691 3.3e 3:7c0d9124:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 36.547657481000002, 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018482157999999999, 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.338 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2691 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745489+0000", 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.703e-06 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748279+0000", 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027905669999999999 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748329+0000", 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9353e-05 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748357+0000", 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8575999999999999e-05 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748540+0000", 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018234300000000001 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748940+0000", 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040061699999999998 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.749226+0000", 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028620000000000002 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.762456+0000", 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013229925999999999 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763785+0000", 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00132825 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763889+0000", 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104616 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763967+0000", 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8007e-05 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2696 3.31 3:8e0a861b:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 36.445677371000002, 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019128764999999999, 2024-04-17T15:40:06.343 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2696 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:06.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847469+0000", 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4249999999999998e-06 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849776+0000", 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023068659999999999 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849808+0000", 2024-04-17T15:40:06.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2363000000000002e-05 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849823+0000", 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5238e-05 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849950+0000", 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012710600000000001 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850228+0000", 2024-04-17T15:40:06.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000277915 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850487+0000", 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025900899999999999 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.858273+0000", 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077861379999999997 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866446+0000", 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081723060000000007 2024-04-17T15:40:06.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866526+0000", 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0242999999999997e-05 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866594+0000", 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8156000000000003e-05 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2731 3.25 3:a7c57b71:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:06.348 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 36.031068804, 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022381027000000001, 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2731 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262078+0000", 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8940000000000003e-06 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264600+0000", 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025222119999999998 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264637+0000", 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6875000000000002e-05 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264652+0000", 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4908e-05 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264756+0000", 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104163 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264918+0000", 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016187100000000001 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.265111+0000", 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019296999999999999 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.275063+0000", 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099523719999999993 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284321+0000", 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092580249999999996 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284399+0000", 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7761000000000003e-05 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284455+0000", 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5976000000000001e-05 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2749 3.31 3:8ffe76ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 35.823755464000001, 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019338203000000002, 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2749 2024-04-17T15:40:06.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469390+0000", 2024-04-17T15:40:06.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.402e-06 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471361+0000", 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019715980000000002 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471390+0000", 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9351000000000001e-05 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471405+0000", 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4346e-05 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471500+0000", 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4970999999999996e-05 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471683+0000", 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018349600000000001 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471860+0000", 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017656400000000001 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.479403+0000", 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075432010000000002 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488606+0000", 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092024670000000006 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488673+0000", 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7230999999999994e-05 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488725+0000", 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2575999999999999e-05 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3191 3.19 3:995acef5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.214805161999999, 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023716885, 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.359 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3191 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078341+0000", 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0269999999999997e-06 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081493+0000", 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031513700000000001 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081523+0000", 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.027e-05 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081539+0000", 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6379999999999999e-05 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081612+0000", 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2286000000000006e-05 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081757+0000", 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014521799999999999 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.362 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081891+0000", 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013438799999999999 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.089902+0000", 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080110170000000005 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.101929+0000", 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012026714000000001 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102002+0000", 2024-04-17T15:40:06.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2972999999999994e-05 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102054+0000", 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2241999999999999e-05 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3194 3.31 3:8d6d9ccc:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.169195016, 2024-04-17T15:40:06.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019551065999999999, 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3194 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123951+0000", 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6049999999999998e-06 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127418+0000", 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003467206 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127479+0000", 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1056000000000006e-05 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127509+0000", 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9796999999999999e-05 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127642+0000", 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013244400000000001 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127865+0000", 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022359999999999999 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.128070+0000", 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000204234 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.136260+0000", 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081904179999999997 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143325+0000", 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070648309999999997 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143424+0000", 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9182e-05 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143499+0000", 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4692999999999998e-05 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3214 3.1a e97/18 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head v 97'17, mlcod=96'15)", 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.915953419999999, 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019376285, 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377191+0000", 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6449999999999999e-06 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383962+0000", 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067710490000000003 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383992+0000", 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9745000000000001e-05 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384007+0000", 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5573000000000002e-05 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384103+0000", 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5511000000000001e-05 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384130+0000", 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7755000000000001e-05 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396497+0000", 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012366769999999999 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396565+0000", 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8237000000000004e-05 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.373 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3246 3.25 3:a59a480d:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.535951947999999, 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020455952999999999, 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3246 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.374 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757194+0000", 2024-04-17T15:40:06.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0000000000000001e-06 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760651+0000", 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034570289999999999 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760693+0000", 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2763999999999999e-05 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760716+0000", 2024-04-17T15:40:06.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2467e-05 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760894+0000", 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000177775 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761181+0000", 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028763399999999999 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761473+0000", 2024-04-17T15:40:06.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029150999999999998 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.772290+0000", 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010816698 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777506+0000", 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052165019999999996 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777587+0000", 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1228000000000002e-05 2024-04-17T15:40:06.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777647+0000", 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9345999999999997e-05 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3292 3.19 3:9a68834c:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.964261368000001, 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018305169999999999, 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.379 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3292 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328885+0000", 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4939999999999999e-06 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331134+0000", 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022493460000000002 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331171+0000", 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7119000000000002e-05 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331188+0000", 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7252e-05 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331289+0000", 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100369 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331483+0000", 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000194286 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.382 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331665+0000", 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018169099999999999 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.341800+0000", 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0101356 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347049+0000", 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052490499999999999 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347125+0000", 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5731999999999999e-05 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347186+0000", 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1230999999999997e-05 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3327 3.25 3:a5e282f6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_262:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:06.384 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.666879671, 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018341494, 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3327 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626267+0000", 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628501+0000", 2024-04-17T15:40:06.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339870000000002 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628532+0000", 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1730000000000003e-05 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628545+0000", 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3176999999999999e-05 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628614+0000", 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8384000000000001e-05 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628732+0000", 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117927 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628864+0000", 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013266600000000001 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.641855+0000", 2024-04-17T15:40:06.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012990431 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644472+0000", 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026173619999999998 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644543+0000", 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1144999999999997e-05 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644604+0000", 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1068999999999994e-05 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3355 3.4 3:2266acf0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 12.343602238000001, 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021132874999999999, 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.390 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3355 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949543+0000", 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8720000000000002e-06 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951012+0000", 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014686160000000001 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951044+0000", 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1951e-05 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951056+0000", 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2502e-05 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951139+0000", 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3190999999999997e-05 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951312+0000", 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017254799999999999 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951475+0000", 2024-04-17T15:40:06.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016339800000000001 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.956582+0000", 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051069840000000002 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970578+0000", 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013995914999999999 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970625+0000", 2024-04-17T15:40:06.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6487999999999999e-05 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970673+0000", 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8409999999999999e-05 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.395 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:06.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:40:06.397 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:06.396+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.4 to 1 (10000) 2024-04-17T15:40:06.423 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:40:06.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-17T15:40:06.536 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:06.536+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:06.544 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:06.545 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:06.545 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:06.545 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:06.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:40:06.604 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:06.604+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:06.699 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:06.700+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:06.726 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:06.726 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:06.726 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:06.726 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:06.726 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:06.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:40:06.827 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:06.828+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:06.901 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:06.901+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.625215793999999, 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:40:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.494756408000001, 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:40:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:40:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.400118075999998, 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:40:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:40:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:40:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.380661637000003, 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.194166425999995, 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:40:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:40:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:40:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2655 3.3b e89/18 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head v 89'7, mlcod=76'5)", 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.979656122000002, 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022625060999999998, 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5600000000000004e-07 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.937998+0000", 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059469739999999998 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938039+0000", 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0113e-05 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938062+0000", 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3807000000000001e-05 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938236+0000", 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403500000000001 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938303+0000", 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6190000000000002e-05 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954503+0000", 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016200763999999999 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954676+0000", 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017232200000000001 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2656 3.16 3:6ad2ad56:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.96047282, 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022969676000000001, 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2656 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951237+0000", 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.264e-06 2024-04-17T15:40:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956406+0000", 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051685460000000004 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956439+0000", 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2959000000000001e-05 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956456+0000", 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7217000000000001e-05 2024-04-17T15:40:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956609+0000", 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015330899999999999 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956880+0000", 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027084100000000002 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.957130+0000", 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025006900000000001 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.966230+0000", 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009099434 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974022+0000", 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077925549999999996 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974126+0000", 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103706 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974204+0000", 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7775999999999995e-05 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2664 3.21 3:84c31c70:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.763540912000003, 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019486428, 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2664 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148169+0000", 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0070000000000002e-06 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151347+0000", 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031786599999999998 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151397+0000", 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9317000000000002e-05 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151417+0000", 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.012e-05 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151540+0000", 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012354900000000001 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151802+0000", 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026111400000000001 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151955+0000", 2024-04-17T15:40:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015302 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.159770+0000", 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078157350000000007 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167530+0000", 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077592989999999999 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167595+0000", 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5320999999999993e-05 2024-04-17T15:40:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167652+0000", 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7286e-05 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2689 3.2d e89/18 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head v 89'5, mlcod=77'3)", 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.206075497999997, 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023548848000000001, 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705634+0000", 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0929999999999999e-06 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711102+0000", 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054679810000000002 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711146+0000", 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3940000000000003e-05 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711170+0000", 2024-04-17T15:40:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4283000000000001e-05 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711304+0000", 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013349999999999999 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711341+0000", 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6803e-05 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729020+0000", 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017679553000000001 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729180+0000", 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015969500000000001 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3161 3.2e 3:77c0c5b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.211803288, 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018746992000000001, 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3161 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699907+0000", 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3390000000000001e-06 2024-04-17T15:40:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702202+0000", 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022948840000000001 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702230+0000", 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8513999999999998e-05 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702241+0000", 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1083999999999999e-05 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702340+0000", 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8443000000000006e-05 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702543+0000", 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020311 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702723+0000", 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000180235 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.714838+0000", 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012114583 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718506+0000", 2024-04-17T15:40:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036683530000000001 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718587+0000", 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1254999999999994e-05 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718650+0000", 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3192000000000001e-05 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3174 3.21 3:84a9f215:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.069826111999999, 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018361252000000002, 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3174 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841884+0000", 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2490000000000001e-06 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844049+0000", 2024-04-17T15:40:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021650620000000001 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844073+0000", 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3893999999999999e-05 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844085+0000", 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1963e-05 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844179+0000", 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4195000000000002e-05 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844385+0000", 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206331 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844583+0000", 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019758899999999999 2024-04-17T15:40:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.857179+0000", 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012595705 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860113+0000", 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029346950000000002 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860184+0000", 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0852999999999994e-05 2024-04-17T15:40:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860242+0000", 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7716000000000001e-05 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3188 3.2f 3:f4860977:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.899530178999999, 2024-04-17T15:40:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019398723999999999, 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3188 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012181+0000", 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4129999999999999e-06 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014461+0000", 2024-04-17T15:40:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022799539999999998 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014506+0000", 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5529999999999999e-05 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014526+0000", 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9542999999999999e-05 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014635+0000", 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010869700000000001 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014813+0000", 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178128 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.015010+0000", 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000197111 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.023029+0000", 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080189619999999993 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031512+0000", 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084828179999999996 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031549+0000", 2024-04-17T15:40:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6944999999999999e-05 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031575+0000", 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6622999999999999e-05 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3195 3.16 3:6892fdae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.764855939, 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021725749999999999, 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3195 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146855+0000", 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8800000000000001e-06 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150499+0000", 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036446019999999998 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150530+0000", 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1099999999999997e-05 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150543+0000", 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2847000000000001e-05 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150617+0000", 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4294000000000004e-05 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150741+0000", 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123731 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150854+0000", 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:40:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.157302+0000", 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064475870000000003 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168431+0000", 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011129847 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168516+0000", 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4331000000000003e-05 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168577+0000", 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0785999999999997e-05 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3215 3.16 3:69d29e25:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.529841888, 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020347908000000001, 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3215 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381869+0000", 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8070000000000001e-06 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384172+0000", 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002302957 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384202+0000", 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0704000000000003e-05 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384216+0000", 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3376e-05 2024-04-17T15:40:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384299+0000", 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3622000000000007e-05 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384481+0000", 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182086 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384646+0000", 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016434199999999999 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396642+0000", 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011996079 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402122+0000", 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054798360000000001 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402169+0000", 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7664000000000003e-05 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402213+0000", 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3435e-05 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3232 3.2e 3:77f4f650:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.335029344000001, 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020894309, 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3232 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576681+0000", 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3060000000000002e-06 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578598+0000", 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001917799 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578637+0000", 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8884000000000002e-05 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578654+0000", 2024-04-17T15:40:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6578999999999998e-05 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578752+0000", 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8412000000000006e-05 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578884+0000", 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131359 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.579029+0000", 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014510799999999999 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.584890+0000", 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058607679999999997 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597433+0000", 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012543642000000001 2024-04-17T15:40:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597513+0000", 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9538999999999999e-05 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597572+0000", 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8913000000000003e-05 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3243 3.21 3:86efebb2:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.202910194999999, 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018171970999999999, 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3243 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708799+0000", 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711223+0000", 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024239690000000002 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711252+0000", 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9176999999999999e-05 2024-04-17T15:40:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711263+0000", 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1269e-05 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711334+0000", 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0891999999999998e-05 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711467+0000", 2024-04-17T15:40:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133306 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711580+0000", 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112734 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.719664+0000", 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080840129999999993 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726888+0000", 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072236660000000001 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726932+0000", 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4709000000000002e-05 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726968+0000", 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6109000000000003e-05 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3245 3.24 3:26e56b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.171221486, 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020901084, 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3245 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740501+0000", 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5823000000000001e-05 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742689+0000", 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021879009999999999 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742737+0000", 2024-04-17T15:40:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8519000000000001e-05 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742759+0000", 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.173e-05 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742848+0000", 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9116000000000005e-05 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743031+0000", 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018237599999999999 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743192+0000", 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000161461 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.749847+0000", 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066546610000000001 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761259+0000", 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011411813999999999 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761330+0000", 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1481000000000002e-05 2024-04-17T15:40:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761386+0000", 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6202000000000002e-05 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3254 3.21 3:86770de1:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.04766364, 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022547540000000001, 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3254 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864046+0000", 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.004e-06 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865763+0000", 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017173360000000001 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865809+0000", 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5519999999999998e-05 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865827+0000", 2024-04-17T15:40:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7716000000000001e-05 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865933+0000", 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010629 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866093+0000", 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000159946 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866220+0000", 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127164 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.873221+0000", 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070009570000000004 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886373+0000", 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013151891000000001 2024-04-17T15:40:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886502+0000", 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012948500000000001 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886591+0000", 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8231000000000003e-05 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3264 3.24 3:26cd557b:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.901976025, 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020478857, 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3264 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009734+0000", 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011450+0000", 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017157369999999999 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011475+0000", 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5151999999999999e-05 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011488+0000", 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3740000000000001e-05 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011581+0000", 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.255e-05 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011705+0000", 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012390900000000001 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011811+0000", 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106111 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.019611+0000", 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077997359999999998 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030126+0000", 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010514977999999999 2024-04-17T15:40:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030173+0000", 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7451999999999999e-05 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030210+0000", 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6294000000000002e-05 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3343 3.16 3:6ae5c866:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_278:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 13.101162653999999, 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019911570999999999, 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3343 2024-04-17T15:40:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810546+0000", 2024-04-17T15:40:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.357e-06 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812931+0000", 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023841180000000002 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812960+0000", 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9677999999999999e-05 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812971+0000", 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1259e-05 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813071+0000", 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9406000000000003e-05 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813247+0000", 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000176429 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813415+0000", 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016733000000000001 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.824091+0000", 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010676296 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830354+0000", 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006263294 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830402+0000", 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8155999999999998e-05 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830456+0000", 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3248000000000002e-05 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.027 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:07.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:40:07.030 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:07.029+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:07.130 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:07.129+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:07.207 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:07.207 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:07.207 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:07.208 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:07.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:40:07.231 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:07.229+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:07.331 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:07.332+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:07.351 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:07.351 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:07.351 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:07.351 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:07.351 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:07.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:40:07.437 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.5 to 1 (10000) 2024-04-17T15:40:07.437 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:07.436+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:07.461 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-17T15:40:07.533 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:07.533+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:07.545 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 75.416359954000001, 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 75.404584033999996, 2024-04-17T15:40:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.962840361000005, 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:40:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:40:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:40:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.836196396999995, 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:40:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:40:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:40:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2276 3.2 3:413eb100:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 74.614224530000001, 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020329113999999999, 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2276 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931295+0000", 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6189999999999998e-06 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936287+0000", 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049920559999999999 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936310+0000", 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3538000000000001e-05 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936322+0000", 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1739000000000001e-05 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936395+0000", 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2521000000000006e-05 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936512+0000", 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117872 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936622+0000", 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010926599999999999 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942455+0000", 2024-04-17T15:40:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058337099999999998 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951496+0000", 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090407899999999999 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951571+0000", 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4361000000000002e-05 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951621+0000", 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0642000000000001e-05 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2646 3.8 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 38.810951645999999, 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025266311, 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2646 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734569+0000", 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739260+0000", 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046916730000000004 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739303+0000", 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2799000000000001e-05 2024-04-17T15:40:07.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739322+0000", 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8389999999999998e-05 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739489+0000", 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167016 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739896+0000", 2024-04-17T15:40:07.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040707699999999999 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740309+0000", 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041348699999999998 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.754426+0000", 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014117002 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759750+0000", 2024-04-17T15:40:07.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053237900000000001 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759800+0000", 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0405000000000003e-05 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759831+0000", 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0861999999999997e-05 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2688 3.18 3:1b829d89:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.861716049000002, 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023433995999999999, 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2688 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683806+0000", 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2000000000000002e-06 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688730+0000", 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049237680000000002 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688789+0000", 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9469999999999998e-05 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688813+0000", 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4253e-05 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688955+0000", 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014158899999999999 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689247+0000", 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029219100000000002 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689484+0000", 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023730499999999999 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705954+0000", 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016469461000000001 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707072+0000", 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001118427 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707163+0000", 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1199999999999994e-05 2024-04-17T15:40:07.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707235+0000", 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1131999999999996e-05 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2737 3.8 3:1044985e:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.211524742999998, 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024601553000000002, 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.584 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2737 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333996+0000", 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8929999999999998e-06 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335595+0000", 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015994550000000001 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335629+0000", 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335645+0000", 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6597999999999999e-05 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335729+0000", 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3633000000000004e-05 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op must wait for map", 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335735+0000", 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339342+0000", 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036071340000000001 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339550+0000", 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020780199999999999 2024-04-17T15:40:07.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339728+0000", 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178734 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354941+0000", 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015212356 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358485+0000", 2024-04-17T15:40:07.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035443250000000001 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358544+0000", 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8888000000000003e-05 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358593+0000", 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9557e-05 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2736 3.5 e90/18 3:a18cd429:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_91:head v 90'5, mlcod=76'3)", 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 37.209784564000003, 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020182848, 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335733+0000", 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5799999999999999e-07 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339776+0000", 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040432940000000002 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339787+0000", 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0671e-05 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339795+0000", 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0639999999999994e-06 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339845+0000", 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0086000000000001e-05 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339891+0000", 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5849000000000001e-05 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.355857+0000", 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015966774999999999 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.355915+0000", 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7451000000000003e-05 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.594 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2757 3.7 3:e214b53f:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 36.981141805999997, 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020206643999999999, 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2757 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.595 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564377+0000", 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2510000000000001e-06 2024-04-17T15:40:07.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566069+0000", 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001691981 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566102+0000", 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3061000000000001e-05 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566118+0000", 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6045999999999998e-05 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566256+0000", 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137527 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566449+0000", 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019308500000000001 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566611+0000", 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016235500000000001 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.573412+0000", 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068006849999999999 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584453+0000", 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011041146 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584525+0000", 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2512e-05 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584581+0000", 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5995000000000002e-05 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3200 3.33 3:cc4ca667:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.328190641000001, 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020688749999999999, 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3200 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217328+0000", 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6920000000000001e-06 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219299+0000", 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019712150000000001 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219323+0000", 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4076000000000001e-05 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219337+0000", 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3767e-05 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219426+0000", 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9279999999999999e-05 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219636+0000", 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021027400000000001 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219804+0000", 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167629 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.228577+0000", 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0087731679999999996 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.237862+0000", 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092845170000000008 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.237943+0000", 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1642000000000002e-05 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.238015+0000", 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1489999999999995e-05 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3208 3.1e 3:7bf3f1fd:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.605 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 15.239803329000001, 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024643996000000001, 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3208 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305716+0000", 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8609999999999998e-06 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307655+0000", 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001938546 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307680+0000", 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5238000000000001e-05 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307695+0000", 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5133000000000001e-05 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307786+0000", 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0728000000000003e-05 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307955+0000", 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016871400000000001 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.308078+0000", 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012391 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.317113+0000", 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090349109999999996 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330212+0000", 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013098344 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330292+0000", 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0183000000000001e-05 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330357+0000", 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5427999999999998e-05 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3237 3.33 3:cc5684ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.914568394, 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022846793000000001, 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3237 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630950+0000", 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7039999999999999e-06 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632791+0000", 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018406119999999999 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632820+0000", 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9380999999999999e-05 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632834+0000", 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4345000000000001e-05 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632926+0000", 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2145999999999995e-05 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633056+0000", 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012976700000000001 2024-04-17T15:40:07.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633198+0000", 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000141342 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.639250+0000", 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006052605 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653695+0000", 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014444988000000001 2024-04-17T15:40:07.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653741+0000", 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5556000000000002e-05 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653795+0000", 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4347e-05 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.616 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3242 3.33 3:cc808c01:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.849948266, 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020918729, 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3242 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695572+0000", 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5769999999999998e-06 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697488+0000", 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001916189 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697516+0000", 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8093999999999999e-05 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697529+0000", 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3158e-05 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697639+0000", 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109227 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697845+0000", 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206226 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.698025+0000", 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179987 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.705449+0000", 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.007424445 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716350+0000", 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010900734 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716426+0000", 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5622000000000002e-05 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.621 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716487+0000", 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1470000000000006e-05 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3250 3.7 3:e148f750:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.728233611, 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021674067000000002, 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3250 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817288+0000", 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7299999999999996e-06 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820832+0000", 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035441740000000002 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820870+0000", 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7565999999999999e-05 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820885+0000", 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5132e-05 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821009+0000", 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124475 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821146+0000", 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013711600000000001 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821247+0000", 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010072400000000001 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.827312+0000", 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060654389999999997 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838765+0000", 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011452208 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838888+0000", 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123771 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838957+0000", 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8732000000000005e-05 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.627 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3252 3.2 3:40c9ca30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.708741773, 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022557901000000002, 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3252 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836777+0000", 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4949999999999998e-06 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843566+0000", 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067891239999999997 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843599+0000", 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2002999999999998e-05 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843614+0000", 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5957e-05 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843705+0000", 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0276000000000001e-05 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843902+0000", 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019734200000000001 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.844063+0000", 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160512 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.854965+0000", 2024-04-17T15:40:07.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010902593 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859208+0000", 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0042428580000000004 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859279+0000", 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0858000000000005e-05 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859333+0000", 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3882999999999999e-05 2024-04-17T15:40:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3257 3.29 3:97b19dae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.632909347, 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021952833000000001, 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3257 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.633 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912611+0000", 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0330000000000002e-06 2024-04-17T15:40:07.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916649+0000", 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040378489999999996 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916685+0000", 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5646999999999999e-05 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916701+0000", 2024-04-17T15:40:07.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6328e-05 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916812+0000", 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011056 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917015+0000", 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020336400000000001 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:07.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917200+0000", 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018441900000000001 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.926337+0000", 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091371060000000007 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934459+0000", 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081220489999999992 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934506+0000", 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7534999999999998e-05 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934560+0000", 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3943000000000002e-05 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3259 3.29 3:97b435f0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.638 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.599627848000001, 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021828215000000002, 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3259 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:07.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945892+0000", 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9679999999999998e-06 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.947986+0000", 2024-04-17T15:40:07.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020939650000000001 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948032+0000", 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6180999999999997e-05 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948055+0000", 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3031999999999999e-05 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948167+0000", 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011191700000000001 2024-04-17T15:40:07.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948370+0000", 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020330599999999999 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948569+0000", 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019869199999999999 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.956337+0000", 2024-04-17T15:40:07.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077678039999999997 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967491+0000", 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011154393 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967620+0000", 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012935299999999999 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967717+0000", 2024-04-17T15:40:07.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6603999999999999e-05 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3274 3.38 3:1c6c0b46:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.412469395, 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020992581999999999, 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.644 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3274 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133050+0000", 2024-04-17T15:40:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.88e-06 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135292+0000", 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022414240000000001 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135324+0000", 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000002e-05 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135342+0000", 2024-04-17T15:40:07.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8808e-05 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135460+0000", 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118107 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135621+0000", 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016069599999999999 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135814+0000", 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000192793 2024-04-17T15:40:07.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.142834+0000", 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070204389999999998 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.153823+0000", 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010988639999999999 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.153932+0000", 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010886400000000001 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.154040+0000", 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107951 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3297 3.2 3:4392bec4:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 14.157329108000001, 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020524942000000001, 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:07.649 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3297 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388191+0000", 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2009999999999999e-06 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390093+0000", 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019019110000000001 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390128+0000", 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5043000000000003e-05 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390143+0000", 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5319999999999999e-05 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390237+0000", 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4327000000000007e-05 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390421+0000", 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018346500000000001 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390590+0000", 2024-04-17T15:40:07.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169257 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.397780+0000", 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071894719999999997 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408577+0000", 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010797899999999999 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408651+0000", 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3208999999999997e-05 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:07.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408712+0000", 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1836999999999998e-05 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:07.654 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:07.656 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:40:07.656 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:07.656+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:07.756 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:07.757+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:07.792 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:07.792 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:07.792 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:40:07.792 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:07.807 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:40:07.857 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:07.856+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:07.958 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:07.957+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:07.979 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:07.979 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:07.979 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:40:07.979 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:40:07.979 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:07.993 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:40:08.079 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:08.081+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:08.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:40:08.159 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:08.156+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:08.165 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:08.165 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.343704973000001, 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.166 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.189527217000006, 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.175 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.177190723999999, 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.176 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:40:08.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:40:08.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.096153931999993, 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 75.539675068999998, 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.187 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:08.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:40:08.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:40:08.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.192 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 75.526217158999998, 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:40:08.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:40:08.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2701 3.3 3:c3da646c:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.250158128000002, 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023302740999999998, 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.197 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2701 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:40:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916003+0000", 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919735+0000", 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037320090000000001 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919758+0000", 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3213e-05 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919769+0000", 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0692e-05 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919848+0000", 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9340999999999998e-05 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.920004+0000", 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015543600000000001 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.920144+0000", 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140242 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.928075+0000", 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079310189999999992 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939200+0000", 2024-04-17T15:40:08.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011125245000000001 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939256+0000", 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6320000000000003e-05 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939302+0000", 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6026000000000003e-05 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.202 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2743 3.34 3:2f634024:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.761471966000002, 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025426936000000001, 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2743 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404706+0000", 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9983000000000002e-05 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408933+0000", 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042273040000000003 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408972+0000", 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8495000000000003e-05 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408990+0000", 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8219999999999998e-05 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.409170+0000", 2024-04-17T15:40:08.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018019600000000001 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.409592+0000", 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042226600000000003 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410018+0000", 2024-04-17T15:40:08.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042519299999999998 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.428938+0000", 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018920248000000001 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430015+0000", 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001077103 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430067+0000", 2024-04-17T15:40:08.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2494000000000003e-05 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430113+0000", 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5433999999999999e-05 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2754 3.3 3:c015b210:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.644119132, 2024-04-17T15:40:08.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022904342000000001, 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2754 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522043+0000", 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8160000000000004e-06 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527193+0000", 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051507990000000002 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527235+0000", 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1306000000000001e-05 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527257+0000", 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2855999999999999e-05 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527445+0000", 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018744200000000001 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527846+0000", 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040134300000000002 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.528089+0000", 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024270800000000001 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.537308+0000", 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092189520000000007 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544773+0000", 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074648049999999997 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544869+0000", 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6643000000000003e-05 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544943+0000", 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3671999999999995e-05 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2762 3.1 e90/18 3:82c647bc:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_117:head v 90'7, mlcod=89'5)", 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 37.539104064, 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023406844999999999, 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:40:08.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627056+0000", 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5129999999999999e-06 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631125+0000", 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040686120000000001 2024-04-17T15:40:08.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631161+0000", 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6239000000000003e-05 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631178+0000", 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6779999999999999e-05 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631336+0000", 2024-04-17T15:40:08.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158379 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631401+0000", 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4331999999999993e-05 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.650306+0000", 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018905511 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.650461+0000", 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015447900000000001 2024-04-17T15:40:08.217 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3214 3.1a 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.795663960000001, 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026716791, 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.218 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3214 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370497+0000", 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.394e-06 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375507+0000", 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050097060000000001 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375549+0000", 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2076000000000002e-05 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375568+0000", 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8623000000000001e-05 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375747+0000", 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017887900000000001 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.376173+0000", 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042638600000000001 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.376641+0000", 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046769599999999998 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.387458+0000", 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010817069 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397008+0000", 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095501070000000004 2024-04-17T15:40:08.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397134+0000", 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125986 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397211+0000", 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6868999999999999e-05 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3248 3.14 3:2bd8a3aa:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:08.223 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.372491189, 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036059802000000002, 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3248 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793670+0000", 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-06 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800168+0000", 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064981429999999996 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800211+0000", 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2647e-05 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800231+0000", 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0075999999999999e-05 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800418+0000", 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000187095 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800689+0000", 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027156800000000003 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800937+0000", 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024735799999999999 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.821838+0000", 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020901405000000001 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829564+0000", 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077253900000000004 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829656+0000", 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2461999999999997e-05 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829726+0000", 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0388000000000004e-05 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3266 3.14 3:2a47ad18:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.034134+0000", 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.132024133, 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023433829, 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3266 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.034134+0000", 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.034134+0000", 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.034137+0000", 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-06 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038047+0000", 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039095930000000003 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038086+0000", 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9409999999999997e-05 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038103+0000", 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246000000000001e-05 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038288+0000", 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018491199999999999 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038737+0000", 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044811900000000002 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.039165+0000", 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000428186 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.050945+0000", 2024-04-17T15:40:08.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011780778 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.057211+0000", 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0062658089999999998 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.057407+0000", 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019612199999999999 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.057568+0000", 2024-04-17T15:40:08.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016011399999999999 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3278 3.9 3:901d1baf:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.987774869999999, 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036045059999999997, 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.234 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3278 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178386+0000", 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2499999999999998e-06 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182939+0000", 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045523370000000001 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182973+0000", 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4164e-05 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182990+0000", 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7770000000000001e-05 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.183166+0000", 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175348 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.183580+0000", 2024-04-17T15:40:08.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041376999999999999 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.184017+0000", 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043735900000000001 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.206149+0000", 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022131980999999998 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214134+0000", 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079846440000000008 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214289+0000", 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015586899999999999 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214428+0000", 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013856799999999999 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3279 3.14 3:2b0d2ba5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.977971725, 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025537218, 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3279 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188189+0000", 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9799999999999998e-06 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193213+0000", 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050239400000000002 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193256+0000", 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3336e-05 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193281+0000", 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4983000000000001e-05 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193487+0000", 2024-04-17T15:40:08.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020554500000000001 2024-04-17T15:40:08.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193759+0000", 2024-04-17T15:40:08.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027231400000000001 2024-04-17T15:40:08.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193995+0000", 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023626800000000001 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.212099+0000", 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018103668999999999 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213400+0000", 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001301202 2024-04-17T15:40:08.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213593+0000", 2024-04-17T15:40:08.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019239600000000001 2024-04-17T15:40:08.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213723+0000", 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013058500000000001 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3284 3.14 3:2971c8f6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.922044314000001, 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025723386000000001, 2024-04-17T15:40:08.246 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3284 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244117+0000", 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.224e-06 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247174+0000", 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003057649 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247230+0000", 2024-04-17T15:40:08.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5232999999999998e-05 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247258+0000", 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8232999999999999e-05 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247439+0000", 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000180812 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247896+0000", 2024-04-17T15:40:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045720999999999999 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.248348+0000", 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045195599999999999 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.266345+0000", 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017997658999999999 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269169+0000", 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028231300000000001 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269701+0000", 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053260500000000001 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269837+0000", 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135675 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3285 3.34 3:2f312a35:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:08.251 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.912325502, 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026478687000000001, 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3285 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253835+0000", 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258650+0000", 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048142410000000004 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258685+0000", 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4953999999999998e-05 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258711+0000", 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258974+0000", 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026291699999999999 2024-04-17T15:40:08.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.259347+0000", 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037358699999999999 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.259801+0000", 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045420600000000002 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.272624+0000", 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012822452 2024-04-17T15:40:08.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280003+0000", 2024-04-17T15:40:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073793620000000004 2024-04-17T15:40:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280180+0000", 2024-04-17T15:40:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000177319 2024-04-17T15:40:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280311+0000", 2024-04-17T15:40:08.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013058899999999999 2024-04-17T15:40:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3360 3.1b e98/18 3:d899093f:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_295:head v 98'17, mlcod=96'15)", 2024-04-17T15:40:08.258 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.155613117, 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028203004, 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010546+0000", 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9299999999999996e-07 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017091+0000", 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065455590000000003 2024-04-17T15:40:08.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017123+0000", 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.146e-05 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017148+0000", 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.514e-05 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017349+0000", 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200931 2024-04-17T15:40:08.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017410+0000", 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1489999999999996e-05 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038631+0000", 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021220645 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038748+0000", 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011688600000000001 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3359 3.2c e98/18 3:35140f57:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_294:head v 98'12, mlcod=97'10)", 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.154169437, 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026019891, 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011990+0000", 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.19e-06 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015476+0000", 2024-04-17T15:40:08.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034868260000000002 2024-04-17T15:40:08.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015505+0000", 2024-04-17T15:40:08.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9030000000000002e-05 2024-04-17T15:40:08.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015523+0000", 2024-04-17T15:40:08.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7520000000000002e-05 2024-04-17T15:40:08.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015719+0000", 2024-04-17T15:40:08.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019590499999999999 2024-04-17T15:40:08.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015785+0000", 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5988999999999994e-05 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.037812+0000", 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022027409000000001 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038008+0000", 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019602199999999999 2024-04-17T15:40:08.268 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3366 3.14 3:2bff8300:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_301:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.077544+0000", 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.088613626000001, 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023061773000000001, 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:08.269 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3366 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.077544+0000", 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.077544+0000", 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.077548+0000", 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.782e-06 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083215+0000", 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056673449999999998 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:08.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083251+0000", 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5945000000000002e-05 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083268+0000", 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816999999999998e-05 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083404+0000", 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135513 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:08.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083732+0000", 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000328437 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.084071+0000", 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033846000000000001 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.094453+0000", 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010382103 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.100287+0000", 2024-04-17T15:40:08.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058344599999999996 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.100475+0000", 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000187698 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.100606+0000", 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013121300000000001 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.274 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.275 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:08.275 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:08.275 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:08.275 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:08.276 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:08.277 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:08.277 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:08.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:40:08.278 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:08.276+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:08.288 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:08.288 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:08.306 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:08.306 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:08.327 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:08.328 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:08.347 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:08.347 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:08.365 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:08.366 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:08.377 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:08.377+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:08.385 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:08.386 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:08.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:40:08.450 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.6 to 1 (10000) 2024-04-17T15:40:08.457 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:08.458 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:08.472 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:40:08.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-17T15:40:08.515 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:08.517+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:08.578 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:08.577+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:08.643 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:08.643 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:08.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:40:08.700 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:08.701+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:08.779 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:08.781+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:08.828 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:08.828 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:08.843 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:40:08.887 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:08.889+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:08.981 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:08.981+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:09.014 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:09.014 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:09.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:40:09.081 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:09.080+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:09.182 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:09.181+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:09.200 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:09.200 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:09.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:40:09.303 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:09.305+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:09.384 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:09.384+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:09.388 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:09.388 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:09.403 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:40:09.452 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:40:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.7 to 1 (10000) 2024-04-17T15:40:09.485 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:09.484+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:09.491 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-17T15:40:09.491 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:40:09.577 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:09.577 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:09.585 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:09.585+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:09.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:40:09.686 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:09.685+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:09.760 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:09.760 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:09.774 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:40:09.815 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:09.817+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:09.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:40:09.867 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:40:09.880 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-17T15:40:09.457193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4207737608,"num_objects":1203,"num_object_clones":0,"num_object_copies":2406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1203,"num_whiteouts":0,"num_read":3070,"num_read_kb":2766,"num_write":2270,"num_write_kb":4139780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3186,"ondisk_log_size":3186,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8477656,"kb_used_data":8228168,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":746497064,"statfs":{"total":773094113280,"available":764412993536,"internally_reserved":0,"allocated":8425644032,"data_stored":8421209420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.042849"},"pg_stats":[{"pgid":"3.3f","version":"97'13","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770881+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:40:05.770881+0000","last_peered":"2024-04-17T15:40:05.770881+0000","last_clean":"2024-04-17T15:40:05.770881+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:40:05.770881+0000","last_undegraded":"2024-04-17T15:40:05.770881+0000","last_fullsized":"2024-04-17T15:40:05.770881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771691+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:40:05.771691+0000","last_peered":"2024-04-17T15:40:05.771691+0000","last_clean":"2024-04-17T15:40:05.771691+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:40:05.771691+0000","last_undegraded":"2024-04-17T15:40:05.771691+0000","last_fullsized":"2024-04-17T15:40:05.771691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"98'18","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421941+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:40:05.421941+0000","last_peered":"2024-04-17T15:40:05.421941+0000","last_clean":"2024-04-17T15:40:05.421941+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:40:05.421941+0000","last_undegraded":"2024-04-17T15:40:05.421941+0000","last_fullsized":"2024-04-17T15:40:05.421941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768350+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:40:05.768350+0000","last_peered":"2024-04-17T15:40:05.768350+0000","last_clean":"2024-04-17T15:40:05.768350+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:40:05.768350+0000","last_undegraded":"2024-04-17T15:40:05.768350+0000","last_fullsized":"2024-04-17T15:40:05.768350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"98'14","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768586+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:40:05.768586+0000","last_peered":"2024-04-17T15:40:05.768586+0000","last_clean":"2024-04-17T15:40:05.768586+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:40:05.768586+0000","last_undegraded":"2024-04-17T15:40:05.768586+0000","last_fullsized":"2024-04-17T15:40:05.768586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417762+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:40:05.417762+0000","last_peered":"2024-04-17T15:40:05.417762+0000","last_clean":"2024-04-17T15:40:05.417762+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:40:05.417762+0000","last_undegraded":"2024-04-17T15:40:05.417762+0000","last_fullsized":"2024-04-17T15:40:05.417762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"97'11","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771215+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:40:05.771215+0000","last_peered":"2024-04-17T15:40:05.771215+0000","last_clean":"2024-04-17T15:40:05.771215+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:40:05.771215+0000","last_undegraded":"2024-04-17T15:40:05.771215+0000","last_fullsized":"2024-04-17T15:40:05.771215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":210,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766461+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:40:05.766461+0000","last_peered":"2024-04-17T15:40:05.766461+0000","last_clean":"2024-04-17T15:40:05.766461+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:40:05.766461+0000","last_undegraded":"2024-04-17T15:40:05.766461+0000","last_fullsized":"2024-04-17T15:40:05.766461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"98'19","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772478+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:40:05.772478+0000","last_peered":"2024-04-17T15:40:05.772478+0000","last_clean":"2024-04-17T15:40:05.772478+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:40:05.772478+0000","last_undegraded":"2024-04-17T15:40:05.772478+0000","last_fullsized":"2024-04-17T15:40:05.772478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768687+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:40:05.768687+0000","last_peered":"2024-04-17T15:40:05.768687+0000","last_clean":"2024-04-17T15:40:05.768687+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:40:05.768687+0000","last_undegraded":"2024-04-17T15:40:05.768687+0000","last_fullsized":"2024-04-17T15:40:05.768687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"98'12","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774814+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:40:05.774814+0000","last_peered":"2024-04-17T15:40:05.774814+0000","last_clean":"2024-04-17T15:40:05.774814+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:40:05.774814+0000","last_undegraded":"2024-04-17T15:40:05.774814+0000","last_fullsized":"2024-04-17T15:40:05.774814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418960+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:40:05.418960+0000","last_peered":"2024-04-17T15:40:05.418960+0000","last_clean":"2024-04-17T15:40:05.418960+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:40:05.418960+0000","last_undegraded":"2024-04-17T15:40:05.418960+0000","last_fullsized":"2024-04-17T15:40:05.418960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"98'13","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768921+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:40:05.768921+0000","last_peered":"2024-04-17T15:40:05.768921+0000","last_clean":"2024-04-17T15:40:05.768921+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:40:05.768921+0000","last_undegraded":"2024-04-17T15:40:05.768921+0000","last_fullsized":"2024-04-17T15:40:05.768921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771150+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:40:05.771150+0000","last_peered":"2024-04-17T15:40:05.771150+0000","last_clean":"2024-04-17T15:40:05.771150+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:40:05.771150+0000","last_undegraded":"2024-04-17T15:40:05.771150+0000","last_fullsized":"2024-04-17T15:40:05.771150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"98'17","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769551+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:40:05.769551+0000","last_peered":"2024-04-17T15:40:05.769551+0000","last_clean":"2024-04-17T15:40:05.769551+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:40:05.769551+0000","last_undegraded":"2024-04-17T15:40:05.769551+0000","last_fullsized":"2024-04-17T15:40:05.769551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418141+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:40:05.418141+0000","last_peered":"2024-04-17T15:40:05.418141+0000","last_clean":"2024-04-17T15:40:05.418141+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:40:05.418141+0000","last_undegraded":"2024-04-17T15:40:05.418141+0000","last_fullsized":"2024-04-17T15:40:05.418141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"72'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417537+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:40:05.417537+0000","last_peered":"2024-04-17T15:40:05.417537+0000","last_clean":"2024-04-17T15:40:05.417537+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:40:05.417537+0000","last_undegraded":"2024-04-17T15:40:05.417537+0000","last_fullsized":"2024-04-17T15:40:05.417537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"98'11","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771162+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:40:05.771162+0000","last_peered":"2024-04-17T15:40:05.771162+0000","last_clean":"2024-04-17T15:40:05.771162+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:40:05.771162+0000","last_undegraded":"2024-04-17T15:40:05.771162+0000","last_fullsized":"2024-04-17T15:40:05.771162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768647+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:40:05.768647+0000","last_peered":"2024-04-17T15:40:05.768647+0000","last_clean":"2024-04-17T15:40:05.768647+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:40:05.768647+0000","last_undegraded":"2024-04-17T15:40:05.768647+0000","last_fullsized":"2024-04-17T15:40:05.768647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"98'13","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772977+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:40:05.772977+0000","last_peered":"2024-04-17T15:40:05.772977+0000","last_clean":"2024-04-17T15:40:05.772977+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:40:05.772977+0000","last_undegraded":"2024-04-17T15:40:05.772977+0000","last_fullsized":"2024-04-17T15:40:05.772977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774948+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:40:05.774948+0000","last_peered":"2024-04-17T15:40:05.774948+0000","last_clean":"2024-04-17T15:40:05.774948+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:40:05.774948+0000","last_undegraded":"2024-04-17T15:40:05.774948+0000","last_fullsized":"2024-04-17T15:40:05.774948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"98'17","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773466+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:40:05.773466+0000","last_peered":"2024-04-17T15:40:05.773466+0000","last_clean":"2024-04-17T15:40:05.773466+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:40:05.773466+0000","last_undegraded":"2024-04-17T15:40:05.773466+0000","last_fullsized":"2024-04-17T15:40:05.773466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":237,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416692+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:40:05.416692+0000","last_peered":"2024-04-17T15:40:05.416692+0000","last_clean":"2024-04-17T15:40:05.416692+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:40:05.416692+0000","last_undegraded":"2024-04-17T15:40:05.416692+0000","last_fullsized":"2024-04-17T15:40:05.416692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"98'14","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418063+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:40:05.418063+0000","last_peered":"2024-04-17T15:40:05.418063+0000","last_clean":"2024-04-17T15:40:05.418063+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:40:05.418063+0000","last_undegraded":"2024-04-17T15:40:05.418063+0000","last_fullsized":"2024-04-17T15:40:05.418063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418092+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:40:05.418092+0000","last_peered":"2024-04-17T15:40:05.418092+0000","last_clean":"2024-04-17T15:40:05.418092+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:40:05.418092+0000","last_undegraded":"2024-04-17T15:40:05.418092+0000","last_fullsized":"2024-04-17T15:40:05.418092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"98'11","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767925+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:40:05.767925+0000","last_peered":"2024-04-17T15:40:05.767925+0000","last_clean":"2024-04-17T15:40:05.767925+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:40:05.767925+0000","last_undegraded":"2024-04-17T15:40:05.767925+0000","last_fullsized":"2024-04-17T15:40:05.767925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"73'4","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419031+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:40:05.419031+0000","last_peered":"2024-04-17T15:40:05.419031+0000","last_clean":"2024-04-17T15:40:05.419031+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:40:05.419031+0000","last_undegraded":"2024-04-17T15:40:05.419031+0000","last_fullsized":"2024-04-17T15:40:05.419031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"98'13","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766683+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:40:05.766683+0000","last_peered":"2024-04-17T15:40:05.766683+0000","last_clean":"2024-04-17T15:40:05.766683+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:40:05.766683+0000","last_undegraded":"2024-04-17T15:40:05.766683+0000","last_fullsized":"2024-04-17T15:40:05.766683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417066+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:05.417066+0000","last_peered":"2024-04-17T15:40:05.417066+0000","last_clean":"2024-04-17T15:40:05.417066+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:05.417066+0000","last_undegraded":"2024-04-17T15:40:05.417066+0000","last_fullsized":"2024-04-17T15:40:05.417066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767909+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:40:05.767909+0000","last_peered":"2024-04-17T15:40:05.767909+0000","last_clean":"2024-04-17T15:40:05.767909+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:40:05.767909+0000","last_undegraded":"2024-04-17T15:40:05.767909+0000","last_fullsized":"2024-04-17T15:40:05.767909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"98'15","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772720+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:40:05.772720+0000","last_peered":"2024-04-17T15:40:05.772720+0000","last_clean":"2024-04-17T15:40:05.772720+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:40:05.772720+0000","last_undegraded":"2024-04-17T15:40:05.772720+0000","last_fullsized":"2024-04-17T15:40:05.772720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769902+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:40:05.769902+0000","last_peered":"2024-04-17T15:40:05.769902+0000","last_clean":"2024-04-17T15:40:05.769902+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:40:05.769902+0000","last_undegraded":"2024-04-17T15:40:05.769902+0000","last_fullsized":"2024-04-17T15:40:05.769902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"98'16","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769793+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:40:05.769793+0000","last_peered":"2024-04-17T15:40:05.769793+0000","last_clean":"2024-04-17T15:40:05.769793+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:40:05.769793+0000","last_undegraded":"2024-04-17T15:40:05.769793+0000","last_fullsized":"2024-04-17T15:40:05.769793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770271+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:05.770271+0000","last_peered":"2024-04-17T15:40:05.770271+0000","last_clean":"2024-04-17T15:40:05.770271+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:05.770271+0000","last_undegraded":"2024-04-17T15:40:05.770271+0000","last_fullsized":"2024-04-17T15:40:05.770271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":227,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768798+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:05.768798+0000","last_peered":"2024-04-17T15:40:05.768798+0000","last_clean":"2024-04-17T15:40:05.768798+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:05.768798+0000","last_undegraded":"2024-04-17T15:40:05.768798+0000","last_fullsized":"2024-04-17T15:40:05.768798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":101,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771509+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:40:05.771509+0000","last_peered":"2024-04-17T15:40:05.771509+0000","last_clean":"2024-04-17T15:40:05.771509+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:40:05.771509+0000","last_undegraded":"2024-04-17T15:40:05.771509+0000","last_fullsized":"2024-04-17T15:40:05.771509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"98'11","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766714+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:40:05.766714+0000","last_peered":"2024-04-17T15:40:05.766714+0000","last_clean":"2024-04-17T15:40:05.766714+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:40:05.766714+0000","last_undegraded":"2024-04-17T15:40:05.766714+0000","last_fullsized":"2024-04-17T15:40:05.766714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767761+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:05.767761+0000","last_peered":"2024-04-17T15:40:05.767761+0000","last_clean":"2024-04-17T15:40:05.767761+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:05.767761+0000","last_undegraded":"2024-04-17T15:40:05.767761+0000","last_fullsized":"2024-04-17T15:40:05.767761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418393+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:40:05.418393+0000","last_peered":"2024-04-17T15:40:05.418393+0000","last_clean":"2024-04-17T15:40:05.418393+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:40:05.418393+0000","last_undegraded":"2024-04-17T15:40:05.418393+0000","last_fullsized":"2024-04-17T15:40:05.418393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":163,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417884+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:05.417884+0000","last_peered":"2024-04-17T15:40:05.417884+0000","last_clean":"2024-04-17T15:40:05.417884+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:05.417884+0000","last_undegraded":"2024-04-17T15:40:05.417884+0000","last_fullsized":"2024-04-17T15:40:05.417884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766434+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:05.766434+0000","last_peered":"2024-04-17T15:40:05.766434+0000","last_clean":"2024-04-17T15:40:05.766434+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:05.766434+0000","last_undegraded":"2024-04-17T15:40:05.766434+0000","last_fullsized":"2024-04-17T15:40:05.766434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"71'2","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770443+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:40:05.770443+0000","last_peered":"2024-04-17T15:40:05.770443+0000","last_clean":"2024-04-17T15:40:05.770443+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:40:05.770443+0000","last_undegraded":"2024-04-17T15:40:05.770443+0000","last_fullsized":"2024-04-17T15:40:05.770443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"98'19","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769211+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:40:05.769211+0000","last_peered":"2024-04-17T15:40:05.769211+0000","last_clean":"2024-04-17T15:40:05.769211+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:40:05.769211+0000","last_undegraded":"2024-04-17T15:40:05.769211+0000","last_fullsized":"2024-04-17T15:40:05.769211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769894+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:40:05.769894+0000","last_peered":"2024-04-17T15:40:05.769894+0000","last_clean":"2024-04-17T15:40:05.769894+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:40:05.769894+0000","last_undegraded":"2024-04-17T15:40:05.769894+0000","last_fullsized":"2024-04-17T15:40:05.769894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"73'11","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417695+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:40:05.417695+0000","last_peered":"2024-04-17T15:40:05.417695+0000","last_clean":"2024-04-17T15:40:05.417695+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:40:05.417695+0000","last_undegraded":"2024-04-17T15:40:05.417695+0000","last_fullsized":"2024-04-17T15:40:05.417695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"98'119","reported_seq":318,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771664+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:40:05.771664+0000","last_peered":"2024-04-17T15:40:05.771664+0000","last_clean":"2024-04-17T15:40:05.771664+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:40:05.771664+0000","last_undegraded":"2024-04-17T15:40:05.771664+0000","last_fullsized":"2024-04-17T15:40:05.771664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":163,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417490+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:05.417490+0000","last_peered":"2024-04-17T15:40:05.417490+0000","last_clean":"2024-04-17T15:40:05.417490+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:05.417490+0000","last_undegraded":"2024-04-17T15:40:05.417490+0000","last_fullsized":"2024-04-17T15:40:05.417490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":226,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769377+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:40:05.769377+0000","last_peered":"2024-04-17T15:40:05.769377+0000","last_clean":"2024-04-17T15:40:05.769377+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:40:05.769377+0000","last_undegraded":"2024-04-17T15:40:05.769377+0000","last_fullsized":"2024-04-17T15:40:05.769377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"98'23","reported_seq":204,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767605+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:40:05.767605+0000","last_peered":"2024-04-17T15:40:05.767605+0000","last_clean":"2024-04-17T15:40:05.767605+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:40:05.767605+0000","last_undegraded":"2024-04-17T15:40:05.767605+0000","last_fullsized":"2024-04-17T15:40:05.767605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770279+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:40:05.770279+0000","last_peered":"2024-04-17T15:40:05.770279+0000","last_clean":"2024-04-17T15:40:05.770279+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:40:05.770279+0000","last_undegraded":"2024-04-17T15:40:05.770279+0000","last_fullsized":"2024-04-17T15:40:05.770279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"98'16","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772173+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:40:05.772173+0000","last_peered":"2024-04-17T15:40:05.772173+0000","last_clean":"2024-04-17T15:40:05.772173+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:40:05.772173+0000","last_undegraded":"2024-04-17T15:40:05.772173+0000","last_fullsized":"2024-04-17T15:40:05.772173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"98'119","reported_seq":398,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767427+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:40:05.767427+0000","last_peered":"2024-04-17T15:40:05.767427+0000","last_clean":"2024-04-17T15:40:05.767427+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:40:05.767427+0000","last_undegraded":"2024-04-17T15:40:05.767427+0000","last_fullsized":"2024-04-17T15:40:05.767427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"90'4","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773927+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:40:05.773927+0000","last_peered":"2024-04-17T15:40:05.773927+0000","last_clean":"2024-04-17T15:40:05.773927+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:40:05.773927+0000","last_undegraded":"2024-04-17T15:40:05.773927+0000","last_fullsized":"2024-04-17T15:40:05.773927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"98'16","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771454+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:40:05.771454+0000","last_peered":"2024-04-17T15:40:05.771454+0000","last_clean":"2024-04-17T15:40:05.771454+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:40:05.771454+0000","last_undegraded":"2024-04-17T15:40:05.771454+0000","last_fullsized":"2024-04-17T15:40:05.771454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767781+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:40:05.767781+0000","last_peered":"2024-04-17T15:40:05.767781+0000","last_clean":"2024-04-17T15:40:05.767781+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:40:05.767781+0000","last_undegraded":"2024-04-17T15:40:05.767781+0000","last_fullsized":"2024-04-17T15:40:05.767781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"98'26","reported_seq":206,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774422+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:40:05.774422+0000","last_peered":"2024-04-17T15:40:05.774422+0000","last_clean":"2024-04-17T15:40:05.774422+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:40:05.774422+0000","last_undegraded":"2024-04-17T15:40:05.774422+0000","last_fullsized":"2024-04-17T15:40:05.774422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420523+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:40:05.420523+0000","last_peered":"2024-04-17T15:40:05.420523+0000","last_clean":"2024-04-17T15:40:05.420523+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:40:05.420523+0000","last_undegraded":"2024-04-17T15:40:05.420523+0000","last_fullsized":"2024-04-17T15:40:05.420523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770537+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:40:05.770537+0000","last_peered":"2024-04-17T15:40:05.770537+0000","last_clean":"2024-04-17T15:40:05.770537+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:40:05.770537+0000","last_undegraded":"2024-04-17T15:40:05.770537+0000","last_fullsized":"2024-04-17T15:40:05.770537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":222,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417619+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:40:05.417619+0000","last_peered":"2024-04-17T15:40:05.417619+0000","last_clean":"2024-04-17T15:40:05.417619+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:40:05.417619+0000","last_undegraded":"2024-04-17T15:40:05.417619+0000","last_fullsized":"2024-04-17T15:40:05.417619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"97'5","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771163+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:40:05.771163+0000","last_peered":"2024-04-17T15:40:05.771163+0000","last_clean":"2024-04-17T15:40:05.771163+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:40:05.771163+0000","last_undegraded":"2024-04-17T15:40:05.771163+0000","last_fullsized":"2024-04-17T15:40:05.771163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416364+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:40:05.416364+0000","last_peered":"2024-04-17T15:40:05.416364+0000","last_clean":"2024-04-17T15:40:05.416364+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:40:05.416364+0000","last_undegraded":"2024-04-17T15:40:05.416364+0000","last_fullsized":"2024-04-17T15:40:05.416364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"98'17","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768389+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:40:05.768389+0000","last_peered":"2024-04-17T15:40:05.768389+0000","last_clean":"2024-04-17T15:40:05.768389+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:40:05.768389+0000","last_undegraded":"2024-04-17T15:40:05.768389+0000","last_fullsized":"2024-04-17T15:40:05.768389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766843+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:40:05.766843+0000","last_peered":"2024-04-17T15:40:05.766843+0000","last_clean":"2024-04-17T15:40:05.766843+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:40:05.766843+0000","last_undegraded":"2024-04-17T15:40:05.766843+0000","last_fullsized":"2024-04-17T15:40:05.766843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768019+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:40:05.768019+0000","last_peered":"2024-04-17T15:40:05.768019+0000","last_clean":"2024-04-17T15:40:05.768019+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:40:05.768019+0000","last_undegraded":"2024-04-17T15:40:05.768019+0000","last_fullsized":"2024-04-17T15:40:05.768019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"98'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769346+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:40:05.769346+0000","last_peered":"2024-04-17T15:40:05.769346+0000","last_clean":"2024-04-17T15:40:05.769346+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:40:05.769346+0000","last_undegraded":"2024-04-17T15:40:05.769346+0000","last_fullsized":"2024-04-17T15:40:05.769346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"98'13","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773146+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:40:05.773146+0000","last_peered":"2024-04-17T15:40:05.773146+0000","last_clean":"2024-04-17T15:40:05.773146+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:40:05.773146+0000","last_undegraded":"2024-04-17T15:40:05.773146+0000","last_fullsized":"2024-04-17T15:40:05.773146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417035+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:40:05.417035+0000","last_peered":"2024-04-17T15:40:05.417035+0000","last_clean":"2024-04-17T15:40:05.417035+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:40:05.417035+0000","last_undegraded":"2024-04-17T15:40:05.417035+0000","last_fullsized":"2024-04-17T15:40:05.417035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"98'24","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768541+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:40:05.768541+0000","last_peered":"2024-04-17T15:40:05.768541+0000","last_clean":"2024-04-17T15:40:05.768541+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:40:05.768541+0000","last_undegraded":"2024-04-17T15:40:05.768541+0000","last_fullsized":"2024-04-17T15:40:05.768541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62305,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"98'119","reported_seq":321,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767915+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:40:05.767915+0000","last_peered":"2024-04-17T15:40:05.767915+0000","last_clean":"2024-04-17T15:40:05.767915+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:40:05.767915+0000","last_undegraded":"2024-04-17T15:40:05.767915+0000","last_fullsized":"2024-04-17T15:40:05.767915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769931+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:40:05.769931+0000","last_peered":"2024-04-17T15:40:05.769931+0000","last_clean":"2024-04-17T15:40:05.769931+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:40:05.769931+0000","last_undegraded":"2024-04-17T15:40:05.769931+0000","last_fullsized":"2024-04-17T15:40:05.769931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":177,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767126+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:40:05.767126+0000","last_peered":"2024-04-17T15:40:05.767126+0000","last_clean":"2024-04-17T15:40:05.767126+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:40:05.767126+0000","last_undegraded":"2024-04-17T15:40:05.767126+0000","last_fullsized":"2024-04-17T15:40:05.767126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"98'15","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771914+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:40:05.771914+0000","last_peered":"2024-04-17T15:40:05.771914+0000","last_clean":"2024-04-17T15:40:05.771914+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:40:05.771914+0000","last_undegraded":"2024-04-17T15:40:05.771914+0000","last_fullsized":"2024-04-17T15:40:05.771914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417248+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:40:05.417248+0000","last_peered":"2024-04-17T15:40:05.417248+0000","last_clean":"2024-04-17T15:40:05.417248+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:40:05.417248+0000","last_undegraded":"2024-04-17T15:40:05.417248+0000","last_fullsized":"2024-04-17T15:40:05.417248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'27","reported_seq":207,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768193+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:40:05.768193+0000","last_peered":"2024-04-17T15:40:05.768193+0000","last_clean":"2024-04-17T15:40:05.768193+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:40:05.768193+0000","last_undegraded":"2024-04-17T15:40:05.768193+0000","last_fullsized":"2024-04-17T15:40:05.768193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416153+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:40:05.416153+0000","last_peered":"2024-04-17T15:40:05.416153+0000","last_clean":"2024-04-17T15:40:05.416153+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:40:05.416153+0000","last_undegraded":"2024-04-17T15:40:05.416153+0000","last_fullsized":"2024-04-17T15:40:05.416153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"84'4","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421494+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:40:05.421494+0000","last_peered":"2024-04-17T15:40:05.421494+0000","last_clean":"2024-04-17T15:40:05.421494+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:40:05.421494+0000","last_undegraded":"2024-04-17T15:40:05.421494+0000","last_fullsized":"2024-04-17T15:40:05.421494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":175,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418757+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:40:05.418757+0000","last_peered":"2024-04-17T15:40:05.418757+0000","last_clean":"2024-04-17T15:40:05.418757+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:40:05.418757+0000","last_undegraded":"2024-04-17T15:40:05.418757+0000","last_fullsized":"2024-04-17T15:40:05.418757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"98'13","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767667+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:40:05.767667+0000","last_peered":"2024-04-17T15:40:05.767667+0000","last_clean":"2024-04-17T15:40:05.767667+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:40:05.767667+0000","last_undegraded":"2024-04-17T15:40:05.767667+0000","last_fullsized":"2024-04-17T15:40:05.767667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417228+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:40:05.417228+0000","last_peered":"2024-04-17T15:40:05.417228+0000","last_clean":"2024-04-17T15:40:05.417228+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:40:05.417228+0000","last_undegraded":"2024-04-17T15:40:05.417228+0000","last_fullsized":"2024-04-17T15:40:05.417228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"98'18","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417986+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:40:05.417986+0000","last_peered":"2024-04-17T15:40:05.417986+0000","last_clean":"2024-04-17T15:40:05.417986+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:40:05.417986+0000","last_undegraded":"2024-04-17T15:40:05.417986+0000","last_fullsized":"2024-04-17T15:40:05.417986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769532+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:40:05.769532+0000","last_peered":"2024-04-17T15:40:05.769532+0000","last_clean":"2024-04-17T15:40:05.769532+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:40:05.769532+0000","last_undegraded":"2024-04-17T15:40:05.769532+0000","last_fullsized":"2024-04-17T15:40:05.769532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768569+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:40:05.768569+0000","last_peered":"2024-04-17T15:40:05.768569+0000","last_clean":"2024-04-17T15:40:05.768569+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:40:05.768569+0000","last_undegraded":"2024-04-17T15:40:05.768569+0000","last_fullsized":"2024-04-17T15:40:05.768569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":175,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419103+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:40:05.419103+0000","last_peered":"2024-04-17T15:40:05.419103+0000","last_clean":"2024-04-17T15:40:05.419103+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:40:05.419103+0000","last_undegraded":"2024-04-17T15:40:05.419103+0000","last_fullsized":"2024-04-17T15:40:05.419103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"98'19","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769778+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:40:05.769778+0000","last_peered":"2024-04-17T15:40:05.769778+0000","last_clean":"2024-04-17T15:40:05.769778+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:40:05.769778+0000","last_undegraded":"2024-04-17T15:40:05.769778+0000","last_fullsized":"2024-04-17T15:40:05.769778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420800+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:40:05.420800+0000","last_peered":"2024-04-17T15:40:05.420800+0000","last_clean":"2024-04-17T15:40:05.420800+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:40:05.420800+0000","last_undegraded":"2024-04-17T15:40:05.420800+0000","last_fullsized":"2024-04-17T15:40:05.420800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"98'22","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417941+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:40:05.417941+0000","last_peered":"2024-04-17T15:40:05.417941+0000","last_clean":"2024-04-17T15:40:05.417941+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:40:05.417941+0000","last_undegraded":"2024-04-17T15:40:05.417941+0000","last_fullsized":"2024-04-17T15:40:05.417941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"98'119","reported_seq":352,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417557+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:40:05.417557+0000","last_peered":"2024-04-17T15:40:05.417557+0000","last_clean":"2024-04-17T15:40:05.417557+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:40:05.417557+0000","last_undegraded":"2024-04-17T15:40:05.417557+0000","last_fullsized":"2024-04-17T15:40:05.417557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420023+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:40:05.420023+0000","last_peered":"2024-04-17T15:40:05.420023+0000","last_clean":"2024-04-17T15:40:05.420023+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:40:05.420023+0000","last_undegraded":"2024-04-17T15:40:05.420023+0000","last_fullsized":"2024-04-17T15:40:05.420023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418319+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:40:05.418319+0000","last_peered":"2024-04-17T15:40:05.418319+0000","last_clean":"2024-04-17T15:40:05.418319+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:40:05.418319+0000","last_undegraded":"2024-04-17T15:40:05.418319+0000","last_fullsized":"2024-04-17T15:40:05.418319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"98'16","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418985+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:40:05.418985+0000","last_peered":"2024-04-17T15:40:05.418985+0000","last_clean":"2024-04-17T15:40:05.418985+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:40:05.418985+0000","last_undegraded":"2024-04-17T15:40:05.418985+0000","last_fullsized":"2024-04-17T15:40:05.418985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":332,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769013+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:40:05.769013+0000","last_peered":"2024-04-17T15:40:05.769013+0000","last_clean":"2024-04-17T15:40:05.769013+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:40:05.769013+0000","last_undegraded":"2024-04-17T15:40:05.769013+0000","last_fullsized":"2024-04-17T15:40:05.769013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":158,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767540+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:40:05.767540+0000","last_peered":"2024-04-17T15:40:05.767540+0000","last_clean":"2024-04-17T15:40:05.767540+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:40:05.767540+0000","last_undegraded":"2024-04-17T15:40:05.767540+0000","last_fullsized":"2024-04-17T15:40:05.767540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"98'119","reported_seq":367,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772458+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:40:05.772458+0000","last_peered":"2024-04-17T15:40:05.772458+0000","last_clean":"2024-04-17T15:40:05.772458+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:40:05.772458+0000","last_undegraded":"2024-04-17T15:40:05.772458+0000","last_fullsized":"2024-04-17T15:40:05.772458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417606+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:40:05.417606+0000","last_peered":"2024-04-17T15:40:05.417606+0000","last_clean":"2024-04-17T15:40:05.417606+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:40:05.417606+0000","last_undegraded":"2024-04-17T15:40:05.417606+0000","last_fullsized":"2024-04-17T15:40:05.417606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.422217+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:40:05.422217+0000","last_peered":"2024-04-17T15:40:05.422217+0000","last_clean":"2024-04-17T15:40:05.422217+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:40:05.422217+0000","last_undegraded":"2024-04-17T15:40:05.422217+0000","last_fullsized":"2024-04-17T15:40:05.422217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"98'22","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769758+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:40:05.769758+0000","last_peered":"2024-04-17T15:40:05.769758+0000","last_clean":"2024-04-17T15:40:05.769758+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:40:05.769758+0000","last_undegraded":"2024-04-17T15:40:05.769758+0000","last_fullsized":"2024-04-17T15:40:05.769758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418181+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:40:05.418181+0000","last_peered":"2024-04-17T15:40:05.418181+0000","last_clean":"2024-04-17T15:40:05.418181+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:40:05.418181+0000","last_undegraded":"2024-04-17T15:40:05.418181+0000","last_fullsized":"2024-04-17T15:40:05.418181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"98'24","reported_seq":203,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769635+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:40:05.769635+0000","last_peered":"2024-04-17T15:40:05.769635+0000","last_clean":"2024-04-17T15:40:05.769635+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:40:05.769635+0000","last_undegraded":"2024-04-17T15:40:05.769635+0000","last_fullsized":"2024-04-17T15:40:05.769635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768066+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:40:05.768066+0000","last_peered":"2024-04-17T15:40:05.768066+0000","last_clean":"2024-04-17T15:40:05.768066+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:40:05.768066+0000","last_undegraded":"2024-04-17T15:40:05.768066+0000","last_fullsized":"2024-04-17T15:40:05.768066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420400+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:40:05.420400+0000","last_peered":"2024-04-17T15:40:05.420400+0000","last_clean":"2024-04-17T15:40:05.420400+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:40:05.420400+0000","last_undegraded":"2024-04-17T15:40:05.420400+0000","last_fullsized":"2024-04-17T15:40:05.420400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773054+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:40:05.773054+0000","last_peered":"2024-04-17T15:40:05.773054+0000","last_clean":"2024-04-17T15:40:05.773054+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:40:05.773054+0000","last_undegraded":"2024-04-17T15:40:05.773054+0000","last_fullsized":"2024-04-17T15:40:05.773054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":334,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768823+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:05.768823+0000","last_peered":"2024-04-17T15:40:05.768823+0000","last_clean":"2024-04-17T15:40:05.768823+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:05.768823+0000","last_undegraded":"2024-04-17T15:40:05.768823+0000","last_fullsized":"2024-04-17T15:40:05.768823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770213+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:40:05.770213+0000","last_peered":"2024-04-17T15:40:05.770213+0000","last_clean":"2024-04-17T15:40:05.770213+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:40:05.770213+0000","last_undegraded":"2024-04-17T15:40:05.770213+0000","last_fullsized":"2024-04-17T15:40:05.770213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"98'15","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767253+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:40:05.767253+0000","last_peered":"2024-04-17T15:40:05.767253+0000","last_clean":"2024-04-17T15:40:05.767253+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:40:05.767253+0000","last_undegraded":"2024-04-17T15:40:05.767253+0000","last_fullsized":"2024-04-17T15:40:05.767253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770478+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:40:05.770478+0000","last_peered":"2024-04-17T15:40:05.770478+0000","last_clean":"2024-04-17T15:40:05.770478+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:40:05.770478+0000","last_undegraded":"2024-04-17T15:40:05.770478+0000","last_fullsized":"2024-04-17T15:40:05.770478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"98'34","reported_seq":216,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773818+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:40:05.773818+0000","last_peered":"2024-04-17T15:40:05.773818+0000","last_clean":"2024-04-17T15:40:05.773818+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:40:05.773818+0000","last_undegraded":"2024-04-17T15:40:05.773818+0000","last_fullsized":"2024-04-17T15:40:05.773818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770065+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:40:05.770065+0000","last_peered":"2024-04-17T15:40:05.770065+0000","last_clean":"2024-04-17T15:40:05.770065+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:40:05.770065+0000","last_undegraded":"2024-04-17T15:40:05.770065+0000","last_fullsized":"2024-04-17T15:40:05.770065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767023+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:40:05.767023+0000","last_peered":"2024-04-17T15:40:05.767023+0000","last_clean":"2024-04-17T15:40:05.767023+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:40:05.767023+0000","last_undegraded":"2024-04-17T15:40:05.767023+0000","last_fullsized":"2024-04-17T15:40:05.767023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"98'10","reported_seq":206,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770275+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:40:05.770275+0000","last_peered":"2024-04-17T15:40:05.770275+0000","last_clean":"2024-04-17T15:40:05.770275+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:40:05.770275+0000","last_undegraded":"2024-04-17T15:40:05.770275+0000","last_fullsized":"2024-04-17T15:40:05.770275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768267+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:05.768267+0000","last_peered":"2024-04-17T15:40:05.768267+0000","last_clean":"2024-04-17T15:40:05.768267+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:05.768267+0000","last_undegraded":"2024-04-17T15:40:05.768267+0000","last_fullsized":"2024-04-17T15:40:05.768267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"98'19","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768310+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:40:05.768310+0000","last_peered":"2024-04-17T15:40:05.768310+0000","last_clean":"2024-04-17T15:40:05.768310+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:40:05.768310+0000","last_undegraded":"2024-04-17T15:40:05.768310+0000","last_fullsized":"2024-04-17T15:40:05.768310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":252,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774575+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:40:05.774575+0000","last_peered":"2024-04-17T15:40:05.774575+0000","last_clean":"2024-04-17T15:40:05.774575+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:40:05.774575+0000","last_undegraded":"2024-04-17T15:40:05.774575+0000","last_fullsized":"2024-04-17T15:40:05.774575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"98'123","reported_seq":386,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420695+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:40:05.420695+0000","last_peered":"2024-04-17T15:40:05.420695+0000","last_clean":"2024-04-17T15:40:05.420695+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:40:05.420695+0000","last_undegraded":"2024-04-17T15:40:05.420695+0000","last_fullsized":"2024-04-17T15:40:05.420695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":161,"num_read_kb":146,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771923+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:40:05.771923+0000","last_peered":"2024-04-17T15:40:05.771923+0000","last_clean":"2024-04-17T15:40:05.771923+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:40:05.771923+0000","last_undegraded":"2024-04-17T15:40:05.771923+0000","last_fullsized":"2024-04-17T15:40:05.771923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420418+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:40:05.420418+0000","last_peered":"2024-04-17T15:40:05.420418+0000","last_clean":"2024-04-17T15:40:05.420418+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:40:05.420418+0000","last_undegraded":"2024-04-17T15:40:05.420418+0000","last_fullsized":"2024-04-17T15:40:05.420418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":177,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.422231+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:40:05.422231+0000","last_peered":"2024-04-17T15:40:05.422231+0000","last_clean":"2024-04-17T15:40:05.422231+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:40:05.422231+0000","last_undegraded":"2024-04-17T15:40:05.422231+0000","last_fullsized":"2024-04-17T15:40:05.422231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416715+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:40:05.416715+0000","last_peered":"2024-04-17T15:40:05.416715+0000","last_clean":"2024-04-17T15:40:05.416715+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:40:05.416715+0000","last_undegraded":"2024-04-17T15:40:05.416715+0000","last_fullsized":"2024-04-17T15:40:05.416715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"98'13","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419674+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:40:05.419674+0000","last_peered":"2024-04-17T15:40:05.419674+0000","last_clean":"2024-04-17T15:40:05.419674+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:40:05.419674+0000","last_undegraded":"2024-04-17T15:40:05.419674+0000","last_fullsized":"2024-04-17T15:40:05.419674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417756+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:40:05.417756+0000","last_peered":"2024-04-17T15:40:05.417756+0000","last_clean":"2024-04-17T15:40:05.417756+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:40:05.417756+0000","last_undegraded":"2024-04-17T15:40:05.417756+0000","last_fullsized":"2024-04-17T15:40:05.417756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"71'16","reported_seq":225,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772433+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:40:05.772433+0000","last_peered":"2024-04-17T15:40:05.772433+0000","last_clean":"2024-04-17T15:40:05.772433+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:40:05.772433+0000","last_undegraded":"2024-04-17T15:40:05.772433+0000","last_fullsized":"2024-04-17T15:40:05.772433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767452+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:40:05.767452+0000","last_peered":"2024-04-17T15:40:05.767452+0000","last_clean":"2024-04-17T15:40:05.767452+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:40:05.767452+0000","last_undegraded":"2024-04-17T15:40:05.767452+0000","last_fullsized":"2024-04-17T15:40:05.767452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768128+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:40:05.768128+0000","last_peered":"2024-04-17T15:40:05.768128+0000","last_clean":"2024-04-17T15:40:05.768128+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:40:05.768128+0000","last_undegraded":"2024-04-17T15:40:05.768128+0000","last_fullsized":"2024-04-17T15:40:05.768128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":203,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421016+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:40:05.421016+0000","last_peered":"2024-04-17T15:40:05.421016+0000","last_clean":"2024-04-17T15:40:05.421016+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:40:05.421016+0000","last_undegraded":"2024-04-17T15:40:05.421016+0000","last_fullsized":"2024-04-17T15:40:05.421016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.775256+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:05.775256+0000","last_peered":"2024-04-17T15:40:05.775256+0000","last_clean":"2024-04-17T15:40:05.775256+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:05.775256+0000","last_undegraded":"2024-04-17T15:40:05.775256+0000","last_fullsized":"2024-04-17T15:40:05.775256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"98'16","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418071+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:40:05.418071+0000","last_peered":"2024-04-17T15:40:05.418071+0000","last_clean":"2024-04-17T15:40:05.418071+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:40:05.418071+0000","last_undegraded":"2024-04-17T15:40:05.418071+0000","last_fullsized":"2024-04-17T15:40:05.418071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766241+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:40:05.766241+0000","last_peered":"2024-04-17T15:40:05.766241+0000","last_clean":"2024-04-17T15:40:05.766241+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:40:05.766241+0000","last_undegraded":"2024-04-17T15:40:05.766241+0000","last_fullsized":"2024-04-17T15:40:05.766241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768797+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:40:05.768797+0000","last_peered":"2024-04-17T15:40:05.768797+0000","last_clean":"2024-04-17T15:40:05.768797+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:40:05.768797+0000","last_undegraded":"2024-04-17T15:40:05.768797+0000","last_fullsized":"2024-04-17T15:40:05.768797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773524+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:40:05.773524+0000","last_peered":"2024-04-17T15:40:05.773524+0000","last_clean":"2024-04-17T15:40:05.773524+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:40:05.773524+0000","last_undegraded":"2024-04-17T15:40:05.773524+0000","last_fullsized":"2024-04-17T15:40:05.773524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767259+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:40:05.767259+0000","last_peered":"2024-04-17T15:40:05.767259+0000","last_clean":"2024-04-17T15:40:05.767259+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:40:05.767259+0000","last_undegraded":"2024-04-17T15:40:05.767259+0000","last_fullsized":"2024-04-17T15:40:05.767259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":213,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420798+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:40:05.420798+0000","last_peered":"2024-04-17T15:40:05.420798+0000","last_clean":"2024-04-17T15:40:05.420798+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:40:05.420798+0000","last_undegraded":"2024-04-17T15:40:05.420798+0000","last_fullsized":"2024-04-17T15:40:05.420798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"98'17","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773684+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:40:05.773684+0000","last_peered":"2024-04-17T15:40:05.773684+0000","last_clean":"2024-04-17T15:40:05.773684+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:40:05.773684+0000","last_undegraded":"2024-04-17T15:40:05.773684+0000","last_fullsized":"2024-04-17T15:40:05.773684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421265+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:40:05.421265+0000","last_peered":"2024-04-17T15:40:05.421265+0000","last_clean":"2024-04-17T15:40:05.421265+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:40:05.421265+0000","last_undegraded":"2024-04-17T15:40:05.421265+0000","last_fullsized":"2024-04-17T15:40:05.421265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766609+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:40:05.766609+0000","last_peered":"2024-04-17T15:40:05.766609+0000","last_clean":"2024-04-17T15:40:05.766609+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:40:05.766609+0000","last_undegraded":"2024-04-17T15:40:05.766609+0000","last_fullsized":"2024-04-17T15:40:05.766609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"98'32","reported_seq":215,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766252+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:40:05.766252+0000","last_peered":"2024-04-17T15:40:05.766252+0000","last_clean":"2024-04-17T15:40:05.766252+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:40:05.766252+0000","last_undegraded":"2024-04-17T15:40:05.766252+0000","last_fullsized":"2024-04-17T15:40:05.766252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":163,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417136+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:40:05.417136+0000","last_peered":"2024-04-17T15:40:05.417136+0000","last_clean":"2024-04-17T15:40:05.417136+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:40:05.417136+0000","last_undegraded":"2024-04-17T15:40:05.417136+0000","last_fullsized":"2024-04-17T15:40:05.417136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768519+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:40:05.768519+0000","last_peered":"2024-04-17T15:40:05.768519+0000","last_clean":"2024-04-17T15:40:05.768519+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:40:05.768519+0000","last_undegraded":"2024-04-17T15:40:05.768519+0000","last_fullsized":"2024-04-17T15:40:05.768519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767006+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:40:05.767006+0000","last_peered":"2024-04-17T15:40:05.767006+0000","last_clean":"2024-04-17T15:40:05.767006+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:40:05.767006+0000","last_undegraded":"2024-04-17T15:40:05.767006+0000","last_fullsized":"2024-04-17T15:40:05.767006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"98'8","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421129+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:40:05.421129+0000","last_peered":"2024-04-17T15:40:05.421129+0000","last_clean":"2024-04-17T15:40:05.421129+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:40:05.421129+0000","last_undegraded":"2024-04-17T15:40:05.421129+0000","last_fullsized":"2024-04-17T15:40:05.421129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773454+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:40:05.773454+0000","last_peered":"2024-04-17T15:40:05.773454+0000","last_clean":"2024-04-17T15:40:05.773454+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:40:05.773454+0000","last_undegraded":"2024-04-17T15:40:05.773454+0000","last_fullsized":"2024-04-17T15:40:05.773454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768770+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:40:05.768770+0000","last_peered":"2024-04-17T15:40:05.768770+0000","last_clean":"2024-04-17T15:40:05.768770+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:40:05.768770+0000","last_undegraded":"2024-04-17T15:40:05.768770+0000","last_fullsized":"2024-04-17T15:40:05.768770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419524+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:40:05.419524+0000","last_peered":"2024-04-17T15:40:05.419524+0000","last_clean":"2024-04-17T15:40:05.419524+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:40:05.419524+0000","last_undegraded":"2024-04-17T15:40:05.419524+0000","last_fullsized":"2024-04-17T15:40:05.419524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"98'119","reported_seq":320,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771952+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:40:05.771952+0000","last_peered":"2024-04-17T15:40:05.771952+0000","last_clean":"2024-04-17T15:40:05.771952+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:40:05.771952+0000","last_undegraded":"2024-04-17T15:40:05.771952+0000","last_fullsized":"2024-04-17T15:40:05.771952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769636+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:40:05.769636+0000","last_peered":"2024-04-17T15:40:05.769636+0000","last_clean":"2024-04-17T15:40:05.769636+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:40:05.769636+0000","last_undegraded":"2024-04-17T15:40:05.769636+0000","last_fullsized":"2024-04-17T15:40:05.769636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769281+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:40:05.769281+0000","last_peered":"2024-04-17T15:40:05.769281+0000","last_clean":"2024-04-17T15:40:05.769281+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:40:05.769281+0000","last_undegraded":"2024-04-17T15:40:05.769281+0000","last_fullsized":"2024-04-17T15:40:05.769281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"98'15","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769213+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:40:05.769213+0000","last_peered":"2024-04-17T15:40:05.769213+0000","last_clean":"2024-04-17T15:40:05.769213+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:40:05.769213+0000","last_undegraded":"2024-04-17T15:40:05.769213+0000","last_fullsized":"2024-04-17T15:40:05.769213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421949+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:40:05.421949+0000","last_peered":"2024-04-17T15:40:05.421949+0000","last_clean":"2024-04-17T15:40:05.421949+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:40:05.421949+0000","last_undegraded":"2024-04-17T15:40:05.421949+0000","last_fullsized":"2024-04-17T15:40:05.421949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417604+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:40:05.417604+0000","last_peered":"2024-04-17T15:40:05.417604+0000","last_clean":"2024-04-17T15:40:05.417604+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:40:05.417604+0000","last_undegraded":"2024-04-17T15:40:05.417604+0000","last_fullsized":"2024-04-17T15:40:05.417604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":182,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418698+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:40:05.418698+0000","last_peered":"2024-04-17T15:40:05.418698+0000","last_clean":"2024-04-17T15:40:05.418698+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:40:05.418698+0000","last_undegraded":"2024-04-17T15:40:05.418698+0000","last_fullsized":"2024-04-17T15:40:05.418698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"98'119","reported_seq":320,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768913+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:40:05.768913+0000","last_peered":"2024-04-17T15:40:05.768913+0000","last_clean":"2024-04-17T15:40:05.768913+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:40:05.768913+0000","last_undegraded":"2024-04-17T15:40:05.768913+0000","last_fullsized":"2024-04-17T15:40:05.768913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767561+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:40:05.767561+0000","last_peered":"2024-04-17T15:40:05.767561+0000","last_clean":"2024-04-17T15:40:05.767561+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:40:05.767561+0000","last_undegraded":"2024-04-17T15:40:05.767561+0000","last_fullsized":"2024-04-17T15:40:05.767561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418817+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:40:05.418817+0000","last_peered":"2024-04-17T15:40:05.418817+0000","last_clean":"2024-04-17T15:40:05.418817+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:40:05.418817+0000","last_undegraded":"2024-04-17T15:40:05.418817+0000","last_fullsized":"2024-04-17T15:40:05.418817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"98'15","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770422+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:40:05.770422+0000","last_peered":"2024-04-17T15:40:05.770422+0000","last_clean":"2024-04-17T15:40:05.770422+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:40:05.770422+0000","last_undegraded":"2024-04-17T15:40:05.770422+0000","last_fullsized":"2024-04-17T15:40:05.770422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774662+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:40:05.774662+0000","last_peered":"2024-04-17T15:40:05.774662+0000","last_clean":"2024-04-17T15:40:05.774662+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:40:05.774662+0000","last_undegraded":"2024-04-17T15:40:05.774662+0000","last_fullsized":"2024-04-17T15:40:05.774662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769125+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:40:05.769125+0000","last_peered":"2024-04-17T15:40:05.769125+0000","last_clean":"2024-04-17T15:40:05.769125+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:40:05.769125+0000","last_undegraded":"2024-04-17T15:40:05.769125+0000","last_fullsized":"2024-04-17T15:40:05.769125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"98'43","reported_seq":226,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771642+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:40:05.771642+0000","last_peered":"2024-04-17T15:40:05.771642+0000","last_clean":"2024-04-17T15:40:05.771642+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:40:05.771642+0000","last_undegraded":"2024-04-17T15:40:05.771642+0000","last_fullsized":"2024-04-17T15:40:05.771642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":28,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766947+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:40:05.766947+0000","last_peered":"2024-04-17T15:40:05.766947+0000","last_clean":"2024-04-17T15:40:05.766947+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:40:05.766947+0000","last_undegraded":"2024-04-17T15:40:05.766947+0000","last_fullsized":"2024-04-17T15:40:05.766947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769334+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:40:05.769334+0000","last_peered":"2024-04-17T15:40:05.769334+0000","last_clean":"2024-04-17T15:40:05.769334+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:40:05.769334+0000","last_undegraded":"2024-04-17T15:40:05.769334+0000","last_fullsized":"2024-04-17T15:40:05.769334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":167,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769343+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:40:05.769343+0000","last_peered":"2024-04-17T15:40:05.769343+0000","last_clean":"2024-04-17T15:40:05.769343+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:40:05.769343+0000","last_undegraded":"2024-04-17T15:40:05.769343+0000","last_fullsized":"2024-04-17T15:40:05.769343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417736+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:40:05.417736+0000","last_peered":"2024-04-17T15:40:05.417736+0000","last_clean":"2024-04-17T15:40:05.417736+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:40:05.417736+0000","last_undegraded":"2024-04-17T15:40:05.417736+0000","last_fullsized":"2024-04-17T15:40:05.417736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"98'17","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417775+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:40:05.417775+0000","last_peered":"2024-04-17T15:40:05.417775+0000","last_clean":"2024-04-17T15:40:05.417775+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:40:05.417775+0000","last_undegraded":"2024-04-17T15:40:05.417775+0000","last_fullsized":"2024-04-17T15:40:05.417775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420937+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:40:05.420937+0000","last_peered":"2024-04-17T15:40:05.420937+0000","last_clean":"2024-04-17T15:40:05.420937+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:40:05.420937+0000","last_undegraded":"2024-04-17T15:40:05.420937+0000","last_fullsized":"2024-04-17T15:40:05.420937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"98'18","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766817+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:40:05.766817+0000","last_peered":"2024-04-17T15:40:05.766817+0000","last_clean":"2024-04-17T15:40:05.766817+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:40:05.766817+0000","last_undegraded":"2024-04-17T15:40:05.766817+0000","last_fullsized":"2024-04-17T15:40:05.766817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768962+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:40:05.768962+0000","last_peered":"2024-04-17T15:40:05.768962+0000","last_clean":"2024-04-17T15:40:05.768962+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:40:05.768962+0000","last_undegraded":"2024-04-17T15:40:05.768962+0000","last_fullsized":"2024-04-17T15:40:05.768962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":166,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768516+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:40:05.768516+0000","last_peered":"2024-04-17T15:40:05.768516+0000","last_clean":"2024-04-17T15:40:05.768516+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:40:05.768516+0000","last_undegraded":"2024-04-17T15:40:05.768516+0000","last_fullsized":"2024-04-17T15:40:05.768516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":143,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774306+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:05.774306+0000","last_peered":"2024-04-17T15:40:05.774306+0000","last_clean":"2024-04-17T15:40:05.774306+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:05.774306+0000","last_undegraded":"2024-04-17T15:40:05.774306+0000","last_fullsized":"2024-04-17T15:40:05.774306+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"98'19","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772887+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:40:05.772887+0000","last_peered":"2024-04-17T15:40:05.772887+0000","last_clean":"2024-04-17T15:40:05.772887+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:40:05.772887+0000","last_undegraded":"2024-04-17T15:40:05.772887+0000","last_fullsized":"2024-04-17T15:40:05.772887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":252,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768028+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:40:05.768028+0000","last_peered":"2024-04-17T15:40:05.768028+0000","last_clean":"2024-04-17T15:40:05.768028+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:40:05.768028+0000","last_undegraded":"2024-04-17T15:40:05.768028+0000","last_fullsized":"2024-04-17T15:40:05.768028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"103'8","reported_seq":179,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766077+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:05.766077+0000","last_peered":"2024-04-17T15:40:05.766077+0000","last_clean":"2024-04-17T15:40:05.766077+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:05.766077+0000","last_undegraded":"2024-04-17T15:40:05.766077+0000","last_fullsized":"2024-04-17T15:40:05.766077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768056+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:05.768056+0000","last_peered":"2024-04-17T15:40:05.768056+0000","last_clean":"2024-04-17T15:40:05.768056+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:05.768056+0000","last_undegraded":"2024-04-17T15:40:05.768056+0000","last_fullsized":"2024-04-17T15:40:05.768056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766090+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:05.766090+0000","last_peered":"2024-04-17T15:40:05.766090+0000","last_clean":"2024-04-17T15:40:05.766090+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:05.766090+0000","last_undegraded":"2024-04-17T15:40:05.766090+0000","last_fullsized":"2024-04-17T15:40:05.766090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767152+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:40:05.767152+0000","last_peered":"2024-04-17T15:40:05.767152+0000","last_clean":"2024-04-17T15:40:05.767152+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:40:05.767152+0000","last_undegraded":"2024-04-17T15:40:05.767152+0000","last_fullsized":"2024-04-17T15:40:05.767152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"98'29","reported_seq":156,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417671+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:40:05.417671+0000","last_peered":"2024-04-17T15:40:05.417671+0000","last_clean":"2024-04-17T15:40:05.417671+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:40:05.417671+0000","last_undegraded":"2024-04-17T15:40:05.417671+0000","last_fullsized":"2024-04-17T15:40:05.417671+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766791+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:40:05.766791+0000","last_peered":"2024-04-17T15:40:05.766791+0000","last_clean":"2024-04-17T15:40:05.766791+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:40:05.766791+0000","last_undegraded":"2024-04-17T15:40:05.766791+0000","last_fullsized":"2024-04-17T15:40:05.766791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"98'18","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767825+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:40:05.767825+0000","last_peered":"2024-04-17T15:40:05.767825+0000","last_clean":"2024-04-17T15:40:05.767825+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:40:05.767825+0000","last_undegraded":"2024-04-17T15:40:05.767825+0000","last_fullsized":"2024-04-17T15:40:05.767825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768518+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:40:05.768518+0000","last_peered":"2024-04-17T15:40:05.768518+0000","last_clean":"2024-04-17T15:40:05.768518+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:40:05.768518+0000","last_undegraded":"2024-04-17T15:40:05.768518+0000","last_fullsized":"2024-04-17T15:40:05.768518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":166,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770226+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:05.770226+0000","last_peered":"2024-04-17T15:40:05.770226+0000","last_clean":"2024-04-17T15:40:05.770226+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:05.770226+0000","last_undegraded":"2024-04-17T15:40:05.770226+0000","last_fullsized":"2024-04-17T15:40:05.770226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":203,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769449+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:40:05.769449+0000","last_peered":"2024-04-17T15:40:05.769449+0000","last_clean":"2024-04-17T15:40:05.769449+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:40:05.769449+0000","last_undegraded":"2024-04-17T15:40:05.769449+0000","last_fullsized":"2024-04-17T15:40:05.769449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"98'23","reported_seq":204,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770021+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:40:05.770021+0000","last_peered":"2024-04-17T15:40:05.770021+0000","last_clean":"2024-04-17T15:40:05.770021+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:40:05.770021+0000","last_undegraded":"2024-04-17T15:40:05.770021+0000","last_fullsized":"2024-04-17T15:40:05.770021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768171+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:40:05.768171+0000","last_peered":"2024-04-17T15:40:05.768171+0000","last_clean":"2024-04-17T15:40:05.768171+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:40:05.768171+0000","last_undegraded":"2024-04-17T15:40:05.768171+0000","last_fullsized":"2024-04-17T15:40:05.768171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"98'17","reported_seq":190,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769350+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:40:05.769350+0000","last_peered":"2024-04-17T15:40:05.769350+0000","last_clean":"2024-04-17T15:40:05.769350+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:40:05.769350+0000","last_undegraded":"2024-04-17T15:40:05.769350+0000","last_fullsized":"2024-04-17T15:40:05.769350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766208+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:40:05.766208+0000","last_peered":"2024-04-17T15:40:05.766208+0000","last_clean":"2024-04-17T15:40:05.766208+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:40:05.766208+0000","last_undegraded":"2024-04-17T15:40:05.766208+0000","last_fullsized":"2024-04-17T15:40:05.766208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"77'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774181+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:40:05.774181+0000","last_peered":"2024-04-17T15:40:05.774181+0000","last_clean":"2024-04-17T15:40:05.774181+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:40:05.774181+0000","last_undegraded":"2024-04-17T15:40:05.774181+0000","last_fullsized":"2024-04-17T15:40:05.774181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"98'17","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769655+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:40:05.769655+0000","last_peered":"2024-04-17T15:40:05.769655+0000","last_clean":"2024-04-17T15:40:05.769655+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:40:05.769655+0000","last_undegraded":"2024-04-17T15:40:05.769655+0000","last_fullsized":"2024-04-17T15:40:05.769655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770150+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:40:05.770150+0000","last_peered":"2024-04-17T15:40:05.770150+0000","last_clean":"2024-04-17T15:40:05.770150+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:40:05.770150+0000","last_undegraded":"2024-04-17T15:40:05.770150+0000","last_fullsized":"2024-04-17T15:40:05.770150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"98'26","reported_seq":206,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421294+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:40:05.421294+0000","last_peered":"2024-04-17T15:40:05.421294+0000","last_clean":"2024-04-17T15:40:05.421294+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:40:05.421294+0000","last_undegraded":"2024-04-17T15:40:05.421294+0000","last_fullsized":"2024-04-17T15:40:05.421294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770785+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:40:05.770785+0000","last_peered":"2024-04-17T15:40:05.770785+0000","last_clean":"2024-04-17T15:40:05.770785+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:40:05.770785+0000","last_undegraded":"2024-04-17T15:40:05.770785+0000","last_fullsized":"2024-04-17T15:40:05.770785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"73'6","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767552+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:05.767552+0000","last_peered":"2024-04-17T15:40:05.767552+0000","last_clean":"2024-04-17T15:40:05.767552+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:05.767552+0000","last_undegraded":"2024-04-17T15:40:05.767552+0000","last_fullsized":"2024-04-17T15:40:05.767552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":190,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770261+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:40:05.770261+0000","last_peered":"2024-04-17T15:40:05.770261+0000","last_clean":"2024-04-17T15:40:05.770261+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:40:05.770261+0000","last_undegraded":"2024-04-17T15:40:05.770261+0000","last_fullsized":"2024-04-17T15:40:05.770261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"98'18","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420598+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:40:05.420598+0000","last_peered":"2024-04-17T15:40:05.420598+0000","last_clean":"2024-04-17T15:40:05.420598+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:40:05.420598+0000","last_undegraded":"2024-04-17T15:40:05.420598+0000","last_fullsized":"2024-04-17T15:40:05.420598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773776+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:40:05.773776+0000","last_peered":"2024-04-17T15:40:05.773776+0000","last_clean":"2024-04-17T15:40:05.773776+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:40:05.773776+0000","last_undegraded":"2024-04-17T15:40:05.773776+0000","last_fullsized":"2024-04-17T15:40:05.773776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"98'22","reported_seq":198,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770024+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:40:05.770024+0000","last_peered":"2024-04-17T15:40:05.770024+0000","last_clean":"2024-04-17T15:40:05.770024+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:40:05.770024+0000","last_undegraded":"2024-04-17T15:40:05.770024+0000","last_fullsized":"2024-04-17T15:40:05.770024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421414+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:05.421414+0000","last_peered":"2024-04-17T15:40:05.421414+0000","last_clean":"2024-04-17T15:40:05.421414+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:05.421414+0000","last_undegraded":"2024-04-17T15:40:05.421414+0000","last_fullsized":"2024-04-17T15:40:05.421414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768044+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:05.768044+0000","last_peered":"2024-04-17T15:40:05.768044+0000","last_clean":"2024-04-17T15:40:05.768044+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:05.768044+0000","last_undegraded":"2024-04-17T15:40:05.768044+0000","last_fullsized":"2024-04-17T15:40:05.768044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768323+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:40:05.768323+0000","last_peered":"2024-04-17T15:40:05.768323+0000","last_clean":"2024-04-17T15:40:05.768323+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:40:05.768323+0000","last_undegraded":"2024-04-17T15:40:05.768323+0000","last_fullsized":"2024-04-17T15:40:05.768323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"98'23","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418929+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:40:05.418929+0000","last_peered":"2024-04-17T15:40:05.418929+0000","last_clean":"2024-04-17T15:40:05.418929+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:40:05.418929+0000","last_undegraded":"2024-04-17T15:40:05.418929+0000","last_fullsized":"2024-04-17T15:40:05.418929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419181+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:05.419181+0000","last_peered":"2024-04-17T15:40:05.419181+0000","last_clean":"2024-04-17T15:40:05.419181+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:05.419181+0000","last_undegraded":"2024-04-17T15:40:05.419181+0000","last_fullsized":"2024-04-17T15:40:05.419181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"98'19","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769799+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:40:05.769799+0000","last_peered":"2024-04-17T15:40:05.769799+0000","last_clean":"2024-04-17T15:40:05.769799+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:40:05.769799+0000","last_undegraded":"2024-04-17T15:40:05.769799+0000","last_fullsized":"2024-04-17T15:40:05.769799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421444+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:40:05.421444+0000","last_peered":"2024-04-17T15:40:05.421444+0000","last_clean":"2024-04-17T15:40:05.421444+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:40:05.421444+0000","last_undegraded":"2024-04-17T15:40:05.421444+0000","last_fullsized":"2024-04-17T15:40:05.421444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769084+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:05.769084+0000","last_peered":"2024-04-17T15:40:05.769084+0000","last_clean":"2024-04-17T15:40:05.769084+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:05.769084+0000","last_undegraded":"2024-04-17T15:40:05.769084+0000","last_fullsized":"2024-04-17T15:40:05.769084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418162+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:40:05.418162+0000","last_peered":"2024-04-17T15:40:05.418162+0000","last_clean":"2024-04-17T15:40:05.418162+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:40:05.418162+0000","last_undegraded":"2024-04-17T15:40:05.418162+0000","last_fullsized":"2024-04-17T15:40:05.418162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"98'18","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766344+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:40:05.766344+0000","last_peered":"2024-04-17T15:40:05.766344+0000","last_clean":"2024-04-17T15:40:05.766344+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:40:05.766344+0000","last_undegraded":"2024-04-17T15:40:05.766344+0000","last_fullsized":"2024-04-17T15:40:05.766344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421844+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:40:05.421844+0000","last_peered":"2024-04-17T15:40:05.421844+0000","last_clean":"2024-04-17T15:40:05.421844+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:40:05.421844+0000","last_undegraded":"2024-04-17T15:40:05.421844+0000","last_fullsized":"2024-04-17T15:40:05.421844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"98'12","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418097+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:40:05.418097+0000","last_peered":"2024-04-17T15:40:05.418097+0000","last_clean":"2024-04-17T15:40:05.418097+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:40:05.418097+0000","last_undegraded":"2024-04-17T15:40:05.418097+0000","last_fullsized":"2024-04-17T15:40:05.418097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"98'119","reported_seq":320,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773042+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:40:05.773042+0000","last_peered":"2024-04-17T15:40:05.773042+0000","last_clean":"2024-04-17T15:40:05.773042+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:40:05.773042+0000","last_undegraded":"2024-04-17T15:40:05.773042+0000","last_fullsized":"2024-04-17T15:40:05.773042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":158,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766774+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:05.766774+0000","last_peered":"2024-04-17T15:40:05.766774+0000","last_clean":"2024-04-17T15:40:05.766774+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:05.766774+0000","last_undegraded":"2024-04-17T15:40:05.766774+0000","last_fullsized":"2024-04-17T15:40:05.766774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":175,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417611+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:05.417611+0000","last_peered":"2024-04-17T15:40:05.417611+0000","last_clean":"2024-04-17T15:40:05.417611+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:05.417611+0000","last_undegraded":"2024-04-17T15:40:05.417611+0000","last_fullsized":"2024-04-17T15:40:05.417611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"98'15","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771481+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:40:05.771481+0000","last_peered":"2024-04-17T15:40:05.771481+0000","last_clean":"2024-04-17T15:40:05.771481+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:40:05.771481+0000","last_undegraded":"2024-04-17T15:40:05.771481+0000","last_fullsized":"2024-04-17T15:40:05.771481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769445+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:40:05.769445+0000","last_peered":"2024-04-17T15:40:05.769445+0000","last_clean":"2024-04-17T15:40:05.769445+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:40:05.769445+0000","last_undegraded":"2024-04-17T15:40:05.769445+0000","last_fullsized":"2024-04-17T15:40:05.769445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"98'22","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769531+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:40:05.769531+0000","last_peered":"2024-04-17T15:40:05.769531+0000","last_clean":"2024-04-17T15:40:05.769531+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:40:05.769531+0000","last_undegraded":"2024-04-17T15:40:05.769531+0000","last_fullsized":"2024-04-17T15:40:05.769531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.765726+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:40:05.765726+0000","last_peered":"2024-04-17T15:40:05.765726+0000","last_clean":"2024-04-17T15:40:05.765726+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:40:05.765726+0000","last_undegraded":"2024-04-17T15:40:05.765726+0000","last_fullsized":"2024-04-17T15:40:05.765726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771713+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:05.771713+0000","last_peered":"2024-04-17T15:40:05.771713+0000","last_clean":"2024-04-17T15:40:05.771713+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:05.771713+0000","last_undegraded":"2024-04-17T15:40:05.771713+0000","last_fullsized":"2024-04-17T15:40:05.771713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418738+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:05.418738+0000","last_peered":"2024-04-17T15:40:05.418738+0000","last_clean":"2024-04-17T15:40:05.418738+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:05.418738+0000","last_undegraded":"2024-04-17T15:40:05.418738+0000","last_fullsized":"2024-04-17T15:40:05.418738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"98'19","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771803+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:40:05.771803+0000","last_peered":"2024-04-17T15:40:05.771803+0000","last_clean":"2024-04-17T15:40:05.771803+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:40:05.771803+0000","last_undegraded":"2024-04-17T15:40:05.771803+0000","last_fullsized":"2024-04-17T15:40:05.771803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769898+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:05.769898+0000","last_peered":"2024-04-17T15:40:05.769898+0000","last_clean":"2024-04-17T15:40:05.769898+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:05.769898+0000","last_undegraded":"2024-04-17T15:40:05.769898+0000","last_fullsized":"2024-04-17T15:40:05.769898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"98'17","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.765840+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:40:05.765840+0000","last_peered":"2024-04-17T15:40:05.765840+0000","last_clean":"2024-04-17T15:40:05.765840+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:40:05.765840+0000","last_undegraded":"2024-04-17T15:40:05.765840+0000","last_fullsized":"2024-04-17T15:40:05.765840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767481+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:40:05.767481+0000","last_peered":"2024-04-17T15:40:05.767481+0000","last_clean":"2024-04-17T15:40:05.767481+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:40:05.767481+0000","last_undegraded":"2024-04-17T15:40:05.767481+0000","last_fullsized":"2024-04-17T15:40:05.767481+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768625+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:05.768625+0000","last_peered":"2024-04-17T15:40:05.768625+0000","last_clean":"2024-04-17T15:40:05.768625+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:05.768625+0000","last_undegraded":"2024-04-17T15:40:05.768625+0000","last_fullsized":"2024-04-17T15:40:05.768625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767325+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:40:05.767325+0000","last_peered":"2024-04-17T15:40:05.767325+0000","last_clean":"2024-04-17T15:40:05.767325+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:40:05.767325+0000","last_undegraded":"2024-04-17T15:40:05.767325+0000","last_fullsized":"2024-04-17T15:40:05.767325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"98'13","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769023+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:40:05.769023+0000","last_peered":"2024-04-17T15:40:05.769023+0000","last_clean":"2024-04-17T15:40:05.769023+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:40:05.769023+0000","last_undegraded":"2024-04-17T15:40:05.769023+0000","last_fullsized":"2024-04-17T15:40:05.769023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417076+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:40:05.417076+0000","last_peered":"2024-04-17T15:40:05.417076+0000","last_clean":"2024-04-17T15:40:05.417076+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:40:05.417076+0000","last_undegraded":"2024-04-17T15:40:05.417076+0000","last_fullsized":"2024-04-17T15:40:05.417076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"98'12","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768687+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:40:05.768687+0000","last_peered":"2024-04-17T15:40:05.768687+0000","last_clean":"2024-04-17T15:40:05.768687+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:40:05.768687+0000","last_undegraded":"2024-04-17T15:40:05.768687+0000","last_fullsized":"2024-04-17T15:40:05.768687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":163,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417215+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:05.417215+0000","last_peered":"2024-04-17T15:40:05.417215+0000","last_clean":"2024-04-17T15:40:05.417215+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:05.417215+0000","last_undegraded":"2024-04-17T15:40:05.417215+0000","last_fullsized":"2024-04-17T15:40:05.417215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772327+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:05.772327+0000","last_peered":"2024-04-17T15:40:05.772327+0000","last_clean":"2024-04-17T15:40:05.772327+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:05.772327+0000","last_undegraded":"2024-04-17T15:40:05.772327+0000","last_fullsized":"2024-04-17T15:40:05.772327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"98'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417831+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:40:05.417831+0000","last_peered":"2024-04-17T15:40:05.417831+0000","last_clean":"2024-04-17T15:40:05.417831+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:40:05.417831+0000","last_undegraded":"2024-04-17T15:40:05.417831+0000","last_fullsized":"2024-04-17T15:40:05.417831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"98'14","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769903+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:40:05.769903+0000","last_peered":"2024-04-17T15:40:05.769903+0000","last_clean":"2024-04-17T15:40:05.769903+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:40:05.769903+0000","last_undegraded":"2024-04-17T15:40:05.769903+0000","last_fullsized":"2024-04-17T15:40:05.769903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":174,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419869+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:40:05.419869+0000","last_peered":"2024-04-17T15:40:05.419869+0000","last_clean":"2024-04-17T15:40:05.419869+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:40:05.419869+0000","last_undegraded":"2024-04-17T15:40:05.419869+0000","last_fullsized":"2024-04-17T15:40:05.419869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"98'17","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417399+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:40:05.417399+0000","last_peered":"2024-04-17T15:40:05.417399+0000","last_clean":"2024-04-17T15:40:05.417399+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:40:05.417399+0000","last_undegraded":"2024-04-17T15:40:05.417399+0000","last_fullsized":"2024-04-17T15:40:05.417399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766085+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:40:05.766085+0000","last_peered":"2024-04-17T15:40:05.766085+0000","last_clean":"2024-04-17T15:40:05.766085+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:40:05.766085+0000","last_undegraded":"2024-04-17T15:40:05.766085+0000","last_fullsized":"2024-04-17T15:40:05.766085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":159,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419216+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:05.419216+0000","last_peered":"2024-04-17T15:40:05.419216+0000","last_clean":"2024-04-17T15:40:05.419216+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:05.419216+0000","last_undegraded":"2024-04-17T15:40:05.419216+0000","last_fullsized":"2024-04-17T15:40:05.419216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421812+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:40:05.421812+0000","last_peered":"2024-04-17T15:40:05.421812+0000","last_clean":"2024-04-17T15:40:05.421812+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:40:05.421812+0000","last_undegraded":"2024-04-17T15:40:05.421812+0000","last_fullsized":"2024-04-17T15:40:05.421812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"98'20","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767440+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:40:05.767440+0000","last_peered":"2024-04-17T15:40:05.767440+0000","last_clean":"2024-04-17T15:40:05.767440+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:40:05.767440+0000","last_undegraded":"2024-04-17T15:40:05.767440+0000","last_fullsized":"2024-04-17T15:40:05.767440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":213,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421779+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:40:05.421779+0000","last_peered":"2024-04-17T15:40:05.421779+0000","last_clean":"2024-04-17T15:40:05.421779+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:40:05.421779+0000","last_undegraded":"2024-04-17T15:40:05.421779+0000","last_fullsized":"2024-04-17T15:40:05.421779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"98'16","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416486+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:40:05.416486+0000","last_peered":"2024-04-17T15:40:05.416486+0000","last_clean":"2024-04-17T15:40:05.416486+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:40:05.416486+0000","last_undegraded":"2024-04-17T15:40:05.416486+0000","last_fullsized":"2024-04-17T15:40:05.416486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770858+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:40:05.770858+0000","last_peered":"2024-04-17T15:40:05.770858+0000","last_clean":"2024-04-17T15:40:05.770858+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:40:05.770858+0000","last_undegraded":"2024-04-17T15:40:05.770858+0000","last_fullsized":"2024-04-17T15:40:05.770858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"98'10","reported_seq":190,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.775118+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:40:05.775118+0000","last_peered":"2024-04-17T15:40:05.775118+0000","last_clean":"2024-04-17T15:40:05.775118+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:40:05.775118+0000","last_undegraded":"2024-04-17T15:40:05.775118+0000","last_fullsized":"2024-04-17T15:40:05.775118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":177,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421309+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:40:05.421309+0000","last_peered":"2024-04-17T15:40:05.421309+0000","last_clean":"2024-04-17T15:40:05.421309+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:40:05.421309+0000","last_undegraded":"2024-04-17T15:40:05.421309+0000","last_fullsized":"2024-04-17T15:40:05.421309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"98'13","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766543+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:40:05.766543+0000","last_peered":"2024-04-17T15:40:05.766543+0000","last_clean":"2024-04-17T15:40:05.766543+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:40:05.766543+0000","last_undegraded":"2024-04-17T15:40:05.766543+0000","last_fullsized":"2024-04-17T15:40:05.766543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768290+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:40:05.768290+0000","last_peered":"2024-04-17T15:40:05.768290+0000","last_clean":"2024-04-17T15:40:05.768290+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:40:05.768290+0000","last_undegraded":"2024-04-17T15:40:05.768290+0000","last_fullsized":"2024-04-17T15:40:05.768290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"98'19","reported_seq":146,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418014+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:40:05.418014+0000","last_peered":"2024-04-17T15:40:05.418014+0000","last_clean":"2024-04-17T15:40:05.418014+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:40:05.418014+0000","last_undegraded":"2024-04-17T15:40:05.418014+0000","last_fullsized":"2024-04-17T15:40:05.418014+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418941+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:40:05.418941+0000","last_peered":"2024-04-17T15:40:05.418941+0000","last_clean":"2024-04-17T15:40:05.418941+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:40:05.418941+0000","last_undegraded":"2024-04-17T15:40:05.418941+0000","last_fullsized":"2024-04-17T15:40:05.418941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"98'24","reported_seq":205,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.422090+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:40:05.422090+0000","last_peered":"2024-04-17T15:40:05.422090+0000","last_clean":"2024-04-17T15:40:05.422090+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:40:05.422090+0000","last_undegraded":"2024-04-17T15:40:05.422090+0000","last_fullsized":"2024-04-17T15:40:05.422090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767056+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:40:05.767056+0000","last_peered":"2024-04-17T15:40:05.767056+0000","last_clean":"2024-04-17T15:40:05.767056+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:40:05.767056+0000","last_undegraded":"2024-04-17T15:40:05.767056+0000","last_fullsized":"2024-04-17T15:40:05.767056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"98'19","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773225+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:40:05.773225+0000","last_peered":"2024-04-17T15:40:05.773225+0000","last_clean":"2024-04-17T15:40:05.773225+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:40:05.773225+0000","last_undegraded":"2024-04-17T15:40:05.773225+0000","last_fullsized":"2024-04-17T15:40:05.773225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767258+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:40:05.767258+0000","last_peered":"2024-04-17T15:40:05.767258+0000","last_clean":"2024-04-17T15:40:05.767258+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:40:05.767258+0000","last_undegraded":"2024-04-17T15:40:05.767258+0000","last_fullsized":"2024-04-17T15:40:05.767258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"98'13","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769536+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:40:05.769536+0000","last_peered":"2024-04-17T15:40:05.769536+0000","last_clean":"2024-04-17T15:40:05.769536+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:40:05.769536+0000","last_undegraded":"2024-04-17T15:40:05.769536+0000","last_fullsized":"2024-04-17T15:40:05.769536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769779+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:40:05.769779+0000","last_peered":"2024-04-17T15:40:05.769779+0000","last_clean":"2024-04-17T15:40:05.769779+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:40:05.769779+0000","last_undegraded":"2024-04-17T15:40:05.769779+0000","last_fullsized":"2024-04-17T15:40:05.769779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"98'18","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774210+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:40:05.774210+0000","last_peered":"2024-04-17T15:40:05.774210+0000","last_clean":"2024-04-17T15:40:05.774210+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:40:05.774210+0000","last_undegraded":"2024-04-17T15:40:05.774210+0000","last_fullsized":"2024-04-17T15:40:05.774210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":229,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418233+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:40:05.418233+0000","last_peered":"2024-04-17T15:40:05.418233+0000","last_clean":"2024-04-17T15:40:05.418233+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:40:05.418233+0000","last_undegraded":"2024-04-17T15:40:05.418233+0000","last_fullsized":"2024-04-17T15:40:05.418233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"98'13","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767429+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:40:05.767429+0000","last_peered":"2024-04-17T15:40:05.767429+0000","last_clean":"2024-04-17T15:40:05.767429+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:40:05.767429+0000","last_undegraded":"2024-04-17T15:40:05.767429+0000","last_fullsized":"2024-04-17T15:40:05.767429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417450+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:40:05.417450+0000","last_peered":"2024-04-17T15:40:05.417450+0000","last_clean":"2024-04-17T15:40:05.417450+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:40:05.417450+0000","last_undegraded":"2024-04-17T15:40:05.417450+0000","last_fullsized":"2024-04-17T15:40:05.417450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"98'14","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.775123+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:40:05.775123+0000","last_peered":"2024-04-17T15:40:05.775123+0000","last_clean":"2024-04-17T15:40:05.775123+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:40:05.775123+0000","last_undegraded":"2024-04-17T15:40:05.775123+0000","last_fullsized":"2024-04-17T15:40:05.775123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"90'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418837+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:40:05.418837+0000","last_peered":"2024-04-17T15:40:05.418837+0000","last_clean":"2024-04-17T15:40:05.418837+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:40:05.418837+0000","last_undegraded":"2024-04-17T15:40:05.418837+0000","last_fullsized":"2024-04-17T15:40:05.418837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"98'17","reported_seq":198,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766670+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:40:05.766670+0000","last_peered":"2024-04-17T15:40:05.766670+0000","last_clean":"2024-04-17T15:40:05.766670+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:40:05.766670+0000","last_undegraded":"2024-04-17T15:40:05.766670+0000","last_fullsized":"2024-04-17T15:40:05.766670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":174,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772186+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:40:05.772186+0000","last_peered":"2024-04-17T15:40:05.772186+0000","last_clean":"2024-04-17T15:40:05.772186+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:40:05.772186+0000","last_undegraded":"2024-04-17T15:40:05.772186+0000","last_fullsized":"2024-04-17T15:40:05.772186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"98'16","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769123+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:40:05.769123+0000","last_peered":"2024-04-17T15:40:05.769123+0000","last_clean":"2024-04-17T15:40:05.769123+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:40:05.769123+0000","last_undegraded":"2024-04-17T15:40:05.769123+0000","last_fullsized":"2024-04-17T15:40:05.769123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":177,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766337+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:40:05.766337+0000","last_peered":"2024-04-17T15:40:05.766337+0000","last_clean":"2024-04-17T15:40:05.766337+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:40:05.766337+0000","last_undegraded":"2024-04-17T15:40:05.766337+0000","last_fullsized":"2024-04-17T15:40:05.766337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"98'17","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773406+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:40:05.773406+0000","last_peered":"2024-04-17T15:40:05.773406+0000","last_clean":"2024-04-17T15:40:05.773406+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:40:05.773406+0000","last_undegraded":"2024-04-17T15:40:05.773406+0000","last_fullsized":"2024-04-17T15:40:05.773406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":136,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416220+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:40:05.416220+0000","last_peered":"2024-04-17T15:40:05.416220+0000","last_clean":"2024-04-17T15:40:05.416220+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:40:05.416220+0000","last_undegraded":"2024-04-17T15:40:05.416220+0000","last_fullsized":"2024-04-17T15:40:05.416220+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"98'9","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417921+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:40:05.417921+0000","last_peered":"2024-04-17T15:40:05.417921+0000","last_clean":"2024-04-17T15:40:05.417921+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:40:05.417921+0000","last_undegraded":"2024-04-17T15:40:05.417921+0000","last_fullsized":"2024-04-17T15:40:05.417921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767808+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:40:05.767808+0000","last_peered":"2024-04-17T15:40:05.767808+0000","last_clean":"2024-04-17T15:40:05.767808+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:40:05.767808+0000","last_undegraded":"2024-04-17T15:40:05.767808+0000","last_fullsized":"2024-04-17T15:40:05.767808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"98'19","reported_seq":147,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417732+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:40:05.417732+0000","last_peered":"2024-04-17T15:40:05.417732+0000","last_clean":"2024-04-17T15:40:05.417732+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:40:05.417732+0000","last_undegraded":"2024-04-17T15:40:05.417732+0000","last_fullsized":"2024-04-17T15:40:05.417732+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"98'27","reported_seq":207,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773978+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:40:05.773978+0000","last_peered":"2024-04-17T15:40:05.773978+0000","last_clean":"2024-04-17T15:40:05.773978+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:40:05.773978+0000","last_undegraded":"2024-04-17T15:40:05.773978+0000","last_fullsized":"2024-04-17T15:40:05.773978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769641+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:40:05.769641+0000","last_peered":"2024-04-17T15:40:05.769641+0000","last_clean":"2024-04-17T15:40:05.769641+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:40:05.769641+0000","last_undegraded":"2024-04-17T15:40:05.769641+0000","last_fullsized":"2024-04-17T15:40:05.769641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"98'9","reported_seq":190,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420376+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:40:05.420376+0000","last_peered":"2024-04-17T15:40:05.420376+0000","last_clean":"2024-04-17T15:40:05.420376+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:40:05.420376+0000","last_undegraded":"2024-04-17T15:40:05.420376+0000","last_fullsized":"2024-04-17T15:40:05.420376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770728+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:40:05.770728+0000","last_peered":"2024-04-17T15:40:05.770728+0000","last_clean":"2024-04-17T15:40:05.770728+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:40:05.770728+0000","last_undegraded":"2024-04-17T15:40:05.770728+0000","last_fullsized":"2024-04-17T15:40:05.770728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":308,"num_write":271,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":952,"ondisk_log_size":952,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":258312,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":832,"num_read_kb":597,"num_write":457,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":778240,"data_stored":476764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":711,"ondisk_log_size":711,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":394,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1374,"num_read_kb":1346,"num_write":284,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4206886912,"num_objects":1005,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":1089,"num_write_kb":4136960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8413773824,"data_stored":8413773824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1019,"ondisk_log_size":1019,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1247724,"kb_used_data":1216540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93124116,"statfs":{"total":96636764160,"available":95359094784,"internally_reserved":0,"allocated":1245736960,"data_stored":1245160821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":782148,"kb_used_data":750964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93589692,"statfs":{"total":96636764160,"available":95835844608,"internally_reserved":0,"allocated":768987136,"data_stored":768449676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191628,"kb_used_data":1160444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93180212,"statfs":{"total":96636764160,"available":95416537088,"internally_reserved":0,"allocated":1188294656,"data_stored":1187706550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1255064,"kb_used_data":1223876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93116776,"statfs":{"total":96636764160,"available":95351578624,"internally_reserved":0,"allocated":1253249024,"data_stored":1252723776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1210048,"kb_used_data":1178860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93161792,"statfs":{"total":96636764160,"available":95397675008,"internally_reserved":0,"allocated":1207152640,"data_stored":1206588726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":755412,"kb_used_data":724224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93616428,"statfs":{"total":96636764160,"available":95863222272,"internally_reserved":0,"allocated":741605376,"data_stored":741076961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":734912,"kb_used_data":703724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93636928,"statfs":{"total":96636764160,"available":95884214272,"internally_reserved":0,"allocated":720613376,"data_stored":720049305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1300720,"kb_used_data":1269536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93071120,"statfs":{"total":96636764160,"available":95304826880,"internally_reserved":0,"allocated":1300004864,"data_stored":1299453605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1298137088,"data_stored":1298137088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":719323136,"data_stored":719323136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":740294656,"data_stored":740294656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1205862400,"data_stored":1205862400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1251999744,"data_stored":1251999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":767557632,"data_stored":767557632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1243611136,"data_stored":1243611136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":58539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":176172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:40:09.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:40:09.924 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:09.924+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:09.945 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:09.945 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:09.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:40:09.993 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:09.993+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:10.085 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:10.086 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:10.094 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:10.092+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:10.099 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:40:10.195 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:10.192+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:40:10.236 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:40:10.248 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-17T15:40:09.457193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4207737608,"num_objects":1203,"num_object_clones":0,"num_object_copies":2406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1203,"num_whiteouts":0,"num_read":3070,"num_read_kb":2766,"num_write":2270,"num_write_kb":4139780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3186,"ondisk_log_size":3186,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8477656,"kb_used_data":8228168,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":746497064,"statfs":{"total":773094113280,"available":764412993536,"internally_reserved":0,"allocated":8425644032,"data_stored":8421209420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.042849"},"pg_stats":[{"pgid":"3.3f","version":"97'13","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770881+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:40:05.770881+0000","last_peered":"2024-04-17T15:40:05.770881+0000","last_clean":"2024-04-17T15:40:05.770881+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:40:05.770881+0000","last_undegraded":"2024-04-17T15:40:05.770881+0000","last_fullsized":"2024-04-17T15:40:05.770881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771691+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:40:05.771691+0000","last_peered":"2024-04-17T15:40:05.771691+0000","last_clean":"2024-04-17T15:40:05.771691+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:40:05.771691+0000","last_undegraded":"2024-04-17T15:40:05.771691+0000","last_fullsized":"2024-04-17T15:40:05.771691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"98'18","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421941+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:40:05.421941+0000","last_peered":"2024-04-17T15:40:05.421941+0000","last_clean":"2024-04-17T15:40:05.421941+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:40:05.421941+0000","last_undegraded":"2024-04-17T15:40:05.421941+0000","last_fullsized":"2024-04-17T15:40:05.421941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768350+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:40:05.768350+0000","last_peered":"2024-04-17T15:40:05.768350+0000","last_clean":"2024-04-17T15:40:05.768350+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:40:05.768350+0000","last_undegraded":"2024-04-17T15:40:05.768350+0000","last_fullsized":"2024-04-17T15:40:05.768350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"98'14","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768586+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:40:05.768586+0000","last_peered":"2024-04-17T15:40:05.768586+0000","last_clean":"2024-04-17T15:40:05.768586+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:40:05.768586+0000","last_undegraded":"2024-04-17T15:40:05.768586+0000","last_fullsized":"2024-04-17T15:40:05.768586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417762+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:40:05.417762+0000","last_peered":"2024-04-17T15:40:05.417762+0000","last_clean":"2024-04-17T15:40:05.417762+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:40:05.417762+0000","last_undegraded":"2024-04-17T15:40:05.417762+0000","last_fullsized":"2024-04-17T15:40:05.417762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"97'11","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771215+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:40:05.771215+0000","last_peered":"2024-04-17T15:40:05.771215+0000","last_clean":"2024-04-17T15:40:05.771215+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:40:05.771215+0000","last_undegraded":"2024-04-17T15:40:05.771215+0000","last_fullsized":"2024-04-17T15:40:05.771215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":210,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766461+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:40:05.766461+0000","last_peered":"2024-04-17T15:40:05.766461+0000","last_clean":"2024-04-17T15:40:05.766461+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:40:05.766461+0000","last_undegraded":"2024-04-17T15:40:05.766461+0000","last_fullsized":"2024-04-17T15:40:05.766461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"98'19","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772478+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:40:05.772478+0000","last_peered":"2024-04-17T15:40:05.772478+0000","last_clean":"2024-04-17T15:40:05.772478+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:40:05.772478+0000","last_undegraded":"2024-04-17T15:40:05.772478+0000","last_fullsized":"2024-04-17T15:40:05.772478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768687+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:40:05.768687+0000","last_peered":"2024-04-17T15:40:05.768687+0000","last_clean":"2024-04-17T15:40:05.768687+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:40:05.768687+0000","last_undegraded":"2024-04-17T15:40:05.768687+0000","last_fullsized":"2024-04-17T15:40:05.768687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"98'12","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774814+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:40:05.774814+0000","last_peered":"2024-04-17T15:40:05.774814+0000","last_clean":"2024-04-17T15:40:05.774814+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:40:05.774814+0000","last_undegraded":"2024-04-17T15:40:05.774814+0000","last_fullsized":"2024-04-17T15:40:05.774814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418960+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:40:05.418960+0000","last_peered":"2024-04-17T15:40:05.418960+0000","last_clean":"2024-04-17T15:40:05.418960+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:40:05.418960+0000","last_undegraded":"2024-04-17T15:40:05.418960+0000","last_fullsized":"2024-04-17T15:40:05.418960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"98'13","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768921+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:40:05.768921+0000","last_peered":"2024-04-17T15:40:05.768921+0000","last_clean":"2024-04-17T15:40:05.768921+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:40:05.768921+0000","last_undegraded":"2024-04-17T15:40:05.768921+0000","last_fullsized":"2024-04-17T15:40:05.768921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771150+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:40:05.771150+0000","last_peered":"2024-04-17T15:40:05.771150+0000","last_clean":"2024-04-17T15:40:05.771150+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:40:05.771150+0000","last_undegraded":"2024-04-17T15:40:05.771150+0000","last_fullsized":"2024-04-17T15:40:05.771150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"98'17","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769551+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:40:05.769551+0000","last_peered":"2024-04-17T15:40:05.769551+0000","last_clean":"2024-04-17T15:40:05.769551+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:40:05.769551+0000","last_undegraded":"2024-04-17T15:40:05.769551+0000","last_fullsized":"2024-04-17T15:40:05.769551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418141+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:40:05.418141+0000","last_peered":"2024-04-17T15:40:05.418141+0000","last_clean":"2024-04-17T15:40:05.418141+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:40:05.418141+0000","last_undegraded":"2024-04-17T15:40:05.418141+0000","last_fullsized":"2024-04-17T15:40:05.418141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"72'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417537+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:40:05.417537+0000","last_peered":"2024-04-17T15:40:05.417537+0000","last_clean":"2024-04-17T15:40:05.417537+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:40:05.417537+0000","last_undegraded":"2024-04-17T15:40:05.417537+0000","last_fullsized":"2024-04-17T15:40:05.417537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"98'11","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771162+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:40:05.771162+0000","last_peered":"2024-04-17T15:40:05.771162+0000","last_clean":"2024-04-17T15:40:05.771162+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:40:05.771162+0000","last_undegraded":"2024-04-17T15:40:05.771162+0000","last_fullsized":"2024-04-17T15:40:05.771162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768647+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:40:05.768647+0000","last_peered":"2024-04-17T15:40:05.768647+0000","last_clean":"2024-04-17T15:40:05.768647+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:40:05.768647+0000","last_undegraded":"2024-04-17T15:40:05.768647+0000","last_fullsized":"2024-04-17T15:40:05.768647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"98'13","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772977+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:40:05.772977+0000","last_peered":"2024-04-17T15:40:05.772977+0000","last_clean":"2024-04-17T15:40:05.772977+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:40:05.772977+0000","last_undegraded":"2024-04-17T15:40:05.772977+0000","last_fullsized":"2024-04-17T15:40:05.772977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774948+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:40:05.774948+0000","last_peered":"2024-04-17T15:40:05.774948+0000","last_clean":"2024-04-17T15:40:05.774948+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:40:05.774948+0000","last_undegraded":"2024-04-17T15:40:05.774948+0000","last_fullsized":"2024-04-17T15:40:05.774948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"98'17","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773466+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:40:05.773466+0000","last_peered":"2024-04-17T15:40:05.773466+0000","last_clean":"2024-04-17T15:40:05.773466+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:40:05.773466+0000","last_undegraded":"2024-04-17T15:40:05.773466+0000","last_fullsized":"2024-04-17T15:40:05.773466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":237,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416692+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:40:05.416692+0000","last_peered":"2024-04-17T15:40:05.416692+0000","last_clean":"2024-04-17T15:40:05.416692+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:40:05.416692+0000","last_undegraded":"2024-04-17T15:40:05.416692+0000","last_fullsized":"2024-04-17T15:40:05.416692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"98'14","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418063+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:40:05.418063+0000","last_peered":"2024-04-17T15:40:05.418063+0000","last_clean":"2024-04-17T15:40:05.418063+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:40:05.418063+0000","last_undegraded":"2024-04-17T15:40:05.418063+0000","last_fullsized":"2024-04-17T15:40:05.418063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418092+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:40:05.418092+0000","last_peered":"2024-04-17T15:40:05.418092+0000","last_clean":"2024-04-17T15:40:05.418092+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:40:05.418092+0000","last_undegraded":"2024-04-17T15:40:05.418092+0000","last_fullsized":"2024-04-17T15:40:05.418092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"98'11","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767925+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:40:05.767925+0000","last_peered":"2024-04-17T15:40:05.767925+0000","last_clean":"2024-04-17T15:40:05.767925+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:40:05.767925+0000","last_undegraded":"2024-04-17T15:40:05.767925+0000","last_fullsized":"2024-04-17T15:40:05.767925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"73'4","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419031+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:40:05.419031+0000","last_peered":"2024-04-17T15:40:05.419031+0000","last_clean":"2024-04-17T15:40:05.419031+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:40:05.419031+0000","last_undegraded":"2024-04-17T15:40:05.419031+0000","last_fullsized":"2024-04-17T15:40:05.419031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"98'13","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766683+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:40:05.766683+0000","last_peered":"2024-04-17T15:40:05.766683+0000","last_clean":"2024-04-17T15:40:05.766683+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:40:05.766683+0000","last_undegraded":"2024-04-17T15:40:05.766683+0000","last_fullsized":"2024-04-17T15:40:05.766683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417066+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:05.417066+0000","last_peered":"2024-04-17T15:40:05.417066+0000","last_clean":"2024-04-17T15:40:05.417066+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:05.417066+0000","last_undegraded":"2024-04-17T15:40:05.417066+0000","last_fullsized":"2024-04-17T15:40:05.417066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767909+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:40:05.767909+0000","last_peered":"2024-04-17T15:40:05.767909+0000","last_clean":"2024-04-17T15:40:05.767909+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:40:05.767909+0000","last_undegraded":"2024-04-17T15:40:05.767909+0000","last_fullsized":"2024-04-17T15:40:05.767909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"98'15","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772720+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:40:05.772720+0000","last_peered":"2024-04-17T15:40:05.772720+0000","last_clean":"2024-04-17T15:40:05.772720+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:40:05.772720+0000","last_undegraded":"2024-04-17T15:40:05.772720+0000","last_fullsized":"2024-04-17T15:40:05.772720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769902+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:40:05.769902+0000","last_peered":"2024-04-17T15:40:05.769902+0000","last_clean":"2024-04-17T15:40:05.769902+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:40:05.769902+0000","last_undegraded":"2024-04-17T15:40:05.769902+0000","last_fullsized":"2024-04-17T15:40:05.769902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"98'16","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769793+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:40:05.769793+0000","last_peered":"2024-04-17T15:40:05.769793+0000","last_clean":"2024-04-17T15:40:05.769793+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:40:05.769793+0000","last_undegraded":"2024-04-17T15:40:05.769793+0000","last_fullsized":"2024-04-17T15:40:05.769793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770271+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:05.770271+0000","last_peered":"2024-04-17T15:40:05.770271+0000","last_clean":"2024-04-17T15:40:05.770271+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:05.770271+0000","last_undegraded":"2024-04-17T15:40:05.770271+0000","last_fullsized":"2024-04-17T15:40:05.770271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"98'48","reported_seq":227,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768798+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:05.768798+0000","last_peered":"2024-04-17T15:40:05.768798+0000","last_clean":"2024-04-17T15:40:05.768798+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:05.768798+0000","last_undegraded":"2024-04-17T15:40:05.768798+0000","last_fullsized":"2024-04-17T15:40:05.768798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":101,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771509+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:40:05.771509+0000","last_peered":"2024-04-17T15:40:05.771509+0000","last_clean":"2024-04-17T15:40:05.771509+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:40:05.771509+0000","last_undegraded":"2024-04-17T15:40:05.771509+0000","last_fullsized":"2024-04-17T15:40:05.771509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"98'11","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766714+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:40:05.766714+0000","last_peered":"2024-04-17T15:40:05.766714+0000","last_clean":"2024-04-17T15:40:05.766714+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:40:05.766714+0000","last_undegraded":"2024-04-17T15:40:05.766714+0000","last_fullsized":"2024-04-17T15:40:05.766714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767761+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:05.767761+0000","last_peered":"2024-04-17T15:40:05.767761+0000","last_clean":"2024-04-17T15:40:05.767761+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:05.767761+0000","last_undegraded":"2024-04-17T15:40:05.767761+0000","last_fullsized":"2024-04-17T15:40:05.767761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418393+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:40:05.418393+0000","last_peered":"2024-04-17T15:40:05.418393+0000","last_clean":"2024-04-17T15:40:05.418393+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:40:05.418393+0000","last_undegraded":"2024-04-17T15:40:05.418393+0000","last_fullsized":"2024-04-17T15:40:05.418393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":163,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417884+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:05.417884+0000","last_peered":"2024-04-17T15:40:05.417884+0000","last_clean":"2024-04-17T15:40:05.417884+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:05.417884+0000","last_undegraded":"2024-04-17T15:40:05.417884+0000","last_fullsized":"2024-04-17T15:40:05.417884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766434+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:05.766434+0000","last_peered":"2024-04-17T15:40:05.766434+0000","last_clean":"2024-04-17T15:40:05.766434+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:05.766434+0000","last_undegraded":"2024-04-17T15:40:05.766434+0000","last_fullsized":"2024-04-17T15:40:05.766434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"71'2","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770443+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:40:05.770443+0000","last_peered":"2024-04-17T15:40:05.770443+0000","last_clean":"2024-04-17T15:40:05.770443+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:40:05.770443+0000","last_undegraded":"2024-04-17T15:40:05.770443+0000","last_fullsized":"2024-04-17T15:40:05.770443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"98'19","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769211+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:40:05.769211+0000","last_peered":"2024-04-17T15:40:05.769211+0000","last_clean":"2024-04-17T15:40:05.769211+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:40:05.769211+0000","last_undegraded":"2024-04-17T15:40:05.769211+0000","last_fullsized":"2024-04-17T15:40:05.769211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769894+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:40:05.769894+0000","last_peered":"2024-04-17T15:40:05.769894+0000","last_clean":"2024-04-17T15:40:05.769894+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:40:05.769894+0000","last_undegraded":"2024-04-17T15:40:05.769894+0000","last_fullsized":"2024-04-17T15:40:05.769894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"73'11","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417695+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:40:05.417695+0000","last_peered":"2024-04-17T15:40:05.417695+0000","last_clean":"2024-04-17T15:40:05.417695+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:40:05.417695+0000","last_undegraded":"2024-04-17T15:40:05.417695+0000","last_fullsized":"2024-04-17T15:40:05.417695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"98'119","reported_seq":318,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771664+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:40:05.771664+0000","last_peered":"2024-04-17T15:40:05.771664+0000","last_clean":"2024-04-17T15:40:05.771664+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:40:05.771664+0000","last_undegraded":"2024-04-17T15:40:05.771664+0000","last_fullsized":"2024-04-17T15:40:05.771664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":163,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417490+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:05.417490+0000","last_peered":"2024-04-17T15:40:05.417490+0000","last_clean":"2024-04-17T15:40:05.417490+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:05.417490+0000","last_undegraded":"2024-04-17T15:40:05.417490+0000","last_fullsized":"2024-04-17T15:40:05.417490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":226,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769377+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:40:05.769377+0000","last_peered":"2024-04-17T15:40:05.769377+0000","last_clean":"2024-04-17T15:40:05.769377+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:40:05.769377+0000","last_undegraded":"2024-04-17T15:40:05.769377+0000","last_fullsized":"2024-04-17T15:40:05.769377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"98'23","reported_seq":204,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767605+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:40:05.767605+0000","last_peered":"2024-04-17T15:40:05.767605+0000","last_clean":"2024-04-17T15:40:05.767605+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:40:05.767605+0000","last_undegraded":"2024-04-17T15:40:05.767605+0000","last_fullsized":"2024-04-17T15:40:05.767605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770279+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:40:05.770279+0000","last_peered":"2024-04-17T15:40:05.770279+0000","last_clean":"2024-04-17T15:40:05.770279+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:40:05.770279+0000","last_undegraded":"2024-04-17T15:40:05.770279+0000","last_fullsized":"2024-04-17T15:40:05.770279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"98'16","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772173+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:40:05.772173+0000","last_peered":"2024-04-17T15:40:05.772173+0000","last_clean":"2024-04-17T15:40:05.772173+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:40:05.772173+0000","last_undegraded":"2024-04-17T15:40:05.772173+0000","last_fullsized":"2024-04-17T15:40:05.772173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"98'119","reported_seq":398,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767427+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:40:05.767427+0000","last_peered":"2024-04-17T15:40:05.767427+0000","last_clean":"2024-04-17T15:40:05.767427+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:40:05.767427+0000","last_undegraded":"2024-04-17T15:40:05.767427+0000","last_fullsized":"2024-04-17T15:40:05.767427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"90'4","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773927+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:40:05.773927+0000","last_peered":"2024-04-17T15:40:05.773927+0000","last_clean":"2024-04-17T15:40:05.773927+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:40:05.773927+0000","last_undegraded":"2024-04-17T15:40:05.773927+0000","last_fullsized":"2024-04-17T15:40:05.773927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"98'16","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771454+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:40:05.771454+0000","last_peered":"2024-04-17T15:40:05.771454+0000","last_clean":"2024-04-17T15:40:05.771454+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:40:05.771454+0000","last_undegraded":"2024-04-17T15:40:05.771454+0000","last_fullsized":"2024-04-17T15:40:05.771454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767781+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:40:05.767781+0000","last_peered":"2024-04-17T15:40:05.767781+0000","last_clean":"2024-04-17T15:40:05.767781+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:40:05.767781+0000","last_undegraded":"2024-04-17T15:40:05.767781+0000","last_fullsized":"2024-04-17T15:40:05.767781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"98'26","reported_seq":206,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774422+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:40:05.774422+0000","last_peered":"2024-04-17T15:40:05.774422+0000","last_clean":"2024-04-17T15:40:05.774422+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:40:05.774422+0000","last_undegraded":"2024-04-17T15:40:05.774422+0000","last_fullsized":"2024-04-17T15:40:05.774422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420523+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:40:05.420523+0000","last_peered":"2024-04-17T15:40:05.420523+0000","last_clean":"2024-04-17T15:40:05.420523+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:40:05.420523+0000","last_undegraded":"2024-04-17T15:40:05.420523+0000","last_fullsized":"2024-04-17T15:40:05.420523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770537+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:40:05.770537+0000","last_peered":"2024-04-17T15:40:05.770537+0000","last_clean":"2024-04-17T15:40:05.770537+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:40:05.770537+0000","last_undegraded":"2024-04-17T15:40:05.770537+0000","last_fullsized":"2024-04-17T15:40:05.770537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":222,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417619+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:40:05.417619+0000","last_peered":"2024-04-17T15:40:05.417619+0000","last_clean":"2024-04-17T15:40:05.417619+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:40:05.417619+0000","last_undegraded":"2024-04-17T15:40:05.417619+0000","last_fullsized":"2024-04-17T15:40:05.417619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"97'5","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771163+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:40:05.771163+0000","last_peered":"2024-04-17T15:40:05.771163+0000","last_clean":"2024-04-17T15:40:05.771163+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:40:05.771163+0000","last_undegraded":"2024-04-17T15:40:05.771163+0000","last_fullsized":"2024-04-17T15:40:05.771163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416364+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:40:05.416364+0000","last_peered":"2024-04-17T15:40:05.416364+0000","last_clean":"2024-04-17T15:40:05.416364+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:40:05.416364+0000","last_undegraded":"2024-04-17T15:40:05.416364+0000","last_fullsized":"2024-04-17T15:40:05.416364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"98'17","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768389+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:40:05.768389+0000","last_peered":"2024-04-17T15:40:05.768389+0000","last_clean":"2024-04-17T15:40:05.768389+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:40:05.768389+0000","last_undegraded":"2024-04-17T15:40:05.768389+0000","last_fullsized":"2024-04-17T15:40:05.768389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766843+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:40:05.766843+0000","last_peered":"2024-04-17T15:40:05.766843+0000","last_clean":"2024-04-17T15:40:05.766843+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:40:05.766843+0000","last_undegraded":"2024-04-17T15:40:05.766843+0000","last_fullsized":"2024-04-17T15:40:05.766843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768019+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:40:05.768019+0000","last_peered":"2024-04-17T15:40:05.768019+0000","last_clean":"2024-04-17T15:40:05.768019+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:40:05.768019+0000","last_undegraded":"2024-04-17T15:40:05.768019+0000","last_fullsized":"2024-04-17T15:40:05.768019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"98'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769346+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:40:05.769346+0000","last_peered":"2024-04-17T15:40:05.769346+0000","last_clean":"2024-04-17T15:40:05.769346+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:40:05.769346+0000","last_undegraded":"2024-04-17T15:40:05.769346+0000","last_fullsized":"2024-04-17T15:40:05.769346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"98'13","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773146+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:40:05.773146+0000","last_peered":"2024-04-17T15:40:05.773146+0000","last_clean":"2024-04-17T15:40:05.773146+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:40:05.773146+0000","last_undegraded":"2024-04-17T15:40:05.773146+0000","last_fullsized":"2024-04-17T15:40:05.773146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417035+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:40:05.417035+0000","last_peered":"2024-04-17T15:40:05.417035+0000","last_clean":"2024-04-17T15:40:05.417035+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:40:05.417035+0000","last_undegraded":"2024-04-17T15:40:05.417035+0000","last_fullsized":"2024-04-17T15:40:05.417035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"98'24","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768541+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:40:05.768541+0000","last_peered":"2024-04-17T15:40:05.768541+0000","last_clean":"2024-04-17T15:40:05.768541+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:40:05.768541+0000","last_undegraded":"2024-04-17T15:40:05.768541+0000","last_fullsized":"2024-04-17T15:40:05.768541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62305,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"98'119","reported_seq":321,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767915+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:40:05.767915+0000","last_peered":"2024-04-17T15:40:05.767915+0000","last_clean":"2024-04-17T15:40:05.767915+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:40:05.767915+0000","last_undegraded":"2024-04-17T15:40:05.767915+0000","last_fullsized":"2024-04-17T15:40:05.767915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769931+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:40:05.769931+0000","last_peered":"2024-04-17T15:40:05.769931+0000","last_clean":"2024-04-17T15:40:05.769931+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:40:05.769931+0000","last_undegraded":"2024-04-17T15:40:05.769931+0000","last_fullsized":"2024-04-17T15:40:05.769931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":177,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767126+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:40:05.767126+0000","last_peered":"2024-04-17T15:40:05.767126+0000","last_clean":"2024-04-17T15:40:05.767126+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:40:05.767126+0000","last_undegraded":"2024-04-17T15:40:05.767126+0000","last_fullsized":"2024-04-17T15:40:05.767126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"98'15","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771914+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:40:05.771914+0000","last_peered":"2024-04-17T15:40:05.771914+0000","last_clean":"2024-04-17T15:40:05.771914+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:40:05.771914+0000","last_undegraded":"2024-04-17T15:40:05.771914+0000","last_fullsized":"2024-04-17T15:40:05.771914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417248+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:40:05.417248+0000","last_peered":"2024-04-17T15:40:05.417248+0000","last_clean":"2024-04-17T15:40:05.417248+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:40:05.417248+0000","last_undegraded":"2024-04-17T15:40:05.417248+0000","last_fullsized":"2024-04-17T15:40:05.417248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'27","reported_seq":207,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768193+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:40:05.768193+0000","last_peered":"2024-04-17T15:40:05.768193+0000","last_clean":"2024-04-17T15:40:05.768193+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:40:05.768193+0000","last_undegraded":"2024-04-17T15:40:05.768193+0000","last_fullsized":"2024-04-17T15:40:05.768193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416153+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:40:05.416153+0000","last_peered":"2024-04-17T15:40:05.416153+0000","last_clean":"2024-04-17T15:40:05.416153+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:40:05.416153+0000","last_undegraded":"2024-04-17T15:40:05.416153+0000","last_fullsized":"2024-04-17T15:40:05.416153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"84'4","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421494+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:40:05.421494+0000","last_peered":"2024-04-17T15:40:05.421494+0000","last_clean":"2024-04-17T15:40:05.421494+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:40:05.421494+0000","last_undegraded":"2024-04-17T15:40:05.421494+0000","last_fullsized":"2024-04-17T15:40:05.421494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":175,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418757+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:40:05.418757+0000","last_peered":"2024-04-17T15:40:05.418757+0000","last_clean":"2024-04-17T15:40:05.418757+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:40:05.418757+0000","last_undegraded":"2024-04-17T15:40:05.418757+0000","last_fullsized":"2024-04-17T15:40:05.418757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"98'13","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767667+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:40:05.767667+0000","last_peered":"2024-04-17T15:40:05.767667+0000","last_clean":"2024-04-17T15:40:05.767667+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:40:05.767667+0000","last_undegraded":"2024-04-17T15:40:05.767667+0000","last_fullsized":"2024-04-17T15:40:05.767667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417228+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:40:05.417228+0000","last_peered":"2024-04-17T15:40:05.417228+0000","last_clean":"2024-04-17T15:40:05.417228+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:40:05.417228+0000","last_undegraded":"2024-04-17T15:40:05.417228+0000","last_fullsized":"2024-04-17T15:40:05.417228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"98'18","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417986+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:40:05.417986+0000","last_peered":"2024-04-17T15:40:05.417986+0000","last_clean":"2024-04-17T15:40:05.417986+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:40:05.417986+0000","last_undegraded":"2024-04-17T15:40:05.417986+0000","last_fullsized":"2024-04-17T15:40:05.417986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769532+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:40:05.769532+0000","last_peered":"2024-04-17T15:40:05.769532+0000","last_clean":"2024-04-17T15:40:05.769532+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:40:05.769532+0000","last_undegraded":"2024-04-17T15:40:05.769532+0000","last_fullsized":"2024-04-17T15:40:05.769532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768569+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:40:05.768569+0000","last_peered":"2024-04-17T15:40:05.768569+0000","last_clean":"2024-04-17T15:40:05.768569+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:40:05.768569+0000","last_undegraded":"2024-04-17T15:40:05.768569+0000","last_fullsized":"2024-04-17T15:40:05.768569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":175,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419103+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:40:05.419103+0000","last_peered":"2024-04-17T15:40:05.419103+0000","last_clean":"2024-04-17T15:40:05.419103+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:40:05.419103+0000","last_undegraded":"2024-04-17T15:40:05.419103+0000","last_fullsized":"2024-04-17T15:40:05.419103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"98'19","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769778+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:40:05.769778+0000","last_peered":"2024-04-17T15:40:05.769778+0000","last_clean":"2024-04-17T15:40:05.769778+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:40:05.769778+0000","last_undegraded":"2024-04-17T15:40:05.769778+0000","last_fullsized":"2024-04-17T15:40:05.769778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420800+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:40:05.420800+0000","last_peered":"2024-04-17T15:40:05.420800+0000","last_clean":"2024-04-17T15:40:05.420800+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:40:05.420800+0000","last_undegraded":"2024-04-17T15:40:05.420800+0000","last_fullsized":"2024-04-17T15:40:05.420800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"98'22","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417941+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:40:05.417941+0000","last_peered":"2024-04-17T15:40:05.417941+0000","last_clean":"2024-04-17T15:40:05.417941+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:40:05.417941+0000","last_undegraded":"2024-04-17T15:40:05.417941+0000","last_fullsized":"2024-04-17T15:40:05.417941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"98'119","reported_seq":352,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417557+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:40:05.417557+0000","last_peered":"2024-04-17T15:40:05.417557+0000","last_clean":"2024-04-17T15:40:05.417557+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:40:05.417557+0000","last_undegraded":"2024-04-17T15:40:05.417557+0000","last_fullsized":"2024-04-17T15:40:05.417557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420023+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:40:05.420023+0000","last_peered":"2024-04-17T15:40:05.420023+0000","last_clean":"2024-04-17T15:40:05.420023+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:40:05.420023+0000","last_undegraded":"2024-04-17T15:40:05.420023+0000","last_fullsized":"2024-04-17T15:40:05.420023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418319+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:40:05.418319+0000","last_peered":"2024-04-17T15:40:05.418319+0000","last_clean":"2024-04-17T15:40:05.418319+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:40:05.418319+0000","last_undegraded":"2024-04-17T15:40:05.418319+0000","last_fullsized":"2024-04-17T15:40:05.418319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"98'16","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418985+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:40:05.418985+0000","last_peered":"2024-04-17T15:40:05.418985+0000","last_clean":"2024-04-17T15:40:05.418985+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:40:05.418985+0000","last_undegraded":"2024-04-17T15:40:05.418985+0000","last_fullsized":"2024-04-17T15:40:05.418985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":332,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769013+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:40:05.769013+0000","last_peered":"2024-04-17T15:40:05.769013+0000","last_clean":"2024-04-17T15:40:05.769013+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:40:05.769013+0000","last_undegraded":"2024-04-17T15:40:05.769013+0000","last_fullsized":"2024-04-17T15:40:05.769013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":158,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767540+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:40:05.767540+0000","last_peered":"2024-04-17T15:40:05.767540+0000","last_clean":"2024-04-17T15:40:05.767540+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:40:05.767540+0000","last_undegraded":"2024-04-17T15:40:05.767540+0000","last_fullsized":"2024-04-17T15:40:05.767540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"98'119","reported_seq":367,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772458+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:40:05.772458+0000","last_peered":"2024-04-17T15:40:05.772458+0000","last_clean":"2024-04-17T15:40:05.772458+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:40:05.772458+0000","last_undegraded":"2024-04-17T15:40:05.772458+0000","last_fullsized":"2024-04-17T15:40:05.772458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417606+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:40:05.417606+0000","last_peered":"2024-04-17T15:40:05.417606+0000","last_clean":"2024-04-17T15:40:05.417606+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:40:05.417606+0000","last_undegraded":"2024-04-17T15:40:05.417606+0000","last_fullsized":"2024-04-17T15:40:05.417606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.422217+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:40:05.422217+0000","last_peered":"2024-04-17T15:40:05.422217+0000","last_clean":"2024-04-17T15:40:05.422217+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:40:05.422217+0000","last_undegraded":"2024-04-17T15:40:05.422217+0000","last_fullsized":"2024-04-17T15:40:05.422217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"98'22","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769758+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:40:05.769758+0000","last_peered":"2024-04-17T15:40:05.769758+0000","last_clean":"2024-04-17T15:40:05.769758+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:40:05.769758+0000","last_undegraded":"2024-04-17T15:40:05.769758+0000","last_fullsized":"2024-04-17T15:40:05.769758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418181+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:40:05.418181+0000","last_peered":"2024-04-17T15:40:05.418181+0000","last_clean":"2024-04-17T15:40:05.418181+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:40:05.418181+0000","last_undegraded":"2024-04-17T15:40:05.418181+0000","last_fullsized":"2024-04-17T15:40:05.418181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"98'24","reported_seq":203,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769635+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:40:05.769635+0000","last_peered":"2024-04-17T15:40:05.769635+0000","last_clean":"2024-04-17T15:40:05.769635+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:40:05.769635+0000","last_undegraded":"2024-04-17T15:40:05.769635+0000","last_fullsized":"2024-04-17T15:40:05.769635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768066+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:40:05.768066+0000","last_peered":"2024-04-17T15:40:05.768066+0000","last_clean":"2024-04-17T15:40:05.768066+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:40:05.768066+0000","last_undegraded":"2024-04-17T15:40:05.768066+0000","last_fullsized":"2024-04-17T15:40:05.768066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420400+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:40:05.420400+0000","last_peered":"2024-04-17T15:40:05.420400+0000","last_clean":"2024-04-17T15:40:05.420400+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:40:05.420400+0000","last_undegraded":"2024-04-17T15:40:05.420400+0000","last_fullsized":"2024-04-17T15:40:05.420400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773054+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:40:05.773054+0000","last_peered":"2024-04-17T15:40:05.773054+0000","last_clean":"2024-04-17T15:40:05.773054+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:40:05.773054+0000","last_undegraded":"2024-04-17T15:40:05.773054+0000","last_fullsized":"2024-04-17T15:40:05.773054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":334,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768823+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:05.768823+0000","last_peered":"2024-04-17T15:40:05.768823+0000","last_clean":"2024-04-17T15:40:05.768823+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:05.768823+0000","last_undegraded":"2024-04-17T15:40:05.768823+0000","last_fullsized":"2024-04-17T15:40:05.768823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770213+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:40:05.770213+0000","last_peered":"2024-04-17T15:40:05.770213+0000","last_clean":"2024-04-17T15:40:05.770213+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:40:05.770213+0000","last_undegraded":"2024-04-17T15:40:05.770213+0000","last_fullsized":"2024-04-17T15:40:05.770213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"98'15","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767253+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:40:05.767253+0000","last_peered":"2024-04-17T15:40:05.767253+0000","last_clean":"2024-04-17T15:40:05.767253+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:40:05.767253+0000","last_undegraded":"2024-04-17T15:40:05.767253+0000","last_fullsized":"2024-04-17T15:40:05.767253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770478+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:40:05.770478+0000","last_peered":"2024-04-17T15:40:05.770478+0000","last_clean":"2024-04-17T15:40:05.770478+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:40:05.770478+0000","last_undegraded":"2024-04-17T15:40:05.770478+0000","last_fullsized":"2024-04-17T15:40:05.770478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"98'34","reported_seq":216,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773818+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:40:05.773818+0000","last_peered":"2024-04-17T15:40:05.773818+0000","last_clean":"2024-04-17T15:40:05.773818+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:40:05.773818+0000","last_undegraded":"2024-04-17T15:40:05.773818+0000","last_fullsized":"2024-04-17T15:40:05.773818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770065+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:40:05.770065+0000","last_peered":"2024-04-17T15:40:05.770065+0000","last_clean":"2024-04-17T15:40:05.770065+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:40:05.770065+0000","last_undegraded":"2024-04-17T15:40:05.770065+0000","last_fullsized":"2024-04-17T15:40:05.770065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767023+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:40:05.767023+0000","last_peered":"2024-04-17T15:40:05.767023+0000","last_clean":"2024-04-17T15:40:05.767023+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:40:05.767023+0000","last_undegraded":"2024-04-17T15:40:05.767023+0000","last_fullsized":"2024-04-17T15:40:05.767023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"98'10","reported_seq":206,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770275+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:40:05.770275+0000","last_peered":"2024-04-17T15:40:05.770275+0000","last_clean":"2024-04-17T15:40:05.770275+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:40:05.770275+0000","last_undegraded":"2024-04-17T15:40:05.770275+0000","last_fullsized":"2024-04-17T15:40:05.770275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768267+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:05.768267+0000","last_peered":"2024-04-17T15:40:05.768267+0000","last_clean":"2024-04-17T15:40:05.768267+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:05.768267+0000","last_undegraded":"2024-04-17T15:40:05.768267+0000","last_fullsized":"2024-04-17T15:40:05.768267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"98'19","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768310+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:40:05.768310+0000","last_peered":"2024-04-17T15:40:05.768310+0000","last_clean":"2024-04-17T15:40:05.768310+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:40:05.768310+0000","last_undegraded":"2024-04-17T15:40:05.768310+0000","last_fullsized":"2024-04-17T15:40:05.768310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":252,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774575+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:40:05.774575+0000","last_peered":"2024-04-17T15:40:05.774575+0000","last_clean":"2024-04-17T15:40:05.774575+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:40:05.774575+0000","last_undegraded":"2024-04-17T15:40:05.774575+0000","last_fullsized":"2024-04-17T15:40:05.774575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"98'123","reported_seq":386,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420695+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:40:05.420695+0000","last_peered":"2024-04-17T15:40:05.420695+0000","last_clean":"2024-04-17T15:40:05.420695+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:40:05.420695+0000","last_undegraded":"2024-04-17T15:40:05.420695+0000","last_fullsized":"2024-04-17T15:40:05.420695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":161,"num_read_kb":146,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771923+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:40:05.771923+0000","last_peered":"2024-04-17T15:40:05.771923+0000","last_clean":"2024-04-17T15:40:05.771923+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:40:05.771923+0000","last_undegraded":"2024-04-17T15:40:05.771923+0000","last_fullsized":"2024-04-17T15:40:05.771923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420418+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:40:05.420418+0000","last_peered":"2024-04-17T15:40:05.420418+0000","last_clean":"2024-04-17T15:40:05.420418+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:40:05.420418+0000","last_undegraded":"2024-04-17T15:40:05.420418+0000","last_fullsized":"2024-04-17T15:40:05.420418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":177,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.422231+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:40:05.422231+0000","last_peered":"2024-04-17T15:40:05.422231+0000","last_clean":"2024-04-17T15:40:05.422231+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:40:05.422231+0000","last_undegraded":"2024-04-17T15:40:05.422231+0000","last_fullsized":"2024-04-17T15:40:05.422231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416715+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:40:05.416715+0000","last_peered":"2024-04-17T15:40:05.416715+0000","last_clean":"2024-04-17T15:40:05.416715+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:40:05.416715+0000","last_undegraded":"2024-04-17T15:40:05.416715+0000","last_fullsized":"2024-04-17T15:40:05.416715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"98'13","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419674+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:40:05.419674+0000","last_peered":"2024-04-17T15:40:05.419674+0000","last_clean":"2024-04-17T15:40:05.419674+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:40:05.419674+0000","last_undegraded":"2024-04-17T15:40:05.419674+0000","last_fullsized":"2024-04-17T15:40:05.419674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417756+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:40:05.417756+0000","last_peered":"2024-04-17T15:40:05.417756+0000","last_clean":"2024-04-17T15:40:05.417756+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:40:05.417756+0000","last_undegraded":"2024-04-17T15:40:05.417756+0000","last_fullsized":"2024-04-17T15:40:05.417756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"71'16","reported_seq":225,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772433+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:40:05.772433+0000","last_peered":"2024-04-17T15:40:05.772433+0000","last_clean":"2024-04-17T15:40:05.772433+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:40:05.772433+0000","last_undegraded":"2024-04-17T15:40:05.772433+0000","last_fullsized":"2024-04-17T15:40:05.772433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767452+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:40:05.767452+0000","last_peered":"2024-04-17T15:40:05.767452+0000","last_clean":"2024-04-17T15:40:05.767452+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:40:05.767452+0000","last_undegraded":"2024-04-17T15:40:05.767452+0000","last_fullsized":"2024-04-17T15:40:05.767452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768128+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:40:05.768128+0000","last_peered":"2024-04-17T15:40:05.768128+0000","last_clean":"2024-04-17T15:40:05.768128+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:40:05.768128+0000","last_undegraded":"2024-04-17T15:40:05.768128+0000","last_fullsized":"2024-04-17T15:40:05.768128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":203,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421016+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:40:05.421016+0000","last_peered":"2024-04-17T15:40:05.421016+0000","last_clean":"2024-04-17T15:40:05.421016+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:40:05.421016+0000","last_undegraded":"2024-04-17T15:40:05.421016+0000","last_fullsized":"2024-04-17T15:40:05.421016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.775256+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:05.775256+0000","last_peered":"2024-04-17T15:40:05.775256+0000","last_clean":"2024-04-17T15:40:05.775256+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:05.775256+0000","last_undegraded":"2024-04-17T15:40:05.775256+0000","last_fullsized":"2024-04-17T15:40:05.775256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"98'16","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418071+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:40:05.418071+0000","last_peered":"2024-04-17T15:40:05.418071+0000","last_clean":"2024-04-17T15:40:05.418071+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:40:05.418071+0000","last_undegraded":"2024-04-17T15:40:05.418071+0000","last_fullsized":"2024-04-17T15:40:05.418071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766241+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:40:05.766241+0000","last_peered":"2024-04-17T15:40:05.766241+0000","last_clean":"2024-04-17T15:40:05.766241+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:40:05.766241+0000","last_undegraded":"2024-04-17T15:40:05.766241+0000","last_fullsized":"2024-04-17T15:40:05.766241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768797+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:40:05.768797+0000","last_peered":"2024-04-17T15:40:05.768797+0000","last_clean":"2024-04-17T15:40:05.768797+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:40:05.768797+0000","last_undegraded":"2024-04-17T15:40:05.768797+0000","last_fullsized":"2024-04-17T15:40:05.768797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773524+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:40:05.773524+0000","last_peered":"2024-04-17T15:40:05.773524+0000","last_clean":"2024-04-17T15:40:05.773524+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:40:05.773524+0000","last_undegraded":"2024-04-17T15:40:05.773524+0000","last_fullsized":"2024-04-17T15:40:05.773524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767259+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:40:05.767259+0000","last_peered":"2024-04-17T15:40:05.767259+0000","last_clean":"2024-04-17T15:40:05.767259+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:40:05.767259+0000","last_undegraded":"2024-04-17T15:40:05.767259+0000","last_fullsized":"2024-04-17T15:40:05.767259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":213,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420798+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:40:05.420798+0000","last_peered":"2024-04-17T15:40:05.420798+0000","last_clean":"2024-04-17T15:40:05.420798+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:40:05.420798+0000","last_undegraded":"2024-04-17T15:40:05.420798+0000","last_fullsized":"2024-04-17T15:40:05.420798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"98'17","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773684+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:40:05.773684+0000","last_peered":"2024-04-17T15:40:05.773684+0000","last_clean":"2024-04-17T15:40:05.773684+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:40:05.773684+0000","last_undegraded":"2024-04-17T15:40:05.773684+0000","last_fullsized":"2024-04-17T15:40:05.773684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421265+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:40:05.421265+0000","last_peered":"2024-04-17T15:40:05.421265+0000","last_clean":"2024-04-17T15:40:05.421265+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:40:05.421265+0000","last_undegraded":"2024-04-17T15:40:05.421265+0000","last_fullsized":"2024-04-17T15:40:05.421265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766609+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:40:05.766609+0000","last_peered":"2024-04-17T15:40:05.766609+0000","last_clean":"2024-04-17T15:40:05.766609+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:40:05.766609+0000","last_undegraded":"2024-04-17T15:40:05.766609+0000","last_fullsized":"2024-04-17T15:40:05.766609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"98'32","reported_seq":215,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766252+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:40:05.766252+0000","last_peered":"2024-04-17T15:40:05.766252+0000","last_clean":"2024-04-17T15:40:05.766252+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:40:05.766252+0000","last_undegraded":"2024-04-17T15:40:05.766252+0000","last_fullsized":"2024-04-17T15:40:05.766252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":163,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417136+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:40:05.417136+0000","last_peered":"2024-04-17T15:40:05.417136+0000","last_clean":"2024-04-17T15:40:05.417136+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:40:05.417136+0000","last_undegraded":"2024-04-17T15:40:05.417136+0000","last_fullsized":"2024-04-17T15:40:05.417136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768519+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:40:05.768519+0000","last_peered":"2024-04-17T15:40:05.768519+0000","last_clean":"2024-04-17T15:40:05.768519+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:40:05.768519+0000","last_undegraded":"2024-04-17T15:40:05.768519+0000","last_fullsized":"2024-04-17T15:40:05.768519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767006+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:40:05.767006+0000","last_peered":"2024-04-17T15:40:05.767006+0000","last_clean":"2024-04-17T15:40:05.767006+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:40:05.767006+0000","last_undegraded":"2024-04-17T15:40:05.767006+0000","last_fullsized":"2024-04-17T15:40:05.767006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"98'8","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421129+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:40:05.421129+0000","last_peered":"2024-04-17T15:40:05.421129+0000","last_clean":"2024-04-17T15:40:05.421129+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:40:05.421129+0000","last_undegraded":"2024-04-17T15:40:05.421129+0000","last_fullsized":"2024-04-17T15:40:05.421129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773454+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:40:05.773454+0000","last_peered":"2024-04-17T15:40:05.773454+0000","last_clean":"2024-04-17T15:40:05.773454+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:40:05.773454+0000","last_undegraded":"2024-04-17T15:40:05.773454+0000","last_fullsized":"2024-04-17T15:40:05.773454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768770+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:40:05.768770+0000","last_peered":"2024-04-17T15:40:05.768770+0000","last_clean":"2024-04-17T15:40:05.768770+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:40:05.768770+0000","last_undegraded":"2024-04-17T15:40:05.768770+0000","last_fullsized":"2024-04-17T15:40:05.768770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419524+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:40:05.419524+0000","last_peered":"2024-04-17T15:40:05.419524+0000","last_clean":"2024-04-17T15:40:05.419524+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:40:05.419524+0000","last_undegraded":"2024-04-17T15:40:05.419524+0000","last_fullsized":"2024-04-17T15:40:05.419524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"98'119","reported_seq":320,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771952+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:40:05.771952+0000","last_peered":"2024-04-17T15:40:05.771952+0000","last_clean":"2024-04-17T15:40:05.771952+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:40:05.771952+0000","last_undegraded":"2024-04-17T15:40:05.771952+0000","last_fullsized":"2024-04-17T15:40:05.771952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769636+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:40:05.769636+0000","last_peered":"2024-04-17T15:40:05.769636+0000","last_clean":"2024-04-17T15:40:05.769636+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:40:05.769636+0000","last_undegraded":"2024-04-17T15:40:05.769636+0000","last_fullsized":"2024-04-17T15:40:05.769636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769281+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:40:05.769281+0000","last_peered":"2024-04-17T15:40:05.769281+0000","last_clean":"2024-04-17T15:40:05.769281+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:40:05.769281+0000","last_undegraded":"2024-04-17T15:40:05.769281+0000","last_fullsized":"2024-04-17T15:40:05.769281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"98'15","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769213+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:40:05.769213+0000","last_peered":"2024-04-17T15:40:05.769213+0000","last_clean":"2024-04-17T15:40:05.769213+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:40:05.769213+0000","last_undegraded":"2024-04-17T15:40:05.769213+0000","last_fullsized":"2024-04-17T15:40:05.769213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421949+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:40:05.421949+0000","last_peered":"2024-04-17T15:40:05.421949+0000","last_clean":"2024-04-17T15:40:05.421949+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:40:05.421949+0000","last_undegraded":"2024-04-17T15:40:05.421949+0000","last_fullsized":"2024-04-17T15:40:05.421949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417604+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:40:05.417604+0000","last_peered":"2024-04-17T15:40:05.417604+0000","last_clean":"2024-04-17T15:40:05.417604+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:40:05.417604+0000","last_undegraded":"2024-04-17T15:40:05.417604+0000","last_fullsized":"2024-04-17T15:40:05.417604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":182,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418698+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:40:05.418698+0000","last_peered":"2024-04-17T15:40:05.418698+0000","last_clean":"2024-04-17T15:40:05.418698+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:40:05.418698+0000","last_undegraded":"2024-04-17T15:40:05.418698+0000","last_fullsized":"2024-04-17T15:40:05.418698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"98'119","reported_seq":320,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768913+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:40:05.768913+0000","last_peered":"2024-04-17T15:40:05.768913+0000","last_clean":"2024-04-17T15:40:05.768913+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:40:05.768913+0000","last_undegraded":"2024-04-17T15:40:05.768913+0000","last_fullsized":"2024-04-17T15:40:05.768913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767561+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:40:05.767561+0000","last_peered":"2024-04-17T15:40:05.767561+0000","last_clean":"2024-04-17T15:40:05.767561+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:40:05.767561+0000","last_undegraded":"2024-04-17T15:40:05.767561+0000","last_fullsized":"2024-04-17T15:40:05.767561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418817+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:40:05.418817+0000","last_peered":"2024-04-17T15:40:05.418817+0000","last_clean":"2024-04-17T15:40:05.418817+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:40:05.418817+0000","last_undegraded":"2024-04-17T15:40:05.418817+0000","last_fullsized":"2024-04-17T15:40:05.418817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"98'15","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770422+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:40:05.770422+0000","last_peered":"2024-04-17T15:40:05.770422+0000","last_clean":"2024-04-17T15:40:05.770422+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:40:05.770422+0000","last_undegraded":"2024-04-17T15:40:05.770422+0000","last_fullsized":"2024-04-17T15:40:05.770422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774662+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:40:05.774662+0000","last_peered":"2024-04-17T15:40:05.774662+0000","last_clean":"2024-04-17T15:40:05.774662+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:40:05.774662+0000","last_undegraded":"2024-04-17T15:40:05.774662+0000","last_fullsized":"2024-04-17T15:40:05.774662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769125+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:40:05.769125+0000","last_peered":"2024-04-17T15:40:05.769125+0000","last_clean":"2024-04-17T15:40:05.769125+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:40:05.769125+0000","last_undegraded":"2024-04-17T15:40:05.769125+0000","last_fullsized":"2024-04-17T15:40:05.769125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"98'43","reported_seq":226,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771642+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:40:05.771642+0000","last_peered":"2024-04-17T15:40:05.771642+0000","last_clean":"2024-04-17T15:40:05.771642+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:40:05.771642+0000","last_undegraded":"2024-04-17T15:40:05.771642+0000","last_fullsized":"2024-04-17T15:40:05.771642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":28,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766947+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:40:05.766947+0000","last_peered":"2024-04-17T15:40:05.766947+0000","last_clean":"2024-04-17T15:40:05.766947+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:40:05.766947+0000","last_undegraded":"2024-04-17T15:40:05.766947+0000","last_fullsized":"2024-04-17T15:40:05.766947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769334+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:40:05.769334+0000","last_peered":"2024-04-17T15:40:05.769334+0000","last_clean":"2024-04-17T15:40:05.769334+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:40:05.769334+0000","last_undegraded":"2024-04-17T15:40:05.769334+0000","last_fullsized":"2024-04-17T15:40:05.769334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":167,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769343+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:40:05.769343+0000","last_peered":"2024-04-17T15:40:05.769343+0000","last_clean":"2024-04-17T15:40:05.769343+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:40:05.769343+0000","last_undegraded":"2024-04-17T15:40:05.769343+0000","last_fullsized":"2024-04-17T15:40:05.769343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417736+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:40:05.417736+0000","last_peered":"2024-04-17T15:40:05.417736+0000","last_clean":"2024-04-17T15:40:05.417736+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:40:05.417736+0000","last_undegraded":"2024-04-17T15:40:05.417736+0000","last_fullsized":"2024-04-17T15:40:05.417736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"98'17","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417775+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:40:05.417775+0000","last_peered":"2024-04-17T15:40:05.417775+0000","last_clean":"2024-04-17T15:40:05.417775+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:40:05.417775+0000","last_undegraded":"2024-04-17T15:40:05.417775+0000","last_fullsized":"2024-04-17T15:40:05.417775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420937+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:40:05.420937+0000","last_peered":"2024-04-17T15:40:05.420937+0000","last_clean":"2024-04-17T15:40:05.420937+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:40:05.420937+0000","last_undegraded":"2024-04-17T15:40:05.420937+0000","last_fullsized":"2024-04-17T15:40:05.420937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"98'18","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766817+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:40:05.766817+0000","last_peered":"2024-04-17T15:40:05.766817+0000","last_clean":"2024-04-17T15:40:05.766817+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:40:05.766817+0000","last_undegraded":"2024-04-17T15:40:05.766817+0000","last_fullsized":"2024-04-17T15:40:05.766817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768962+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:40:05.768962+0000","last_peered":"2024-04-17T15:40:05.768962+0000","last_clean":"2024-04-17T15:40:05.768962+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:40:05.768962+0000","last_undegraded":"2024-04-17T15:40:05.768962+0000","last_fullsized":"2024-04-17T15:40:05.768962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":166,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768516+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:40:05.768516+0000","last_peered":"2024-04-17T15:40:05.768516+0000","last_clean":"2024-04-17T15:40:05.768516+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:40:05.768516+0000","last_undegraded":"2024-04-17T15:40:05.768516+0000","last_fullsized":"2024-04-17T15:40:05.768516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":143,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774306+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:05.774306+0000","last_peered":"2024-04-17T15:40:05.774306+0000","last_clean":"2024-04-17T15:40:05.774306+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:05.774306+0000","last_undegraded":"2024-04-17T15:40:05.774306+0000","last_fullsized":"2024-04-17T15:40:05.774306+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"98'19","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772887+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:40:05.772887+0000","last_peered":"2024-04-17T15:40:05.772887+0000","last_clean":"2024-04-17T15:40:05.772887+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:40:05.772887+0000","last_undegraded":"2024-04-17T15:40:05.772887+0000","last_fullsized":"2024-04-17T15:40:05.772887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":252,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768028+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:40:05.768028+0000","last_peered":"2024-04-17T15:40:05.768028+0000","last_clean":"2024-04-17T15:40:05.768028+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:40:05.768028+0000","last_undegraded":"2024-04-17T15:40:05.768028+0000","last_fullsized":"2024-04-17T15:40:05.768028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"103'8","reported_seq":179,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766077+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:05.766077+0000","last_peered":"2024-04-17T15:40:05.766077+0000","last_clean":"2024-04-17T15:40:05.766077+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:05.766077+0000","last_undegraded":"2024-04-17T15:40:05.766077+0000","last_fullsized":"2024-04-17T15:40:05.766077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768056+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:05.768056+0000","last_peered":"2024-04-17T15:40:05.768056+0000","last_clean":"2024-04-17T15:40:05.768056+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:05.768056+0000","last_undegraded":"2024-04-17T15:40:05.768056+0000","last_fullsized":"2024-04-17T15:40:05.768056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766090+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:05.766090+0000","last_peered":"2024-04-17T15:40:05.766090+0000","last_clean":"2024-04-17T15:40:05.766090+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:05.766090+0000","last_undegraded":"2024-04-17T15:40:05.766090+0000","last_fullsized":"2024-04-17T15:40:05.766090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767152+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:40:05.767152+0000","last_peered":"2024-04-17T15:40:05.767152+0000","last_clean":"2024-04-17T15:40:05.767152+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:40:05.767152+0000","last_undegraded":"2024-04-17T15:40:05.767152+0000","last_fullsized":"2024-04-17T15:40:05.767152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"98'29","reported_seq":156,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417671+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:40:05.417671+0000","last_peered":"2024-04-17T15:40:05.417671+0000","last_clean":"2024-04-17T15:40:05.417671+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:40:05.417671+0000","last_undegraded":"2024-04-17T15:40:05.417671+0000","last_fullsized":"2024-04-17T15:40:05.417671+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766791+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:40:05.766791+0000","last_peered":"2024-04-17T15:40:05.766791+0000","last_clean":"2024-04-17T15:40:05.766791+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:40:05.766791+0000","last_undegraded":"2024-04-17T15:40:05.766791+0000","last_fullsized":"2024-04-17T15:40:05.766791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"98'18","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767825+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:40:05.767825+0000","last_peered":"2024-04-17T15:40:05.767825+0000","last_clean":"2024-04-17T15:40:05.767825+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:40:05.767825+0000","last_undegraded":"2024-04-17T15:40:05.767825+0000","last_fullsized":"2024-04-17T15:40:05.767825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768518+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:40:05.768518+0000","last_peered":"2024-04-17T15:40:05.768518+0000","last_clean":"2024-04-17T15:40:05.768518+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:40:05.768518+0000","last_undegraded":"2024-04-17T15:40:05.768518+0000","last_fullsized":"2024-04-17T15:40:05.768518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":166,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770226+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:05.770226+0000","last_peered":"2024-04-17T15:40:05.770226+0000","last_clean":"2024-04-17T15:40:05.770226+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:05.770226+0000","last_undegraded":"2024-04-17T15:40:05.770226+0000","last_fullsized":"2024-04-17T15:40:05.770226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":203,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769449+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:40:05.769449+0000","last_peered":"2024-04-17T15:40:05.769449+0000","last_clean":"2024-04-17T15:40:05.769449+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:40:05.769449+0000","last_undegraded":"2024-04-17T15:40:05.769449+0000","last_fullsized":"2024-04-17T15:40:05.769449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"98'23","reported_seq":204,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770021+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:40:05.770021+0000","last_peered":"2024-04-17T15:40:05.770021+0000","last_clean":"2024-04-17T15:40:05.770021+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:40:05.770021+0000","last_undegraded":"2024-04-17T15:40:05.770021+0000","last_fullsized":"2024-04-17T15:40:05.770021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768171+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:40:05.768171+0000","last_peered":"2024-04-17T15:40:05.768171+0000","last_clean":"2024-04-17T15:40:05.768171+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:40:05.768171+0000","last_undegraded":"2024-04-17T15:40:05.768171+0000","last_fullsized":"2024-04-17T15:40:05.768171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"98'17","reported_seq":190,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769350+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:40:05.769350+0000","last_peered":"2024-04-17T15:40:05.769350+0000","last_clean":"2024-04-17T15:40:05.769350+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:40:05.769350+0000","last_undegraded":"2024-04-17T15:40:05.769350+0000","last_fullsized":"2024-04-17T15:40:05.769350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766208+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:40:05.766208+0000","last_peered":"2024-04-17T15:40:05.766208+0000","last_clean":"2024-04-17T15:40:05.766208+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:40:05.766208+0000","last_undegraded":"2024-04-17T15:40:05.766208+0000","last_fullsized":"2024-04-17T15:40:05.766208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"77'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774181+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:40:05.774181+0000","last_peered":"2024-04-17T15:40:05.774181+0000","last_clean":"2024-04-17T15:40:05.774181+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:40:05.774181+0000","last_undegraded":"2024-04-17T15:40:05.774181+0000","last_fullsized":"2024-04-17T15:40:05.774181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"98'17","reported_seq":197,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769655+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:40:05.769655+0000","last_peered":"2024-04-17T15:40:05.769655+0000","last_clean":"2024-04-17T15:40:05.769655+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:40:05.769655+0000","last_undegraded":"2024-04-17T15:40:05.769655+0000","last_fullsized":"2024-04-17T15:40:05.769655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770150+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:40:05.770150+0000","last_peered":"2024-04-17T15:40:05.770150+0000","last_clean":"2024-04-17T15:40:05.770150+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:40:05.770150+0000","last_undegraded":"2024-04-17T15:40:05.770150+0000","last_fullsized":"2024-04-17T15:40:05.770150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"98'26","reported_seq":206,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421294+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:40:05.421294+0000","last_peered":"2024-04-17T15:40:05.421294+0000","last_clean":"2024-04-17T15:40:05.421294+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:40:05.421294+0000","last_undegraded":"2024-04-17T15:40:05.421294+0000","last_fullsized":"2024-04-17T15:40:05.421294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770785+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:40:05.770785+0000","last_peered":"2024-04-17T15:40:05.770785+0000","last_clean":"2024-04-17T15:40:05.770785+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:40:05.770785+0000","last_undegraded":"2024-04-17T15:40:05.770785+0000","last_fullsized":"2024-04-17T15:40:05.770785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"73'6","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767552+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:05.767552+0000","last_peered":"2024-04-17T15:40:05.767552+0000","last_clean":"2024-04-17T15:40:05.767552+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:05.767552+0000","last_undegraded":"2024-04-17T15:40:05.767552+0000","last_fullsized":"2024-04-17T15:40:05.767552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":190,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770261+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:40:05.770261+0000","last_peered":"2024-04-17T15:40:05.770261+0000","last_clean":"2024-04-17T15:40:05.770261+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:40:05.770261+0000","last_undegraded":"2024-04-17T15:40:05.770261+0000","last_fullsized":"2024-04-17T15:40:05.770261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"98'18","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420598+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:40:05.420598+0000","last_peered":"2024-04-17T15:40:05.420598+0000","last_clean":"2024-04-17T15:40:05.420598+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:40:05.420598+0000","last_undegraded":"2024-04-17T15:40:05.420598+0000","last_fullsized":"2024-04-17T15:40:05.420598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773776+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:40:05.773776+0000","last_peered":"2024-04-17T15:40:05.773776+0000","last_clean":"2024-04-17T15:40:05.773776+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:40:05.773776+0000","last_undegraded":"2024-04-17T15:40:05.773776+0000","last_fullsized":"2024-04-17T15:40:05.773776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"98'22","reported_seq":198,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770024+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:40:05.770024+0000","last_peered":"2024-04-17T15:40:05.770024+0000","last_clean":"2024-04-17T15:40:05.770024+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:40:05.770024+0000","last_undegraded":"2024-04-17T15:40:05.770024+0000","last_fullsized":"2024-04-17T15:40:05.770024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421414+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:05.421414+0000","last_peered":"2024-04-17T15:40:05.421414+0000","last_clean":"2024-04-17T15:40:05.421414+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:05.421414+0000","last_undegraded":"2024-04-17T15:40:05.421414+0000","last_fullsized":"2024-04-17T15:40:05.421414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768044+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:05.768044+0000","last_peered":"2024-04-17T15:40:05.768044+0000","last_clean":"2024-04-17T15:40:05.768044+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:05.768044+0000","last_undegraded":"2024-04-17T15:40:05.768044+0000","last_fullsized":"2024-04-17T15:40:05.768044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768323+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:40:05.768323+0000","last_peered":"2024-04-17T15:40:05.768323+0000","last_clean":"2024-04-17T15:40:05.768323+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:40:05.768323+0000","last_undegraded":"2024-04-17T15:40:05.768323+0000","last_fullsized":"2024-04-17T15:40:05.768323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"98'23","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418929+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:40:05.418929+0000","last_peered":"2024-04-17T15:40:05.418929+0000","last_clean":"2024-04-17T15:40:05.418929+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:40:05.418929+0000","last_undegraded":"2024-04-17T15:40:05.418929+0000","last_fullsized":"2024-04-17T15:40:05.418929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419181+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:05.419181+0000","last_peered":"2024-04-17T15:40:05.419181+0000","last_clean":"2024-04-17T15:40:05.419181+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:05.419181+0000","last_undegraded":"2024-04-17T15:40:05.419181+0000","last_fullsized":"2024-04-17T15:40:05.419181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"98'19","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769799+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:40:05.769799+0000","last_peered":"2024-04-17T15:40:05.769799+0000","last_clean":"2024-04-17T15:40:05.769799+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:40:05.769799+0000","last_undegraded":"2024-04-17T15:40:05.769799+0000","last_fullsized":"2024-04-17T15:40:05.769799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421444+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:40:05.421444+0000","last_peered":"2024-04-17T15:40:05.421444+0000","last_clean":"2024-04-17T15:40:05.421444+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:40:05.421444+0000","last_undegraded":"2024-04-17T15:40:05.421444+0000","last_fullsized":"2024-04-17T15:40:05.421444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":160,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769084+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:05.769084+0000","last_peered":"2024-04-17T15:40:05.769084+0000","last_clean":"2024-04-17T15:40:05.769084+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:05.769084+0000","last_undegraded":"2024-04-17T15:40:05.769084+0000","last_fullsized":"2024-04-17T15:40:05.769084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418162+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:40:05.418162+0000","last_peered":"2024-04-17T15:40:05.418162+0000","last_clean":"2024-04-17T15:40:05.418162+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:40:05.418162+0000","last_undegraded":"2024-04-17T15:40:05.418162+0000","last_fullsized":"2024-04-17T15:40:05.418162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"98'18","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766344+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:40:05.766344+0000","last_peered":"2024-04-17T15:40:05.766344+0000","last_clean":"2024-04-17T15:40:05.766344+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:40:05.766344+0000","last_undegraded":"2024-04-17T15:40:05.766344+0000","last_fullsized":"2024-04-17T15:40:05.766344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":173,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421844+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:40:05.421844+0000","last_peered":"2024-04-17T15:40:05.421844+0000","last_clean":"2024-04-17T15:40:05.421844+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:40:05.421844+0000","last_undegraded":"2024-04-17T15:40:05.421844+0000","last_fullsized":"2024-04-17T15:40:05.421844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"98'12","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418097+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:40:05.418097+0000","last_peered":"2024-04-17T15:40:05.418097+0000","last_clean":"2024-04-17T15:40:05.418097+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:40:05.418097+0000","last_undegraded":"2024-04-17T15:40:05.418097+0000","last_fullsized":"2024-04-17T15:40:05.418097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"98'119","reported_seq":320,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773042+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:40:05.773042+0000","last_peered":"2024-04-17T15:40:05.773042+0000","last_clean":"2024-04-17T15:40:05.773042+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:40:05.773042+0000","last_undegraded":"2024-04-17T15:40:05.773042+0000","last_fullsized":"2024-04-17T15:40:05.773042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":158,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766774+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:05.766774+0000","last_peered":"2024-04-17T15:40:05.766774+0000","last_clean":"2024-04-17T15:40:05.766774+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:05.766774+0000","last_undegraded":"2024-04-17T15:40:05.766774+0000","last_fullsized":"2024-04-17T15:40:05.766774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":175,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417611+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:05.417611+0000","last_peered":"2024-04-17T15:40:05.417611+0000","last_clean":"2024-04-17T15:40:05.417611+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:05.417611+0000","last_undegraded":"2024-04-17T15:40:05.417611+0000","last_fullsized":"2024-04-17T15:40:05.417611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"98'15","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771481+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:40:05.771481+0000","last_peered":"2024-04-17T15:40:05.771481+0000","last_clean":"2024-04-17T15:40:05.771481+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:40:05.771481+0000","last_undegraded":"2024-04-17T15:40:05.771481+0000","last_fullsized":"2024-04-17T15:40:05.771481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":170,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769445+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:40:05.769445+0000","last_peered":"2024-04-17T15:40:05.769445+0000","last_clean":"2024-04-17T15:40:05.769445+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:40:05.769445+0000","last_undegraded":"2024-04-17T15:40:05.769445+0000","last_fullsized":"2024-04-17T15:40:05.769445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"98'22","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769531+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:40:05.769531+0000","last_peered":"2024-04-17T15:40:05.769531+0000","last_clean":"2024-04-17T15:40:05.769531+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:40:05.769531+0000","last_undegraded":"2024-04-17T15:40:05.769531+0000","last_fullsized":"2024-04-17T15:40:05.769531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.765726+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:40:05.765726+0000","last_peered":"2024-04-17T15:40:05.765726+0000","last_clean":"2024-04-17T15:40:05.765726+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:40:05.765726+0000","last_undegraded":"2024-04-17T15:40:05.765726+0000","last_fullsized":"2024-04-17T15:40:05.765726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771713+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:05.771713+0000","last_peered":"2024-04-17T15:40:05.771713+0000","last_clean":"2024-04-17T15:40:05.771713+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:05.771713+0000","last_undegraded":"2024-04-17T15:40:05.771713+0000","last_fullsized":"2024-04-17T15:40:05.771713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418738+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:05.418738+0000","last_peered":"2024-04-17T15:40:05.418738+0000","last_clean":"2024-04-17T15:40:05.418738+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:05.418738+0000","last_undegraded":"2024-04-17T15:40:05.418738+0000","last_fullsized":"2024-04-17T15:40:05.418738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"98'19","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.771803+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:40:05.771803+0000","last_peered":"2024-04-17T15:40:05.771803+0000","last_clean":"2024-04-17T15:40:05.771803+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:40:05.771803+0000","last_undegraded":"2024-04-17T15:40:05.771803+0000","last_fullsized":"2024-04-17T15:40:05.771803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769898+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:05.769898+0000","last_peered":"2024-04-17T15:40:05.769898+0000","last_clean":"2024-04-17T15:40:05.769898+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:05.769898+0000","last_undegraded":"2024-04-17T15:40:05.769898+0000","last_fullsized":"2024-04-17T15:40:05.769898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"98'17","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.765840+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:40:05.765840+0000","last_peered":"2024-04-17T15:40:05.765840+0000","last_clean":"2024-04-17T15:40:05.765840+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:40:05.765840+0000","last_undegraded":"2024-04-17T15:40:05.765840+0000","last_fullsized":"2024-04-17T15:40:05.765840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767481+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:40:05.767481+0000","last_peered":"2024-04-17T15:40:05.767481+0000","last_clean":"2024-04-17T15:40:05.767481+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:40:05.767481+0000","last_undegraded":"2024-04-17T15:40:05.767481+0000","last_fullsized":"2024-04-17T15:40:05.767481+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":164,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768625+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:05.768625+0000","last_peered":"2024-04-17T15:40:05.768625+0000","last_clean":"2024-04-17T15:40:05.768625+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:05.768625+0000","last_undegraded":"2024-04-17T15:40:05.768625+0000","last_fullsized":"2024-04-17T15:40:05.768625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":192,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767325+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:40:05.767325+0000","last_peered":"2024-04-17T15:40:05.767325+0000","last_clean":"2024-04-17T15:40:05.767325+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:40:05.767325+0000","last_undegraded":"2024-04-17T15:40:05.767325+0000","last_fullsized":"2024-04-17T15:40:05.767325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"98'13","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769023+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:40:05.769023+0000","last_peered":"2024-04-17T15:40:05.769023+0000","last_clean":"2024-04-17T15:40:05.769023+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:40:05.769023+0000","last_undegraded":"2024-04-17T15:40:05.769023+0000","last_fullsized":"2024-04-17T15:40:05.769023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417076+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:40:05.417076+0000","last_peered":"2024-04-17T15:40:05.417076+0000","last_clean":"2024-04-17T15:40:05.417076+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:40:05.417076+0000","last_undegraded":"2024-04-17T15:40:05.417076+0000","last_fullsized":"2024-04-17T15:40:05.417076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"98'12","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768687+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:40:05.768687+0000","last_peered":"2024-04-17T15:40:05.768687+0000","last_clean":"2024-04-17T15:40:05.768687+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:40:05.768687+0000","last_undegraded":"2024-04-17T15:40:05.768687+0000","last_fullsized":"2024-04-17T15:40:05.768687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":163,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417215+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:05.417215+0000","last_peered":"2024-04-17T15:40:05.417215+0000","last_clean":"2024-04-17T15:40:05.417215+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:05.417215+0000","last_undegraded":"2024-04-17T15:40:05.417215+0000","last_fullsized":"2024-04-17T15:40:05.417215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772327+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:05.772327+0000","last_peered":"2024-04-17T15:40:05.772327+0000","last_clean":"2024-04-17T15:40:05.772327+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:05.772327+0000","last_undegraded":"2024-04-17T15:40:05.772327+0000","last_fullsized":"2024-04-17T15:40:05.772327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"98'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417831+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:40:05.417831+0000","last_peered":"2024-04-17T15:40:05.417831+0000","last_clean":"2024-04-17T15:40:05.417831+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:40:05.417831+0000","last_undegraded":"2024-04-17T15:40:05.417831+0000","last_fullsized":"2024-04-17T15:40:05.417831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"98'14","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769903+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:40:05.769903+0000","last_peered":"2024-04-17T15:40:05.769903+0000","last_clean":"2024-04-17T15:40:05.769903+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:40:05.769903+0000","last_undegraded":"2024-04-17T15:40:05.769903+0000","last_fullsized":"2024-04-17T15:40:05.769903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":174,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419869+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:40:05.419869+0000","last_peered":"2024-04-17T15:40:05.419869+0000","last_clean":"2024-04-17T15:40:05.419869+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:40:05.419869+0000","last_undegraded":"2024-04-17T15:40:05.419869+0000","last_fullsized":"2024-04-17T15:40:05.419869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"98'17","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417399+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:40:05.417399+0000","last_peered":"2024-04-17T15:40:05.417399+0000","last_clean":"2024-04-17T15:40:05.417399+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:40:05.417399+0000","last_undegraded":"2024-04-17T15:40:05.417399+0000","last_fullsized":"2024-04-17T15:40:05.417399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":165,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766085+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:40:05.766085+0000","last_peered":"2024-04-17T15:40:05.766085+0000","last_clean":"2024-04-17T15:40:05.766085+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:40:05.766085+0000","last_undegraded":"2024-04-17T15:40:05.766085+0000","last_fullsized":"2024-04-17T15:40:05.766085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":159,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.419216+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:05.419216+0000","last_peered":"2024-04-17T15:40:05.419216+0000","last_clean":"2024-04-17T15:40:05.419216+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:05.419216+0000","last_undegraded":"2024-04-17T15:40:05.419216+0000","last_fullsized":"2024-04-17T15:40:05.419216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421812+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:40:05.421812+0000","last_peered":"2024-04-17T15:40:05.421812+0000","last_clean":"2024-04-17T15:40:05.421812+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:40:05.421812+0000","last_undegraded":"2024-04-17T15:40:05.421812+0000","last_fullsized":"2024-04-17T15:40:05.421812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"98'20","reported_seq":200,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767440+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:40:05.767440+0000","last_peered":"2024-04-17T15:40:05.767440+0000","last_clean":"2024-04-17T15:40:05.767440+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:40:05.767440+0000","last_undegraded":"2024-04-17T15:40:05.767440+0000","last_fullsized":"2024-04-17T15:40:05.767440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":213,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421779+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:40:05.421779+0000","last_peered":"2024-04-17T15:40:05.421779+0000","last_clean":"2024-04-17T15:40:05.421779+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:40:05.421779+0000","last_undegraded":"2024-04-17T15:40:05.421779+0000","last_fullsized":"2024-04-17T15:40:05.421779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"98'16","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416486+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:40:05.416486+0000","last_peered":"2024-04-17T15:40:05.416486+0000","last_clean":"2024-04-17T15:40:05.416486+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:40:05.416486+0000","last_undegraded":"2024-04-17T15:40:05.416486+0000","last_fullsized":"2024-04-17T15:40:05.416486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770858+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:40:05.770858+0000","last_peered":"2024-04-17T15:40:05.770858+0000","last_clean":"2024-04-17T15:40:05.770858+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:40:05.770858+0000","last_undegraded":"2024-04-17T15:40:05.770858+0000","last_fullsized":"2024-04-17T15:40:05.770858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"98'10","reported_seq":190,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.775118+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:40:05.775118+0000","last_peered":"2024-04-17T15:40:05.775118+0000","last_clean":"2024-04-17T15:40:05.775118+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:40:05.775118+0000","last_undegraded":"2024-04-17T15:40:05.775118+0000","last_fullsized":"2024-04-17T15:40:05.775118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":177,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.421309+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:40:05.421309+0000","last_peered":"2024-04-17T15:40:05.421309+0000","last_clean":"2024-04-17T15:40:05.421309+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:40:05.421309+0000","last_undegraded":"2024-04-17T15:40:05.421309+0000","last_fullsized":"2024-04-17T15:40:05.421309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"98'13","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766543+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:40:05.766543+0000","last_peered":"2024-04-17T15:40:05.766543+0000","last_clean":"2024-04-17T15:40:05.766543+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:40:05.766543+0000","last_undegraded":"2024-04-17T15:40:05.766543+0000","last_fullsized":"2024-04-17T15:40:05.766543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.768290+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:40:05.768290+0000","last_peered":"2024-04-17T15:40:05.768290+0000","last_clean":"2024-04-17T15:40:05.768290+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:40:05.768290+0000","last_undegraded":"2024-04-17T15:40:05.768290+0000","last_fullsized":"2024-04-17T15:40:05.768290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"98'19","reported_seq":146,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418014+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:40:05.418014+0000","last_peered":"2024-04-17T15:40:05.418014+0000","last_clean":"2024-04-17T15:40:05.418014+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:40:05.418014+0000","last_undegraded":"2024-04-17T15:40:05.418014+0000","last_fullsized":"2024-04-17T15:40:05.418014+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":183,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418941+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:40:05.418941+0000","last_peered":"2024-04-17T15:40:05.418941+0000","last_clean":"2024-04-17T15:40:05.418941+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:40:05.418941+0000","last_undegraded":"2024-04-17T15:40:05.418941+0000","last_fullsized":"2024-04-17T15:40:05.418941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"98'24","reported_seq":205,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.422090+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:40:05.422090+0000","last_peered":"2024-04-17T15:40:05.422090+0000","last_clean":"2024-04-17T15:40:05.422090+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:40:05.422090+0000","last_undegraded":"2024-04-17T15:40:05.422090+0000","last_fullsized":"2024-04-17T15:40:05.422090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767056+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:40:05.767056+0000","last_peered":"2024-04-17T15:40:05.767056+0000","last_clean":"2024-04-17T15:40:05.767056+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:40:05.767056+0000","last_undegraded":"2024-04-17T15:40:05.767056+0000","last_fullsized":"2024-04-17T15:40:05.767056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"98'19","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773225+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:40:05.773225+0000","last_peered":"2024-04-17T15:40:05.773225+0000","last_clean":"2024-04-17T15:40:05.773225+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:40:05.773225+0000","last_undegraded":"2024-04-17T15:40:05.773225+0000","last_fullsized":"2024-04-17T15:40:05.773225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":201,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767258+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:40:05.767258+0000","last_peered":"2024-04-17T15:40:05.767258+0000","last_clean":"2024-04-17T15:40:05.767258+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:40:05.767258+0000","last_undegraded":"2024-04-17T15:40:05.767258+0000","last_fullsized":"2024-04-17T15:40:05.767258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"98'13","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769536+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:40:05.769536+0000","last_peered":"2024-04-17T15:40:05.769536+0000","last_clean":"2024-04-17T15:40:05.769536+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:40:05.769536+0000","last_undegraded":"2024-04-17T15:40:05.769536+0000","last_fullsized":"2024-04-17T15:40:05.769536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":202,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769779+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:40:05.769779+0000","last_peered":"2024-04-17T15:40:05.769779+0000","last_clean":"2024-04-17T15:40:05.769779+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:40:05.769779+0000","last_undegraded":"2024-04-17T15:40:05.769779+0000","last_fullsized":"2024-04-17T15:40:05.769779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"98'18","reported_seq":199,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.774210+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:40:05.774210+0000","last_peered":"2024-04-17T15:40:05.774210+0000","last_clean":"2024-04-17T15:40:05.774210+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:40:05.774210+0000","last_undegraded":"2024-04-17T15:40:05.774210+0000","last_fullsized":"2024-04-17T15:40:05.774210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":229,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418233+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:40:05.418233+0000","last_peered":"2024-04-17T15:40:05.418233+0000","last_clean":"2024-04-17T15:40:05.418233+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:40:05.418233+0000","last_undegraded":"2024-04-17T15:40:05.418233+0000","last_fullsized":"2024-04-17T15:40:05.418233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"98'13","reported_seq":193,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767429+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:40:05.767429+0000","last_peered":"2024-04-17T15:40:05.767429+0000","last_clean":"2024-04-17T15:40:05.767429+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:40:05.767429+0000","last_undegraded":"2024-04-17T15:40:05.767429+0000","last_fullsized":"2024-04-17T15:40:05.767429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":176,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417450+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:40:05.417450+0000","last_peered":"2024-04-17T15:40:05.417450+0000","last_clean":"2024-04-17T15:40:05.417450+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:40:05.417450+0000","last_undegraded":"2024-04-17T15:40:05.417450+0000","last_fullsized":"2024-04-17T15:40:05.417450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"98'14","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.775123+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:40:05.775123+0000","last_peered":"2024-04-17T15:40:05.775123+0000","last_clean":"2024-04-17T15:40:05.775123+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:40:05.775123+0000","last_undegraded":"2024-04-17T15:40:05.775123+0000","last_fullsized":"2024-04-17T15:40:05.775123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"90'2","reported_seq":184,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.418837+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:40:05.418837+0000","last_peered":"2024-04-17T15:40:05.418837+0000","last_clean":"2024-04-17T15:40:05.418837+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:40:05.418837+0000","last_undegraded":"2024-04-17T15:40:05.418837+0000","last_fullsized":"2024-04-17T15:40:05.418837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"98'17","reported_seq":198,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766670+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:40:05.766670+0000","last_peered":"2024-04-17T15:40:05.766670+0000","last_clean":"2024-04-17T15:40:05.766670+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:40:05.766670+0000","last_undegraded":"2024-04-17T15:40:05.766670+0000","last_fullsized":"2024-04-17T15:40:05.766670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":174,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.772186+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:40:05.772186+0000","last_peered":"2024-04-17T15:40:05.772186+0000","last_clean":"2024-04-17T15:40:05.772186+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:40:05.772186+0000","last_undegraded":"2024-04-17T15:40:05.772186+0000","last_fullsized":"2024-04-17T15:40:05.772186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"98'16","reported_seq":196,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769123+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:40:05.769123+0000","last_peered":"2024-04-17T15:40:05.769123+0000","last_clean":"2024-04-17T15:40:05.769123+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:40:05.769123+0000","last_undegraded":"2024-04-17T15:40:05.769123+0000","last_fullsized":"2024-04-17T15:40:05.769123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":177,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.766337+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:40:05.766337+0000","last_peered":"2024-04-17T15:40:05.766337+0000","last_clean":"2024-04-17T15:40:05.766337+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:40:05.766337+0000","last_undegraded":"2024-04-17T15:40:05.766337+0000","last_fullsized":"2024-04-17T15:40:05.766337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"98'17","reported_seq":195,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773406+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:40:05.773406+0000","last_peered":"2024-04-17T15:40:05.773406+0000","last_clean":"2024-04-17T15:40:05.773406+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:40:05.773406+0000","last_undegraded":"2024-04-17T15:40:05.773406+0000","last_fullsized":"2024-04-17T15:40:05.773406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":136,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.416220+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:40:05.416220+0000","last_peered":"2024-04-17T15:40:05.416220+0000","last_clean":"2024-04-17T15:40:05.416220+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:40:05.416220+0000","last_undegraded":"2024-04-17T15:40:05.416220+0000","last_fullsized":"2024-04-17T15:40:05.416220+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"98'9","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417921+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:40:05.417921+0000","last_peered":"2024-04-17T15:40:05.417921+0000","last_clean":"2024-04-17T15:40:05.417921+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:40:05.417921+0000","last_undegraded":"2024-04-17T15:40:05.417921+0000","last_fullsized":"2024-04-17T15:40:05.417921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.767808+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:40:05.767808+0000","last_peered":"2024-04-17T15:40:05.767808+0000","last_clean":"2024-04-17T15:40:05.767808+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:40:05.767808+0000","last_undegraded":"2024-04-17T15:40:05.767808+0000","last_fullsized":"2024-04-17T15:40:05.767808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"98'19","reported_seq":147,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.417732+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:40:05.417732+0000","last_peered":"2024-04-17T15:40:05.417732+0000","last_clean":"2024-04-17T15:40:05.417732+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:40:05.417732+0000","last_undegraded":"2024-04-17T15:40:05.417732+0000","last_fullsized":"2024-04-17T15:40:05.417732+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"98'27","reported_seq":207,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.773978+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:40:05.773978+0000","last_peered":"2024-04-17T15:40:05.773978+0000","last_clean":"2024-04-17T15:40:05.773978+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:40:05.773978+0000","last_undegraded":"2024-04-17T15:40:05.773978+0000","last_fullsized":"2024-04-17T15:40:05.773978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":185,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.769641+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:40:05.769641+0000","last_peered":"2024-04-17T15:40:05.769641+0000","last_clean":"2024-04-17T15:40:05.769641+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:40:05.769641+0000","last_undegraded":"2024-04-17T15:40:05.769641+0000","last_fullsized":"2024-04-17T15:40:05.769641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"98'9","reported_seq":190,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.420376+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:40:05.420376+0000","last_peered":"2024-04-17T15:40:05.420376+0000","last_clean":"2024-04-17T15:40:05.420376+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:40:05.420376+0000","last_undegraded":"2024-04-17T15:40:05.420376+0000","last_fullsized":"2024-04-17T15:40:05.420376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":194,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-17T15:40:05.770728+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:40:05.770728+0000","last_peered":"2024-04-17T15:40:05.770728+0000","last_clean":"2024-04-17T15:40:05.770728+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:40:05.770728+0000","last_undegraded":"2024-04-17T15:40:05.770728+0000","last_fullsized":"2024-04-17T15:40:05.770728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":308,"num_write":271,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":952,"ondisk_log_size":952,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":258312,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":832,"num_read_kb":597,"num_write":457,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":778240,"data_stored":476764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":711,"ondisk_log_size":711,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":394,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1374,"num_read_kb":1346,"num_write":284,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4206886912,"num_objects":1005,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":1089,"num_write_kb":4136960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8413773824,"data_stored":8413773824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1019,"ondisk_log_size":1019,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1247724,"kb_used_data":1216540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93124116,"statfs":{"total":96636764160,"available":95359094784,"internally_reserved":0,"allocated":1245736960,"data_stored":1245160821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":782148,"kb_used_data":750964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93589692,"statfs":{"total":96636764160,"available":95835844608,"internally_reserved":0,"allocated":768987136,"data_stored":768449676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191628,"kb_used_data":1160444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93180212,"statfs":{"total":96636764160,"available":95416537088,"internally_reserved":0,"allocated":1188294656,"data_stored":1187706550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1255064,"kb_used_data":1223876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93116776,"statfs":{"total":96636764160,"available":95351578624,"internally_reserved":0,"allocated":1253249024,"data_stored":1252723776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1210048,"kb_used_data":1178860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93161792,"statfs":{"total":96636764160,"available":95397675008,"internally_reserved":0,"allocated":1207152640,"data_stored":1206588726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":755412,"kb_used_data":724224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93616428,"statfs":{"total":96636764160,"available":95863222272,"internally_reserved":0,"allocated":741605376,"data_stored":741076961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":734912,"kb_used_data":703724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93636928,"statfs":{"total":96636764160,"available":95884214272,"internally_reserved":0,"allocated":720613376,"data_stored":720049305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1300720,"kb_used_data":1269536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93071120,"statfs":{"total":96636764160,"available":95304826880,"internally_reserved":0,"allocated":1300004864,"data_stored":1299453605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1298137088,"data_stored":1298137088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":719323136,"data_stored":719323136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":740294656,"data_stored":740294656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1205862400,"data_stored":1205862400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1251999744,"data_stored":1251999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":767557632,"data_stored":767557632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1243611136,"data_stored":1243611136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":58539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":176172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:40:10.257 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-17T15:40:10.257 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-17T15:40:10.257 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-17T15:40:10.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-17T15:40:10.270 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:10.270 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:10.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:40:10.332 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:10.332+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:10.396 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:10.397+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:10.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:40:10.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-17T15:40:10.449 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:10.449 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:10.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:40:10.497 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:10.497+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:10.541 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:10.541 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:10.558 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:10.559 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:10.577 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:10.577 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:10.594 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:10.594 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:10.597 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:10.597+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:10.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-17T15:40:10.615 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:10.615 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:10.618 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:10.618 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:10.632 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:40:10.635 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:10.636 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:10.655 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:10.675 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:10.698 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:10.697+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:10.747 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:10.747 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:10.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:40:10.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-04-17T15:40:10.793 INFO:tasks.workunit.client.0.smithi044.stderr:200+0 records in 2024-04-17T15:40:10.793 INFO:tasks.workunit.client.0.smithi044.stderr:200+0 records out 2024-04-17T15:40:10.793 INFO:tasks.workunit.client.0.smithi044.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.7405 s, 153 MB/s 2024-04-17T15:40:10.835 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:10.836+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:10.885 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2193 3.1a e76/18 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head v 76'2, mlcod=0'0)", 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 78.812225349000002, 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023831801, 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.074764+0000", 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7399999999999999e-07 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080811+0000", 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060470369999999999 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080830+0000", 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9318e-05 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080842+0000", 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2174000000000001e-05 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081004+0000", 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016199699999999999 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.081044+0000", 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.9832000000000001e-05 2024-04-17T15:40:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098477+0000", 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017432308000000001 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098595+0000", 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118861 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2194 3.0 3:0266da1c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 78.808858846999996, 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020588559999999999, 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2194 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078130+0000", 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.078132+0000", 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2120000000000002e-06 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080175+0000", 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020426369999999999 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080203+0000", 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7529999999999999e-05 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080216+0000", 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3446e-05 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080294+0000", 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7627999999999996e-05 2024-04-17T15:40:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080431+0000", 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137434 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.080547+0000", 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115522 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.096821+0000", 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016274413000000001 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098507+0000", 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001685736 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098615+0000", 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000108093 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.098719+0000", 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103909 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2250 3.19 3:9a4c8e7c:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 78.231659089000004, 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019244893999999999, 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2250 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655330+0000", 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.655334+0000", 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.656993+0000", 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0016590470000000001 2024-04-17T15:40:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657026+0000", 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3436000000000003e-05 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657042+0000", 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6126000000000001e-05 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657138+0000", 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5926000000000003e-05 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657352+0000", 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021378200000000001 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.657530+0000", 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017787599999999999 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.671804+0000", 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014274548999999999 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674442+0000", 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026373490000000002 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674517+0000", 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5203000000000005e-05 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.674575+0000", 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7790000000000001e-05 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2646 3.8 e89/18 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head v 89'5, mlcod=76'3)", 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 42.146463365999999, 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018982274, 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740526+0000", 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740529+0000", 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9660000000000001e-06 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745823+0000", 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052946060000000003 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745886+0000", 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3251999999999997e-05 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.745910+0000", 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3964e-05 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746063+0000", 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015276100000000001 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.746089+0000", 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6180999999999999e-05 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759412+0000", 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013322387999999999 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759508+0000", 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6156000000000006e-05 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2663 3.0 3:00b68c77:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.763356944000002, 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020648330999999999, 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2663 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123632+0000", 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.123635+0000", 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.066e-06 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126602+0000", 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029664679999999999 2024-04-17T15:40:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126640+0000", 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.82e-05 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126654+0000", 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4440000000000001e-05 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126752+0000", 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7879000000000003e-05 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.126948+0000", 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000195983 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.127139+0000", 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019063500000000001 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.143125+0000", 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015986416999999999 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144087+0000", 2024-04-17T15:40:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00096153799999999995 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144196+0000", 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010974199999999999 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.144280+0000", 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3962999999999996e-05 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2669 3.4 3:2238a661:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.621709314999997, 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020392082999999998, 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2669 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265280+0000", 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.265285+0000", 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4729999999999999e-06 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268400+0000", 2024-04-17T15:40:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003114618 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268449+0000", 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9462999999999997e-05 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268477+0000", 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7440000000000002e-05 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268646+0000", 2024-04-17T15:40:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016956299999999999 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.268970+0000", 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00032326799999999998 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.269256+0000", 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028625100000000001 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.278736+0000", 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0094797909999999996 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285472+0000", 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067364429999999999 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285588+0000", 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000116452 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.285672+0000", 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3320999999999997e-05 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2673 3.3e 3:7c55c310:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.521920792000003, 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020262019999999999, 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2673 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365068+0000", 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.365073+0000", 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7999999999999998e-06 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368449+0000", 2024-04-17T15:40:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003376146 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368509+0000", 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0312999999999997e-05 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368541+0000", 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1803e-05 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.368708+0000", 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016662099999999999 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369022+0000", 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00031360099999999999 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.369297+0000", 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027513 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.378587+0000", 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092898990000000008 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385219+0000", 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066324770000000003 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385281+0000", 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1766000000000005e-05 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.385330+0000", 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9463999999999999e-05 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2684 3.6 e89/18 3:6370ca0a:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_39:head v 89'3, mlcod=76'1)", 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.287487652999999, 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019575401999999999, 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599501+0000", 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.599504+0000", 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3599999999999999e-06 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604610+0000", 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051064400000000003 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604655+0000", 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4943e-05 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604679+0000", 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3572999999999999e-05 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604878+0000", 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019935600000000001 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.604944+0000", 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5869000000000002e-05 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.618945+0000", 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014001095999999999 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.619077+0000", 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131765 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2686 3.3e 3:7c7e4e92:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.248900880000001, 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024025214999999999, 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2686 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638088+0000", 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.638092+0000", 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.743e-06 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643705+0000", 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056133939999999998 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643768+0000", 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.2983000000000003e-05 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643797+0000", 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8656000000000001e-05 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.643979+0000", 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018241199999999999 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644258+0000", 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000278848 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.644492+0000", 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023429200000000001 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.658683+0000", 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014190408 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.661860+0000", 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031772839999999998 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662022+0000", 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016153900000000001 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.662113+0000", 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1656000000000005e-05 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2691 3.3e 3:7c0d9124:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.141503901, 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018482157999999999, 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2691 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745485+0000", 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.745489+0000", 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.703e-06 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748279+0000", 2024-04-17T15:40:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027905669999999999 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748329+0000", 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9353e-05 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748357+0000", 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8575999999999999e-05 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748540+0000", 2024-04-17T15:40:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018234300000000001 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.748940+0000", 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040061699999999998 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.749226+0000", 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028620000000000002 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.762456+0000", 2024-04-17T15:40:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013229925999999999 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763785+0000", 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00132825 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763889+0000", 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104616 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.763967+0000", 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8007e-05 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2696 3.31 3:8e0a861b:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.039523791000001, 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019128764999999999, 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2696 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847465+0000", 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.847469+0000", 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4249999999999998e-06 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849776+0000", 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023068659999999999 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849808+0000", 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2363000000000002e-05 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849823+0000", 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5238e-05 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.849950+0000", 2024-04-17T15:40:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012710600000000001 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850228+0000", 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000277915 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.850487+0000", 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025900899999999999 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.858273+0000", 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077861379999999997 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866446+0000", 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081723060000000007 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866526+0000", 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0242999999999997e-05 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.866594+0000", 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8156000000000003e-05 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2731 3.25 3:a7c57b71:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.624915223999999, 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022381027000000001, 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2731 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262074+0000", 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.262078+0000", 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8940000000000003e-06 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264600+0000", 2024-04-17T15:40:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0025222119999999998 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264637+0000", 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6875000000000002e-05 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264652+0000", 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4908e-05 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264756+0000", 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104163 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.264918+0000", 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016187100000000001 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.265111+0000", 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019296999999999999 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.275063+0000", 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0099523719999999993 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284321+0000", 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092580249999999996 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284399+0000", 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7761000000000003e-05 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.284455+0000", 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5976000000000001e-05 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2749 3.31 3:8ffe76ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 40.417601884, 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019338203000000002, 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2749 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469387+0000", 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.469390+0000", 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.402e-06 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471361+0000", 2024-04-17T15:40:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019715980000000002 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471390+0000", 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9351000000000001e-05 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471405+0000", 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4346e-05 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471500+0000", 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4970999999999996e-05 2024-04-17T15:40:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471683+0000", 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018349600000000001 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.471860+0000", 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017656400000000001 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.479403+0000", 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0075432010000000002 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488606+0000", 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092024670000000006 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488673+0000", 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.7230999999999994e-05 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.488725+0000", 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2575999999999999e-05 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3191 3.19 3:995acef5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.808651582, 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023716885, 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3191 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078337+0000", 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.078341+0000", 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0269999999999997e-06 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081493+0000", 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031513700000000001 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081523+0000", 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.027e-05 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081539+0000", 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6379999999999999e-05 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081612+0000", 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2286000000000006e-05 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081757+0000", 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014521799999999999 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.081891+0000", 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013438799999999999 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.089902+0000", 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080110170000000005 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.101929+0000", 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012026714000000001 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102002+0000", 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2972999999999994e-05 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.102054+0000", 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2241999999999999e-05 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3194 3.31 3:8d6d9ccc:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.763041436000002, 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019551065999999999, 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3194 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123948+0000", 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.123951+0000", 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6049999999999998e-06 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127418+0000", 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.003467206 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127479+0000", 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1056000000000006e-05 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127509+0000", 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9796999999999999e-05 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127642+0000", 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013244400000000001 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.127865+0000", 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00022359999999999999 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.128070+0000", 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000204234 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.136260+0000", 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081904179999999997 2024-04-17T15:40:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143325+0000", 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070648309999999997 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143424+0000", 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9182e-05 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.143499+0000", 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4692999999999998e-05 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3214 3.1a e97/18 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head v 97'17, mlcod=96'15)", 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.509799839999999, 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019376285, 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377189+0000", 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.377191+0000", 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6449999999999999e-06 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383962+0000", 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067710490000000003 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.383992+0000", 2024-04-17T15:40:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9745000000000001e-05 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384007+0000", 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5573000000000002e-05 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384103+0000", 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.5511000000000001e-05 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384130+0000", 2024-04-17T15:40:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7755000000000001e-05 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396497+0000", 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012366769999999999 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396565+0000", 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8237000000000004e-05 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3246 3.25 3:a59a480d:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.129798367999999, 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020455952999999999, 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3246 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757191+0000", 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.757194+0000", 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0000000000000001e-06 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760651+0000", 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0034570289999999999 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760693+0000", 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2763999999999999e-05 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760716+0000", 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2467e-05 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.760894+0000", 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000177775 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761181+0000", 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00028763399999999999 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761473+0000", 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029150999999999998 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.772290+0000", 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010816698 2024-04-17T15:40:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777506+0000", 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052165019999999996 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777587+0000", 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1228000000000002e-05 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.777647+0000", 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9345999999999997e-05 2024-04-17T15:40:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3292 3.19 3:9a68834c:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.558107788000001, 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018305169999999999, 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3292 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328881+0000", 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.328885+0000", 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4939999999999999e-06 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331134+0000", 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022493460000000002 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331171+0000", 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7119000000000002e-05 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331188+0000", 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7252e-05 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331289+0000", 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000100369 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331483+0000", 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000194286 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.331665+0000", 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018169099999999999 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.341800+0000", 2024-04-17T15:40:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0101356 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347049+0000", 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0052490499999999999 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347125+0000", 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5731999999999999e-05 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.347186+0000", 2024-04-17T15:40:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1230999999999997e-05 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3327 3.25 3:a5e282f6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_262:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.260726090999999, 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018341494, 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3327 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626263+0000", 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.626267+0000", 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6160000000000002e-06 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628501+0000", 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022339870000000002 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628532+0000", 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1730000000000003e-05 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628545+0000", 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3176999999999999e-05 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628614+0000", 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8384000000000001e-05 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628732+0000", 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117927 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.628864+0000", 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013266600000000001 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.641855+0000", 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012990431 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644472+0000", 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026173619999999998 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644543+0000", 2024-04-17T15:40:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1144999999999997e-05 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.644604+0000", 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1068999999999994e-05 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3355 3.4 3:2266acf0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_290:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 16.937448658000001, 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021132874999999999, 2024-04-17T15:40:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3355 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949540+0000", 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.949543+0000", 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8720000000000002e-06 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951012+0000", 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0014686160000000001 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951044+0000", 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1951e-05 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951056+0000", 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2502e-05 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951139+0000", 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3190999999999997e-05 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951312+0000", 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017254799999999999 2024-04-17T15:40:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.951475+0000", 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016339800000000001 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.956582+0000", 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051069840000000002 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970578+0000", 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013995914999999999 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970625+0000", 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6487999999999999e-05 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.970673+0000", 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8409999999999999e-05 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:10.982 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:10.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:40:10.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-04-17T15:40:10.985 INFO:tasks.workunit.client.0.smithi044.stdout:Bucket Created: buck_2024_03_17_15_40_10 2024-04-17T15:40:10.985 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:10.985+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:11.085 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:11.085+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:11.148 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:11.148 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:11.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:40:11.186 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:11.185+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:11.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-04-17T15:40:11.256 INFO:tasks.workunit.client.0.smithi044.stdout:bucket quota max size set for the given user: buck_2024_03_17_15_40_10 2024-04-17T15:40:11.283 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:11.284 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:11.287 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:11.289+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:11.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:40:11.388 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:11.389+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:11.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 79.199092418000006, 2024-04-17T15:40:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:40:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:40:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:40:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 79.068633031999994, 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:40:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:40:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:40:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:40:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:40:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 78.973994700000006, 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:40:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:40:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:40:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 78.954538260999996, 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 78.768043050000003, 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2655 3.3b e89/18 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head v 89'7, mlcod=76'5)", 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 42.553532746000002, 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022625060999999998, 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5600000000000004e-07 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.937998+0000", 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059469739999999998 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938039+0000", 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0113e-05 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938062+0000", 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3807000000000001e-05 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938236+0000", 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403500000000001 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938303+0000", 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6190000000000002e-05 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954503+0000", 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016200763999999999 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954676+0000", 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017232200000000001 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2656 3.16 3:6ad2ad56:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 42.534349444, 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022969676000000001, 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2656 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951237+0000", 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.264e-06 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956406+0000", 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051685460000000004 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956439+0000", 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2959000000000001e-05 2024-04-17T15:40:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956456+0000", 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7217000000000001e-05 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956609+0000", 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015330899999999999 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956880+0000", 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027084100000000002 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.957130+0000", 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025006900000000001 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.966230+0000", 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009099434 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974022+0000", 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077925549999999996 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974126+0000", 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103706 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974204+0000", 2024-04-17T15:40:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7775999999999995e-05 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2664 3.21 3:84c31c70:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 42.337417535999997, 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019486428, 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2664 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148169+0000", 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0070000000000002e-06 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151347+0000", 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031786599999999998 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151397+0000", 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9317000000000002e-05 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151417+0000", 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.012e-05 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151540+0000", 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012354900000000001 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151802+0000", 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026111400000000001 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151955+0000", 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015302 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.159770+0000", 2024-04-17T15:40:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078157350000000007 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167530+0000", 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077592989999999999 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167595+0000", 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5320999999999993e-05 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167652+0000", 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7286e-05 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2689 3.2d e89/18 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head v 89'5, mlcod=77'3)", 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.779952121999997, 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023548848000000001, 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705634+0000", 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0929999999999999e-06 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711102+0000", 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054679810000000002 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711146+0000", 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3940000000000003e-05 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711170+0000", 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4283000000000001e-05 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711304+0000", 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013349999999999999 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711341+0000", 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6803e-05 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729020+0000", 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017679553000000001 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729180+0000", 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015969500000000001 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3161 3.2e 3:77c0c5b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.785679911999999, 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018746992000000001, 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3161 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699907+0000", 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3390000000000001e-06 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702202+0000", 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022948840000000001 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702230+0000", 2024-04-17T15:40:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8513999999999998e-05 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702241+0000", 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1083999999999999e-05 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702340+0000", 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8443000000000006e-05 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702543+0000", 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020311 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702723+0000", 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000180235 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.714838+0000", 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012114583 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718506+0000", 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036683530000000001 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718587+0000", 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1254999999999994e-05 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718650+0000", 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3192000000000001e-05 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3174 3.21 3:84a9f215:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.643702736000002, 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018361252000000002, 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3174 2024-04-17T15:40:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841884+0000", 2024-04-17T15:40:11.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2490000000000001e-06 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844049+0000", 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021650620000000001 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844073+0000", 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3893999999999999e-05 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844085+0000", 2024-04-17T15:40:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1963e-05 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844179+0000", 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4195000000000002e-05 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844385+0000", 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206331 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844583+0000", 2024-04-17T15:40:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019758899999999999 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.857179+0000", 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012595705 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860113+0000", 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029346950000000002 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860184+0000", 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0852999999999994e-05 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860242+0000", 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7716000000000001e-05 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3188 3.2f 3:f4860977:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.473406803, 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019398723999999999, 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3188 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012181+0000", 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4129999999999999e-06 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014461+0000", 2024-04-17T15:40:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022799539999999998 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014506+0000", 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5529999999999999e-05 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014526+0000", 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9542999999999999e-05 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014635+0000", 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010869700000000001 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014813+0000", 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178128 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.015010+0000", 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000197111 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.023029+0000", 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080189619999999993 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031512+0000", 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084828179999999996 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031549+0000", 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6944999999999999e-05 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031575+0000", 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6622999999999999e-05 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3195 3.16 3:6892fdae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.338732563000001, 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021725749999999999, 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3195 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146855+0000", 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8800000000000001e-06 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150499+0000", 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036446019999999998 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150530+0000", 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1099999999999997e-05 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150543+0000", 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2847000000000001e-05 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150617+0000", 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4294000000000004e-05 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150741+0000", 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123731 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150854+0000", 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.157302+0000", 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064475870000000003 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168431+0000", 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011129847 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168516+0000", 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4331000000000003e-05 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168577+0000", 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0785999999999997e-05 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3215 3.16 3:69d29e25:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.103718512, 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020347908000000001, 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3215 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381869+0000", 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8070000000000001e-06 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384172+0000", 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002302957 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384202+0000", 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0704000000000003e-05 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384216+0000", 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3376e-05 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384299+0000", 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3622000000000007e-05 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384481+0000", 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182086 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384646+0000", 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016434199999999999 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396642+0000", 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011996079 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402122+0000", 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054798360000000001 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402169+0000", 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7664000000000003e-05 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402213+0000", 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3435e-05 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3232 3.2e 3:77f4f650:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.908905967999999, 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020894309, 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3232 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576681+0000", 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3060000000000002e-06 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578598+0000", 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001917799 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578637+0000", 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8884000000000002e-05 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578654+0000", 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6578999999999998e-05 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578752+0000", 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8412000000000006e-05 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578884+0000", 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131359 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.579029+0000", 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014510799999999999 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.584890+0000", 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058607679999999997 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597433+0000", 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012543642000000001 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597513+0000", 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9538999999999999e-05 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597572+0000", 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8913000000000003e-05 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3243 3.21 3:86efebb2:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.776786819000002, 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018171970999999999, 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3243 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708799+0000", 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:40:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711223+0000", 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024239690000000002 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711252+0000", 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9176999999999999e-05 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711263+0000", 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1269e-05 2024-04-17T15:40:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711334+0000", 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0891999999999998e-05 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711467+0000", 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133306 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711580+0000", 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112734 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.719664+0000", 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080840129999999993 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726888+0000", 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072236660000000001 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726932+0000", 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4709000000000002e-05 2024-04-17T15:40:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726968+0000", 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6109000000000003e-05 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3245 3.24 3:26e56b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.745098110000001, 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020901084, 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3245 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740501+0000", 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5823000000000001e-05 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742689+0000", 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021879009999999999 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742737+0000", 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8519000000000001e-05 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742759+0000", 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.173e-05 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742848+0000", 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9116000000000005e-05 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743031+0000", 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018237599999999999 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743192+0000", 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000161461 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.749847+0000", 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066546610000000001 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761259+0000", 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011411813999999999 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761330+0000", 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1481000000000002e-05 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761386+0000", 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6202000000000002e-05 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3254 3.21 3:86770de1:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.621540264, 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022547540000000001, 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3254 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864046+0000", 2024-04-17T15:40:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.004e-06 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865763+0000", 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017173360000000001 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865809+0000", 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5519999999999998e-05 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865827+0000", 2024-04-17T15:40:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7716000000000001e-05 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865933+0000", 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010629 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866093+0000", 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000159946 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866220+0000", 2024-04-17T15:40:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127164 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.873221+0000", 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070009570000000004 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886373+0000", 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013151891000000001 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886502+0000", 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012948500000000001 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886591+0000", 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8231000000000003e-05 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3264 3.24 3:26cd557b:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.475852649, 2024-04-17T15:40:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020478857, 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3264 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009734+0000", 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011450+0000", 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017157369999999999 2024-04-17T15:40:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011475+0000", 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5151999999999999e-05 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011488+0000", 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3740000000000001e-05 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011581+0000", 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.255e-05 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011705+0000", 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012390900000000001 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011811+0000", 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106111 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.019611+0000", 2024-04-17T15:40:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077997359999999998 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030126+0000", 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010514977999999999 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030173+0000", 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7451999999999999e-05 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030210+0000", 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6294000000000002e-05 2024-04-17T15:40:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3343 3.16 3:6ae5c866:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_278:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 17.675039278, 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019911570999999999, 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3343 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810546+0000", 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.357e-06 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812931+0000", 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023841180000000002 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812960+0000", 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9677999999999999e-05 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812971+0000", 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1259e-05 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813071+0000", 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9406000000000003e-05 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813247+0000", 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000176429 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813415+0000", 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016733000000000001 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.824091+0000", 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010676296 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830354+0000", 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006263294 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830402+0000", 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8155999999999998e-05 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830456+0000", 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3248000000000002e-05 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:11.593 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:11.594 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-17T15:40:11.595 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:40:11.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-04-17T15:40:11.597 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:11.592+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:11.696 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:11.697+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:11.752 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:11.752 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:11.770 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:40:11.815 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:11.816+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:11.878 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:11.879 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:11.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:40:11.935 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:11.936+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:11.998 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:11.996+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:12.001 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 79.873480943000004, 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:40:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 79.861705022999999, 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:40:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:40:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 79.419961349999994, 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:40:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:40:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 79.293317385999998, 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:40:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2276 3.2 3:413eb100:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 79.071345519000005, 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020329113999999999, 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2276 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931292+0000", 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.931295+0000", 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6189999999999998e-06 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936287+0000", 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049920559999999999 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936310+0000", 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3538000000000001e-05 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936322+0000", 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1739000000000001e-05 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936395+0000", 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2521000000000006e-05 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936512+0000", 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117872 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.936622+0000", 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010926599999999999 2024-04-17T15:40:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.942455+0000", 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058337099999999998 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951496+0000", 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090407899999999999 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951571+0000", 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4361000000000002e-05 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.951621+0000", 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0642000000000001e-05 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2646 3.8 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 43.268072635000003, 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025266311, 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2646 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734569+0000", 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739260+0000", 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046916730000000004 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739303+0000", 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2799000000000001e-05 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739322+0000", 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8389999999999998e-05 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739489+0000", 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167016 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739896+0000", 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040707699999999999 2024-04-17T15:40:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740309+0000", 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041348699999999998 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.754426+0000", 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014117002 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759750+0000", 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053237900000000001 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759800+0000", 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0405000000000003e-05 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759831+0000", 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0861999999999997e-05 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2688 3.18 3:1b829d89:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 42.318837037999998, 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023433995999999999, 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2688 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683806+0000", 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2000000000000002e-06 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688730+0000", 2024-04-17T15:40:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049237680000000002 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688789+0000", 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9469999999999998e-05 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688813+0000", 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4253e-05 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688955+0000", 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014158899999999999 2024-04-17T15:40:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689247+0000", 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029219100000000002 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689484+0000", 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023730499999999999 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705954+0000", 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016469461000000001 2024-04-17T15:40:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707072+0000", 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001118427 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707163+0000", 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1199999999999994e-05 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707235+0000", 2024-04-17T15:40:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1131999999999996e-05 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2737 3.8 3:1044985e:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.668645732000002, 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024601553000000002, 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2737 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333996+0000", 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8929999999999998e-06 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335595+0000", 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015994550000000001 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335629+0000", 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335645+0000", 2024-04-17T15:40:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6597999999999999e-05 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335729+0000", 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3633000000000004e-05 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op must wait for map", 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335735+0000", 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339342+0000", 2024-04-17T15:40:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036071340000000001 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339550+0000", 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020780199999999999 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339728+0000", 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178734 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354941+0000", 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015212356 2024-04-17T15:40:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358485+0000", 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035443250000000001 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358544+0000", 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8888000000000003e-05 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358593+0000", 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9557e-05 2024-04-17T15:40:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2736 3.5 e90/18 3:a18cd429:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_91:head v 90'5, mlcod=76'3)", 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.666905552999999, 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020182848, 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335732+0000", 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335733+0000", 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5799999999999999e-07 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339776+0000", 2024-04-17T15:40:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040432940000000002 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339787+0000", 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0671e-05 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339795+0000", 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0639999999999994e-06 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339845+0000", 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0086000000000001e-05 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339891+0000", 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5849000000000001e-05 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.355857+0000", 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015966774999999999 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.355915+0000", 2024-04-17T15:40:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7451000000000003e-05 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2757 3.7 3:e214b53f:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 41.438262795, 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020206643999999999, 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2757 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564375+0000", 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.564377+0000", 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2510000000000001e-06 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566069+0000", 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001691981 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566102+0000", 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3061000000000001e-05 2024-04-17T15:40:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566118+0000", 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6045999999999998e-05 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566256+0000", 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000137527 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566449+0000", 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019308500000000001 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.566611+0000", 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016235500000000001 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.573412+0000", 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068006849999999999 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584453+0000", 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011041146 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584525+0000", 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.2512e-05 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.584581+0000", 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.5995000000000002e-05 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3200 3.33 3:cc4ca667:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.785311629999999, 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020688749999999999, 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3200 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217326+0000", 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.217328+0000", 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6920000000000001e-06 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219299+0000", 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019712150000000001 2024-04-17T15:40:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219323+0000", 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4076000000000001e-05 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219337+0000", 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3767e-05 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219426+0000", 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9279999999999999e-05 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219636+0000", 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00021027400000000001 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.219804+0000", 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167629 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.228577+0000", 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0087731679999999996 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.237862+0000", 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0092845170000000008 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.237943+0000", 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1642000000000002e-05 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.238015+0000", 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1489999999999995e-05 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3208 3.1e 3:7bf3f1fd:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.696924318000001, 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024643996000000001, 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3208 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305716+0000", 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8609999999999998e-06 2024-04-17T15:40:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307655+0000", 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001938546 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307680+0000", 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5238000000000001e-05 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307695+0000", 2024-04-17T15:40:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5133000000000001e-05 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307786+0000", 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0728000000000003e-05 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307955+0000", 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016871400000000001 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.308078+0000", 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012391 2024-04-17T15:40:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.317113+0000", 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090349109999999996 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330212+0000", 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013098344 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330292+0000", 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0183000000000001e-05 2024-04-17T15:40:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330357+0000", 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5427999999999998e-05 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3237 3.33 3:cc5684ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.371689383, 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022846793000000001, 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3237 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630950+0000", 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7039999999999999e-06 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632791+0000", 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018406119999999999 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632820+0000", 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9380999999999999e-05 2024-04-17T15:40:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632834+0000", 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4345000000000001e-05 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632926+0000", 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2145999999999995e-05 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633056+0000", 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012976700000000001 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633198+0000", 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000141342 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.639250+0000", 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006052605 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653695+0000", 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014444988000000001 2024-04-17T15:40:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653741+0000", 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5556000000000002e-05 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653795+0000", 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4347e-05 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3242 3.33 3:cc808c01:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.307069254999998, 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020918729, 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3242 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695572+0000", 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5769999999999998e-06 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697488+0000", 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001916189 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697516+0000", 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8093999999999999e-05 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697529+0000", 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3158e-05 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697639+0000", 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109227 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697845+0000", 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206226 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.698025+0000", 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179987 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.705449+0000", 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.007424445 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716350+0000", 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010900734 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716426+0000", 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5622000000000002e-05 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716487+0000", 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1470000000000006e-05 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3250 3.7 3:e148f750:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.1853546, 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021674067000000002, 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3250 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817288+0000", 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7299999999999996e-06 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820832+0000", 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035441740000000002 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820870+0000", 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7565999999999999e-05 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820885+0000", 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5132e-05 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821009+0000", 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124475 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821146+0000", 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013711600000000001 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821247+0000", 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010072400000000001 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.827312+0000", 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060654389999999997 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838765+0000", 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011452208 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838888+0000", 2024-04-17T15:40:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123771 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838957+0000", 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8732000000000005e-05 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3252 3.2 3:40c9ca30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.165862762, 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022557901000000002, 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3252 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836777+0000", 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4949999999999998e-06 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843566+0000", 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067891239999999997 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843599+0000", 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2002999999999998e-05 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843614+0000", 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5957e-05 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843705+0000", 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0276000000000001e-05 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843902+0000", 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019734200000000001 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.844063+0000", 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160512 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.854965+0000", 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010902593 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859208+0000", 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0042428580000000004 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859279+0000", 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0858000000000005e-05 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859333+0000", 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3882999999999999e-05 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3257 3.29 3:97b19dae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.090030336000002, 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021952833000000001, 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3257 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912611+0000", 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0330000000000002e-06 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916649+0000", 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040378489999999996 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916685+0000", 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5646999999999999e-05 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916701+0000", 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6328e-05 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916812+0000", 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011056 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917015+0000", 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020336400000000001 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917200+0000", 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018441900000000001 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.926337+0000", 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091371060000000007 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934459+0000", 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081220489999999992 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934506+0000", 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7534999999999998e-05 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934560+0000", 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3943000000000002e-05 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3259 3.29 3:97b435f0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 19.056748837000001, 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021828215000000002, 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3259 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945892+0000", 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9679999999999998e-06 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.947986+0000", 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020939650000000001 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948032+0000", 2024-04-17T15:40:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6180999999999997e-05 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948055+0000", 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3031999999999999e-05 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948167+0000", 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011191700000000001 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948370+0000", 2024-04-17T15:40:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020330599999999999 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948569+0000", 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019869199999999999 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.956337+0000", 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077678039999999997 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967491+0000", 2024-04-17T15:40:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011154393 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967620+0000", 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012935299999999999 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967717+0000", 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6603999999999999e-05 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3274 3.38 3:1c6c0b46:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.869590383999999, 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020992581999999999, 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3274 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133050+0000", 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.88e-06 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135292+0000", 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022414240000000001 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135324+0000", 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000002e-05 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135342+0000", 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8808e-05 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135460+0000", 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118107 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135621+0000", 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016069599999999999 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135814+0000", 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000192793 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.142834+0000", 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070204389999999998 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.153823+0000", 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010988639999999999 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.153932+0000", 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010886400000000001 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.154040+0000", 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107951 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3297 3.2 3:4392bec4:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 18.614450096999999, 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020524942000000001, 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3297 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388188+0000", 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.388191+0000", 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2009999999999999e-06 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390093+0000", 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019019110000000001 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390128+0000", 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5043000000000003e-05 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390143+0000", 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5319999999999999e-05 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390237+0000", 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4327000000000007e-05 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390421+0000", 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018346500000000001 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.390590+0000", 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000169257 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.397780+0000", 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0071894719999999997 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408577+0000", 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010797899999999999 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408651+0000", 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3208999999999997e-05 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.408712+0000", 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1836999999999998e-05 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:12.109 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:12.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:40:12.111 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:12.109+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:12.211 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:12.212+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:12.245 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:12.245 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:12.245 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:40:12.245 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:12.260 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:40:12.312 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:12.312+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:12.379 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:12.379 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:12.379 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:40:12.379 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:40:12.379 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:12.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:40:12.439 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:12.441+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:12.486 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-17T15:40:12.514 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:12.513+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 93.706408178000004, 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.530 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:40:12.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:40:12.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:40:12.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2184 3.f e76/18 3:f35385ff:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_3:head v 76'2, mlcod=0'0)", 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 80.552230421999994, 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023396420000000001, 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976631+0000", 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.976632+0000", 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0359999999999999e-06 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984518+0000", 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078862359999999996 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984549+0000", 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1569999999999998e-05 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984570+0000", 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0704e-05 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984707+0000", 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013673799999999999 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.984765+0000", 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8266000000000001e-05 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.999902+0000", 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015137215000000001 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.000027+0000", 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012465499999999999 2024-04-17T15:40:12.539 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 80.539893929000002, 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.540 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:40:12.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:40:12.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:40:12.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 80.458857136999995, 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.546 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:40:12.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:40:12.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.902378274, 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:40:12.551 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:40:12.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:40:12.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:40:12.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.556 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2248 3.1c e76/18 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head v 76'2, mlcod=0'0)", 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.888920364000001, 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022866781999999999, 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639941+0000", 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639944+0000", 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4230000000000001e-06 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646504+0000", 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006560041 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646544+0000", 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0176999999999998e-05 2024-04-17T15:40:12.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646568+0000", 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4110000000000001e-05 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646788+0000", 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219118 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.646879+0000", 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1785000000000003e-05 2024-04-17T15:40:12.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662704+0000", 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015824936000000001 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662807+0000", 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103192 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.560 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2701 3.3 3:c3da646c:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.612861332999998, 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023302740999999998, 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2701 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:40:12.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916000+0000", 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.916003+0000", 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919735+0000", 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037320090000000001 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919758+0000", 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3213e-05 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919769+0000", 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0692e-05 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.919848+0000", 2024-04-17T15:40:12.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9340999999999998e-05 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.920004+0000", 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015543600000000001 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.920144+0000", 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140242 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.928075+0000", 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079310189999999992 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939200+0000", 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011125245000000001 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939256+0000", 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6320000000000003e-05 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:29.939302+0000", 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6026000000000003e-05 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.565 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2743 3.34 3:2f634024:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.124175170999997, 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025426936000000001, 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2743 2024-04-17T15:40:12.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404706+0000", 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9983000000000002e-05 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408933+0000", 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042273040000000003 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408972+0000", 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8495000000000003e-05 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408990+0000", 2024-04-17T15:40:12.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8219999999999998e-05 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.409170+0000", 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018019600000000001 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.409592+0000", 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042226600000000003 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410018+0000", 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042519299999999998 2024-04-17T15:40:12.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.428938+0000", 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018920248000000001 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430015+0000", 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001077103 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430067+0000", 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2494000000000003e-05 2024-04-17T15:40:12.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430113+0000", 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5433999999999999e-05 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.571 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2754 3.3 3:c015b210:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.006822337000003, 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022904342000000001, 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2754 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522039+0000", 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.522043+0000", 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8160000000000004e-06 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527193+0000", 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051507990000000002 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527235+0000", 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1306000000000001e-05 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527257+0000", 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2855999999999999e-05 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527445+0000", 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018744200000000001 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.527846+0000", 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040134300000000002 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.528089+0000", 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024270800000000001 2024-04-17T15:40:12.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.537308+0000", 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092189520000000007 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544773+0000", 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074648049999999997 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544869+0000", 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6643000000000003e-05 2024-04-17T15:40:12.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.544943+0000", 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3671999999999995e-05 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:2762 3.1 e90/18 3:82c647bc:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_117:head v 90'7, mlcod=89'5)", 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.901807269000003, 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023406844999999999, 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.577 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627054+0000", 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.627056+0000", 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5129999999999999e-06 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631125+0000", 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040686120000000001 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631161+0000", 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6239000000000003e-05 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631178+0000", 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6779999999999999e-05 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631336+0000", 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158379 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.631401+0000", 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4331999999999993e-05 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.650306+0000", 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018905511 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.650461+0000", 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015447900000000001 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3214 3.1a 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.158367165000001, 2024-04-17T15:40:12.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026716791, 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3214 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370497+0000", 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.394e-06 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375507+0000", 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050097060000000001 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375549+0000", 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2076000000000002e-05 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375568+0000", 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8623000000000001e-05 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375747+0000", 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017887900000000001 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.376173+0000", 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042638600000000001 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.376641+0000", 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046769599999999998 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.387458+0000", 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010817069 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397008+0000", 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095501070000000004 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397134+0000", 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125986 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397211+0000", 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6868999999999999e-05 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.586 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3248 3.14 3:2bd8a3aa:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.735194394000001, 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036059802000000002, 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3248 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793670+0000", 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-06 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800168+0000", 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064981429999999996 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800211+0000", 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2647e-05 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800231+0000", 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0075999999999999e-05 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800418+0000", 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000187095 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800689+0000", 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027156800000000003 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800937+0000", 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024735799999999999 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.821838+0000", 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020901405000000001 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829564+0000", 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077253900000000004 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829656+0000", 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2461999999999997e-05 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829726+0000", 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0388000000000004e-05 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3266 3.14 3:2a47ad18:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.034134+0000", 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.494727338000001, 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023433829, 2024-04-17T15:40:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3266 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.034134+0000", 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.034134+0000", 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.034137+0000", 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.54e-06 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038047+0000", 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039095930000000003 2024-04-17T15:40:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038086+0000", 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9409999999999997e-05 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038103+0000", 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7246000000000001e-05 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038288+0000", 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018491199999999999 2024-04-17T15:40:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.038737+0000", 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044811900000000002 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.039165+0000", 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000428186 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.050945+0000", 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011780778 2024-04-17T15:40:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.057211+0000", 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0062658089999999998 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.057407+0000", 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019612199999999999 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.057568+0000", 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016011399999999999 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3278 3.9 3:901d1baf:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.350478075000002, 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036045059999999997, 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3278 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178386+0000", 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2499999999999998e-06 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182939+0000", 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045523370000000001 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182973+0000", 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4164e-05 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182990+0000", 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7770000000000001e-05 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.183166+0000", 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175348 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.183580+0000", 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041376999999999999 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.184017+0000", 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043735900000000001 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.206149+0000", 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022131980999999998 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214134+0000", 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079846440000000008 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214289+0000", 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015586899999999999 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214428+0000", 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013856799999999999 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3279 3.14 3:2b0d2ba5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:12.603 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.340674929999999, 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025537218, 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3279 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188189+0000", 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9799999999999998e-06 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193213+0000", 2024-04-17T15:40:12.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050239400000000002 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193256+0000", 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3336e-05 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193281+0000", 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4983000000000001e-05 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193487+0000", 2024-04-17T15:40:12.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020554500000000001 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193759+0000", 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027231400000000001 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193995+0000", 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023626800000000001 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.212099+0000", 2024-04-17T15:40:12.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018103668999999999 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213400+0000", 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001301202 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213593+0000", 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019239600000000001 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213723+0000", 2024-04-17T15:40:12.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013058500000000001 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3284 3.14 3:2971c8f6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.284747519, 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025723386000000001, 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.609 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3284 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244117+0000", 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.224e-06 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247174+0000", 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003057649 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247230+0000", 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5232999999999998e-05 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247258+0000", 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8232999999999999e-05 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247439+0000", 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000180812 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247896+0000", 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045720999999999999 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.248348+0000", 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045195599999999999 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.266345+0000", 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017997658999999999 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269169+0000", 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028231300000000001 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269701+0000", 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053260500000000001 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269837+0000", 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135675 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3285 3.34 3:2f312a35:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:12.614 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.275028707000001, 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026478687000000001, 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3285 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253835+0000", 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258650+0000", 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048142410000000004 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258685+0000", 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4953999999999998e-05 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258711+0000", 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258974+0000", 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026291699999999999 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.259347+0000", 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037358699999999999 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.259801+0000", 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045420600000000002 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.272624+0000", 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012822452 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280003+0000", 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073793620000000004 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280180+0000", 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000177319 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280311+0000", 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013058899999999999 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.619 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3360 3.1b e98/18 3:d899093f:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_295:head v 98'17, mlcod=96'15)", 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.518316322, 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028203004, 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010546+0000", 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9299999999999996e-07 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017091+0000", 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065455590000000003 2024-04-17T15:40:12.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017123+0000", 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.146e-05 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017148+0000", 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.514e-05 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017349+0000", 2024-04-17T15:40:12.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200931 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017410+0000", 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1489999999999996e-05 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038631+0000", 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021220645 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038748+0000", 2024-04-17T15:40:12.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011688600000000001 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3359 3.2c e98/18 3:35140f57:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_294:head v 98'12, mlcod=97'10)", 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.516872641999999, 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026019891, 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011990+0000", 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.19e-06 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015476+0000", 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034868260000000002 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015505+0000", 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9030000000000002e-05 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015523+0000", 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7520000000000002e-05 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015719+0000", 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019590499999999999 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015785+0000", 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5988999999999994e-05 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.037812+0000", 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022027409000000001 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038008+0000", 2024-04-17T15:40:12.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019602199999999999 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3366 3.14 3:2bff8300:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_301:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.077544+0000", 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.451316831, 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023061773000000001, 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:12.628 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3366 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.077544+0000", 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.077544+0000", 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.077548+0000", 2024-04-17T15:40:12.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.782e-06 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083215+0000", 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056673449999999998 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083251+0000", 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5945000000000002e-05 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083268+0000", 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6816999999999998e-05 2024-04-17T15:40:12.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083404+0000", 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135513 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.083732+0000", 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000328437 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.084071+0000", 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033846000000000001 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.094453+0000", 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010382103 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.100287+0000", 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058344599999999996 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.100475+0000", 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000187698 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.100606+0000", 2024-04-17T15:40:12.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013121300000000001 2024-04-17T15:40:12.633 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.633 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.633 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.633 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:12.633 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:12.633 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:12.634 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:40:12.635 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:12.633+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:12.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:40:12.735 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:12.737+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:12.805 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:12.806 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:12.806 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:40:12.806 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:12.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:40:12.832 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:12.832 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:12.848 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:12.848 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:12.864 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:12.865+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:12.864 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:12.865 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:12.881 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:12.881 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:12.900 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:12.919 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:12.919 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:12.937 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:12.937 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:12.937 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:12.936+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:12.955 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:12.956 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:12.994 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:12.994 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:13.008 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:40:13.055 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:13.057+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:13.128 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:13.128 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:13.138 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:13.136+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:13.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:40:13.239 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:13.240+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:13.315 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:13.315 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:13.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:40:13.376 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:13.377+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:13.440 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:13.441+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:13.454 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:13.454 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:13.469 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:40:13.541 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:13.540+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:13.640 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:13.640 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:13.641 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:13.640+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:13.654 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:40:13.742 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:13.741+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:13.781 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:13.781 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:13.796 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:40:13.883 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:13.885+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:13.944 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:13.944+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:13.967 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:13.968 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:13.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:40:14.072 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:14.073+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:14.147 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:14.144+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:14.163 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:40:14.248 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:14.249+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:14.290 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:14.290 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:14.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:40:14.348 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:14.349+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:14.445 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:40:14.449 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:14.449+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:14.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:40:14.551 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:14.549+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:14.566 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:14.566 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:14.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:40:14.652 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:14.653+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:14.694 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:14.694 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:14.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:40:14.752 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:14.752+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:14.821 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:14.821 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:14.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:40:14.876 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:14.876+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:14.954 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:14.953+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:14.973 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:40:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:14.999 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:15.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:40:15.056 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:15.056+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:15.129 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:15.147 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:15.147 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:15.156 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:15.156+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:15.163 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:15.163 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:15.170 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:15.170 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:15.179 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:15.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:40:15.200 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:15.200 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:15.221 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:15.221 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:15.242 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:15.242 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:15.257 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:15.256+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:15.263 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:15.310 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:15.311 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:15.311 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:15.324 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:40:15.359 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:15.357+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:15.459 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:15.461+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:40:15.526 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:15.526 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 83.240194549999998, 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:40:15.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.528 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.529 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.530 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.531 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.532 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2227 3.16 3:6be4689d:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 83.109735164, 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018776782999999998, 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2227 2024-04-17T15:40:15.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416950+0000", 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.416953+0000", 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0350000000000002e-06 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418721+0000", 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001768066 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418748+0000", 2024-04-17T15:40:15.535 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6165000000000001e-05 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418763+0000", 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5029e-05 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.418847+0000", 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4501999999999998e-05 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419002+0000", 2024-04-17T15:40:15.536 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015522100000000001 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.419100+0000", 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7255000000000003e-05 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.427691+0000", 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0085911649999999996 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435598+0000", 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079074709999999993 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435669+0000", 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0580999999999994e-05 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.538 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.435727+0000", 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8292999999999999e-05 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2236 3.2f 3:f60be80e:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 83.015096831999998, 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018423737999999999, 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.539 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2236 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.540 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511589+0000", 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.511593+0000", 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0249999999999996e-06 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513301+0000", 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017085550000000001 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513333+0000", 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1615999999999997e-05 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513347+0000", 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3738e-05 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513428+0000", 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1903999999999994e-05 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513599+0000", 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170645 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.513696+0000", 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7168000000000002e-05 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.543 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.521912+0000", 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082154059999999998 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529884+0000", 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0079725379999999995 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.529956+0000", 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1483000000000007e-05 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.530012+0000", 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6660000000000003e-05 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 82.995640393000002, 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:40:15.545 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.547 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:40:15.548 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:15.549 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.550 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:15.551 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 82.809145181999995, 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.552 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:40:15.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:40:15.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:40:15.557 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2655 3.3b e89/18 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head v 89'7, mlcod=76'5)", 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 46.594634878000001, 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022625060999999998, 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.558 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5600000000000004e-07 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.937998+0000", 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059469739999999998 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938039+0000", 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0113e-05 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938062+0000", 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3807000000000001e-05 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938236+0000", 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403500000000001 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938303+0000", 2024-04-17T15:40:15.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6190000000000002e-05 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954503+0000", 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016200763999999999 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954676+0000", 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017232200000000001 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.562 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2656 3.16 3:6ad2ad56:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 46.575451575999999, 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022969676000000001, 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.563 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2656 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:15.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951237+0000", 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.264e-06 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956406+0000", 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051685460000000004 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956439+0000", 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2959000000000001e-05 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956456+0000", 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7217000000000001e-05 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956609+0000", 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015330899999999999 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956880+0000", 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027084100000000002 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.957130+0000", 2024-04-17T15:40:15.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025006900000000001 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.966230+0000", 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009099434 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974022+0000", 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077925549999999996 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974126+0000", 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103706 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974204+0000", 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7775999999999995e-05 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.569 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2664 3.21 3:84c31c70:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 46.378519668000003, 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019486428, 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2664 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.570 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148169+0000", 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0070000000000002e-06 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151347+0000", 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031786599999999998 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151397+0000", 2024-04-17T15:40:15.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9317000000000002e-05 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151417+0000", 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.012e-05 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151540+0000", 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012354900000000001 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151802+0000", 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026111400000000001 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151955+0000", 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015302 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.159770+0000", 2024-04-17T15:40:15.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078157350000000007 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167530+0000", 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077592989999999999 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167595+0000", 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5320999999999993e-05 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167652+0000", 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7286e-05 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2689 3.2d e89/18 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head v 89'5, mlcod=77'3)", 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 45.821054254000003, 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023548848000000001, 2024-04-17T15:40:15.576 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:15.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705634+0000", 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0929999999999999e-06 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711102+0000", 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054679810000000002 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711146+0000", 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3940000000000003e-05 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711170+0000", 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4283000000000001e-05 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711304+0000", 2024-04-17T15:40:15.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013349999999999999 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711341+0000", 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6803e-05 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729020+0000", 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017679553000000001 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729180+0000", 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015969500000000001 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3161 3.2e 3:77c0c5b6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.826782044000002, 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018746992000000001, 2024-04-17T15:40:15.581 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3161 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:15.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699903+0000", 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.699907+0000", 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3390000000000001e-06 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702202+0000", 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022948840000000001 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702230+0000", 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8513999999999998e-05 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702241+0000", 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1083999999999999e-05 2024-04-17T15:40:15.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702340+0000", 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8443000000000006e-05 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702543+0000", 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020311 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.702723+0000", 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000180235 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.714838+0000", 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012114583 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718506+0000", 2024-04-17T15:40:15.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036683530000000001 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718587+0000", 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.1254999999999994e-05 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.718650+0000", 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3192000000000001e-05 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.587 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3174 3.21 3:84a9f215:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.684804868000001, 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018361252000000002, 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3174 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841881+0000", 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.841884+0000", 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2490000000000001e-06 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844049+0000", 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021650620000000001 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844073+0000", 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3893999999999999e-05 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844085+0000", 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1963e-05 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844179+0000", 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4195000000000002e-05 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844385+0000", 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206331 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.844583+0000", 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019758899999999999 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.592 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.857179+0000", 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012595705 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860113+0000", 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0029346950000000002 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860184+0000", 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0852999999999994e-05 2024-04-17T15:40:15.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:51.860242+0000", 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7716000000000001e-05 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3188 3.2f 3:f4860977:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:15.594 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.514508934999999, 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019398723999999999, 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3188 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012181+0000", 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4129999999999999e-06 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014461+0000", 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022799539999999998 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014506+0000", 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5529999999999999e-05 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014526+0000", 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9542999999999999e-05 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014635+0000", 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010869700000000001 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014813+0000", 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178128 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.015010+0000", 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000197111 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.023029+0000", 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080189619999999993 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031512+0000", 2024-04-17T15:40:15.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084828179999999996 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031549+0000", 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6944999999999999e-05 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031575+0000", 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6622999999999999e-05 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3195 3.16 3:6892fdae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.379834695, 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021725749999999999, 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3195 2024-04-17T15:40:15.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146855+0000", 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8800000000000001e-06 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150499+0000", 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036446019999999998 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150530+0000", 2024-04-17T15:40:15.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1099999999999997e-05 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150543+0000", 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2847000000000001e-05 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150617+0000", 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4294000000000004e-05 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150741+0000", 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123731 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150854+0000", 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.157302+0000", 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064475870000000003 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168431+0000", 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011129847 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168516+0000", 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4331000000000003e-05 2024-04-17T15:40:15.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168577+0000", 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0785999999999997e-05 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3215 3.16 3:69d29e25:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:15.607 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.144820643999999, 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020347908000000001, 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3215 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381869+0000", 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8070000000000001e-06 2024-04-17T15:40:15.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384172+0000", 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002302957 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384202+0000", 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0704000000000003e-05 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384216+0000", 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3376e-05 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384299+0000", 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3622000000000007e-05 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384481+0000", 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182086 2024-04-17T15:40:15.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384646+0000", 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016434199999999999 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396642+0000", 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011996079 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402122+0000", 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054798360000000001 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402169+0000", 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7664000000000003e-05 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402213+0000", 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3435e-05 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.613 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3232 3.2e 3:77f4f650:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.950008100000002, 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020894309, 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.614 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3232 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576681+0000", 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3060000000000002e-06 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578598+0000", 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001917799 2024-04-17T15:40:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578637+0000", 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8884000000000002e-05 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578654+0000", 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6578999999999998e-05 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578752+0000", 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8412000000000006e-05 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578884+0000", 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131359 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.579029+0000", 2024-04-17T15:40:15.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014510799999999999 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.584890+0000", 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058607679999999997 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597433+0000", 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012543642000000001 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597513+0000", 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9538999999999999e-05 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597572+0000", 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8913000000000003e-05 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3243 3.21 3:86efebb2:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.817888951, 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018171970999999999, 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3243 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.621 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708796+0000", 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.708799+0000", 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.1270000000000001e-06 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711223+0000", 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024239690000000002 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711252+0000", 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9176999999999999e-05 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711263+0000", 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1269e-05 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711334+0000", 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0891999999999998e-05 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711467+0000", 2024-04-17T15:40:15.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000133306 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.711580+0000", 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000112734 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.719664+0000", 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080840129999999993 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726888+0000", 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0072236660000000001 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726932+0000", 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4709000000000002e-05 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.726968+0000", 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6109000000000003e-05 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.626 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3245 3.24 3:26e56b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.786200242, 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020901084, 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.627 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3245 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740501+0000", 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5823000000000001e-05 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742689+0000", 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021879009999999999 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742737+0000", 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8519000000000001e-05 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742759+0000", 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.173e-05 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742848+0000", 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9116000000000005e-05 2024-04-17T15:40:15.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743031+0000", 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018237599999999999 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743192+0000", 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000161461 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.749847+0000", 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066546610000000001 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761259+0000", 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011411813999999999 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761330+0000", 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1481000000000002e-05 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761386+0000", 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6202000000000002e-05 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3254 3.21 3:86770de1:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.662642395999999, 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022547540000000001, 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.633 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3254 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864046+0000", 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.004e-06 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865763+0000", 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017173360000000001 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865809+0000", 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5519999999999998e-05 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865827+0000", 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7716000000000001e-05 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865933+0000", 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010629 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866093+0000", 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000159946 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866220+0000", 2024-04-17T15:40:15.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127164 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.873221+0000", 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070009570000000004 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886373+0000", 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013151891000000001 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886502+0000", 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012948500000000001 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886591+0000", 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8231000000000003e-05 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3264 3.24 3:26cd557b:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.639 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 22.516954780999999, 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020478857, 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3264 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009734+0000", 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:40:15.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011450+0000", 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017157369999999999 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011475+0000", 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5151999999999999e-05 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011488+0000", 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3740000000000001e-05 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011581+0000", 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.255e-05 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011705+0000", 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012390900000000001 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011811+0000", 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106111 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.019611+0000", 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077997359999999998 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030126+0000", 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010514977999999999 2024-04-17T15:40:15.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030173+0000", 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7451999999999999e-05 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030210+0000", 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6294000000000002e-05 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3343 3.16 3:6ae5c866:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_278:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 21.716141409999999, 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019911570999999999, 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:15.646 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3343 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810546+0000", 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.357e-06 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812931+0000", 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023841180000000002 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812960+0000", 2024-04-17T15:40:15.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9677999999999999e-05 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812971+0000", 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1259e-05 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813071+0000", 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9406000000000003e-05 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813247+0000", 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000176429 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813415+0000", 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016733000000000001 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.824091+0000", 2024-04-17T15:40:15.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010676296 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830354+0000", 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006263294 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830402+0000", 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8155999999999998e-05 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830456+0000", 2024-04-17T15:40:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3248000000000002e-05 2024-04-17T15:40:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.652 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.652 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:15.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:40:15.655 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:15.653+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:15.755 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:15.753+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3769 3.28 e110/18 3:15833913:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_36:head v 110'19, mlcod=98'17)", 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:15.791730+0000", 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0049650739999999999, 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049874150000000003, 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:15.794 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "started", 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.791730+0000", 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.791730+0000", 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.795 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.791732+0000", 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.598e-06 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.796058+0000", 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0043257030000000002 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.796103+0000", 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5648000000000001e-05 2024-04-17T15:40:15.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.796123+0000", 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9712999999999999e-05 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.796241+0000", 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000117883 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.796275+0000", 2024-04-17T15:40:15.797 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4014000000000003e-05 2024-04-17T15:40:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-17T15:40:15.798 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 1 2024-04-17T15:40:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:15.814 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:40:15.860 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:15.860+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:15.957 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:15.957+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:15.969 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:15.969 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:15.970 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:15.990 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:40:16.057 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:16.057+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:16.158 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:16.157+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 84.056055413999999, 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:40:16.184 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.186 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:40:16.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:40:16.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:16.189 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 84.044279493999994, 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:16.190 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:40:16.191 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:40:16.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:40:16.193 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.194 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 83.602535821000004, 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.195 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.196 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.197 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.198 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.199 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 83.475891856999993, 2024-04-17T15:40:16.200 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.201 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.202 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.204 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:40:16.205 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2646 3.8 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 47.450647105999998, 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025266311, 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.206 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2646 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.207 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734569+0000", 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739260+0000", 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046916730000000004 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739303+0000", 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2799000000000001e-05 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.208 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739322+0000", 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8389999999999998e-05 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739489+0000", 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167016 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739896+0000", 2024-04-17T15:40:16.209 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040707699999999999 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740309+0000", 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041348699999999998 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.754426+0000", 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014117002 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.210 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759750+0000", 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053237900000000001 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759800+0000", 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0405000000000003e-05 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759831+0000", 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0861999999999997e-05 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2688 3.18 3:1b829d89:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 46.501411509, 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023433995999999999, 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2688 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.212 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683806+0000", 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2000000000000002e-06 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.213 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688730+0000", 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049237680000000002 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688789+0000", 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9469999999999998e-05 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688813+0000", 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4253e-05 2024-04-17T15:40:16.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688955+0000", 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014158899999999999 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689247+0000", 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029219100000000002 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689484+0000", 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023730499999999999 2024-04-17T15:40:16.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705954+0000", 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016469461000000001 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707072+0000", 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001118427 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707163+0000", 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1199999999999994e-05 2024-04-17T15:40:16.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707235+0000", 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1131999999999996e-05 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2737 3.8 3:1044985e:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 45.851220202999997, 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024601553000000002, 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.217 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2737 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:16.218 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333996+0000", 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8929999999999998e-06 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335595+0000", 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015994550000000001 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335629+0000", 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:40:16.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335645+0000", 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6597999999999999e-05 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335729+0000", 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3633000000000004e-05 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op must wait for map", 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335735+0000", 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.220 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339342+0000", 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036071340000000001 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339550+0000", 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020780199999999999 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339728+0000", 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178734 2024-04-17T15:40:16.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354941+0000", 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015212356 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358485+0000", 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035443250000000001 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358544+0000", 2024-04-17T15:40:16.222 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8888000000000003e-05 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358593+0000", 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9557e-05 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3208 3.1e 3:7bf3f1fd:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.879498788999999, 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024643996000000001, 2024-04-17T15:40:16.223 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3208 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.224 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305716+0000", 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8609999999999998e-06 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307655+0000", 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001938546 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.225 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307680+0000", 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5238000000000001e-05 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307695+0000", 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5133000000000001e-05 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307786+0000", 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0728000000000003e-05 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.226 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307955+0000", 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016871400000000001 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.308078+0000", 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012391 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.317113+0000", 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090349109999999996 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.227 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330212+0000", 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013098344 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330292+0000", 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0183000000000001e-05 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330357+0000", 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5427999999999998e-05 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.228 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3237 3.33 3:cc5684ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.554263853999998, 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022846793000000001, 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.229 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3237 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.230 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630950+0000", 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7039999999999999e-06 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632791+0000", 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018406119999999999 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632820+0000", 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9380999999999999e-05 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632834+0000", 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4345000000000001e-05 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632926+0000", 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2145999999999995e-05 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633056+0000", 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012976700000000001 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.232 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633198+0000", 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000141342 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.639250+0000", 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006052605 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653695+0000", 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014444988000000001 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.233 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653741+0000", 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5556000000000002e-05 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653795+0000", 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4347e-05 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3242 3.33 3:cc808c01:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.234 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.489643726000001, 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020918729, 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3242 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695568+0000", 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.695572+0000", 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5769999999999998e-06 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697488+0000", 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001916189 2024-04-17T15:40:16.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697516+0000", 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8093999999999999e-05 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697529+0000", 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3158e-05 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697639+0000", 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000109227 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.237 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.697845+0000", 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000206226 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.698025+0000", 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000179987 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.705449+0000", 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.007424445 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.238 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716350+0000", 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010900734 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716426+0000", 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5622000000000002e-05 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.716487+0000", 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1470000000000006e-05 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.239 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3250 3.7 3:e148f750:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.367929070999999, 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021674067000000002, 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3250 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.240 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817288+0000", 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7299999999999996e-06 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820832+0000", 2024-04-17T15:40:16.241 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035441740000000002 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820870+0000", 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7565999999999999e-05 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820885+0000", 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5132e-05 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821009+0000", 2024-04-17T15:40:16.242 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124475 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821146+0000", 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013711600000000001 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821247+0000", 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010072400000000001 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.827312+0000", 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060654389999999997 2024-04-17T15:40:16.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838765+0000", 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011452208 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838888+0000", 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123771 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838957+0000", 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8732000000000005e-05 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.244 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3252 3.2 3:40c9ca30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.348437232999999, 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022557901000000002, 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3252 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.245 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836777+0000", 2024-04-17T15:40:16.246 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4949999999999998e-06 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843566+0000", 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067891239999999997 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843599+0000", 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2002999999999998e-05 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843614+0000", 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5957e-05 2024-04-17T15:40:16.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843705+0000", 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0276000000000001e-05 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843902+0000", 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019734200000000001 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.844063+0000", 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160512 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.854965+0000", 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010902593 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859208+0000", 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0042428580000000004 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.249 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859279+0000", 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0858000000000005e-05 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859333+0000", 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3882999999999999e-05 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3257 3.29 3:97b19dae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.250 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.272604807, 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021952833000000001, 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3257 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912611+0000", 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0330000000000002e-06 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916649+0000", 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040378489999999996 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916685+0000", 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5646999999999999e-05 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916701+0000", 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6328e-05 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916812+0000", 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011056 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.253 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917015+0000", 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020336400000000001 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917200+0000", 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018441900000000001 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.926337+0000", 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091371060000000007 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.254 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934459+0000", 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081220489999999992 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934506+0000", 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7534999999999998e-05 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.255 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934560+0000", 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3943000000000002e-05 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3259 3.29 3:97b435f0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.239323307999999, 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021828215000000002, 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.256 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3259 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945892+0000", 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9679999999999998e-06 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.947986+0000", 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020939650000000001 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948032+0000", 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6180999999999997e-05 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.258 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948055+0000", 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3031999999999999e-05 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948167+0000", 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011191700000000001 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948370+0000", 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020330599999999999 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948569+0000", 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019869199999999999 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.956337+0000", 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077678039999999997 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967491+0000", 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011154393 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.260 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967620+0000", 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012935299999999999 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967717+0000", 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6603999999999999e-05 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3274 3.38 3:1c6c0b46:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 23.052164855000001, 2024-04-17T15:40:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020992581999999999, 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3274 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133047+0000", 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.133050+0000", 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.88e-06 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135292+0000", 2024-04-17T15:40:16.263 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022414240000000001 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135324+0000", 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000002e-05 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135342+0000", 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8808e-05 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135460+0000", 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000118107 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.264 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135621+0000", 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016069599999999999 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.135814+0000", 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000192793 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.142834+0000", 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070204389999999998 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.265 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.153823+0000", 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010988639999999999 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.153932+0000", 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010886400000000001 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.154040+0000", 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107951 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.266 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3744 3.38 3:1cea9432:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:15.499761+0000", 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.68545111299999995, 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.034184783000000003, 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3744 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.267 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.499761+0000", 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.499761+0000", 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.499765+0000", 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8020000000000002e-06 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.268 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.502594+0000", 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028294739999999998 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.502632+0000", 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7731000000000002e-05 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.502651+0000", 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9412e-05 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.269 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.502780+0000", 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000128283 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.503084+0000", 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030429399999999998 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.503390+0000", 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030586399999999998 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.270 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.511435+0000", 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080451340000000007 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.533807+0000", 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022372103000000001 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.533884+0000", 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7272000000000001e-05 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.533946+0000", 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1414000000000005e-05 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3765 3.1e 3:78f300bf:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:15.743090+0000", 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.44212185999999998, 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.030025725, 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.272 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3765 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.743090+0000", 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.743090+0000", 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.743093+0000", 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7690000000000001e-06 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745449+0000", 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023559660000000001 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745482+0000", 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3259999999999997e-05 2024-04-17T15:40:16.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745496+0000", 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3821e-05 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745590+0000", 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4205999999999999e-05 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745774+0000", 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000183838 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745927+0000", 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152435 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.755467+0000", 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095402170000000001 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.772992+0000", 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017525171999999999 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.773063+0000", 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0629000000000004e-05 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.773116+0000", 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3412000000000003e-05 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3788 3.22 e110/18 3:47b0d2aa:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_55:head v 110'12, mlcod=98'10)", 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:15.995986+0000", 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.18922591, 2024-04-17T15:40:16.277 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022398136999999999, 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.995986+0000", 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.995986+0000", 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.995987+0000", 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0389999999999999e-06 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999790+0000", 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038026620000000001 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999811+0000", 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0925999999999999e-05 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.279 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999821+0000", 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6970000000000005e-06 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999894+0000", 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3466000000000004e-05 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999922+0000", 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8187e-05 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.280 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.018320+0000", 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018398136999999998 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.018384+0000", 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4022999999999993e-05 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3790 3.29 3:96669cfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:16.281 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:16.014771+0000", 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.170441339, 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028223696, 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3790 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.282 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.014771+0000", 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.014771+0000", 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.014773+0000", 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2019999999999998e-06 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.283 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.016832+0000", 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020591260000000001 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.016864+0000", 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1594000000000003e-05 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.016879+0000", 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5517000000000001e-05 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.284 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.016964+0000", 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4588999999999999e-05 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.017134+0000", 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170106 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.017276+0000", 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000142132 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.285 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.026225+0000", 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0089493890000000003 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.042851+0000", 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016625725000000001 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.042925+0000", 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3726999999999994e-05 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.286 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.042994+0000", 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9589000000000001e-05 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3796 3.2 3:40774ba4:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:16.077793+0000", 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.107419291, 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021480473999999999, 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:16.287 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3796 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.077793+0000", 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.077793+0000", 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.077795+0000", 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2199999999999999e-06 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.080233+0000", 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0024384020000000001 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.080263+0000", 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9560000000000002e-05 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.080277+0000", 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.416e-05 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.080355+0000", 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7819999999999997e-05 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.080499+0000", 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000143771 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.080618+0000", 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011945100000000001 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.087230+0000", 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066116380000000004 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.099175+0000", 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011944872 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.099237+0000", 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1901000000000002e-05 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.099273+0000", 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6678999999999999e-05 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:16.292 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:16.294 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:40:16.294 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:16.293+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:16.394 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:16.393+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:16.444 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:16.445 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:16.445 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:40:16.445 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:16.461 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:40:16.507 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:16.509+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:16.597 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:16.596+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:16.657 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:40:16.657 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:40:16.657 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:16.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:40:16.698 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:16.696+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:16.798 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:16.797+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:16.821 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:40:16.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:40:16.821 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:40:16.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.821 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:1192 3.1a 3:5bad5949:::5305729a-6754-489e-9706-ab50dfde728d.4412.1__shadow_.DGjCI3yKX4OL-8twca2c-96OEPyDGVV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-17T15:40:16.821 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:16.821 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 97.994358301999995, 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024174152000000001, 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 1192 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822453+0000", 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.822455+0000", 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.21e-06 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831127+0000", 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086716950000000001 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831182+0000", 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5253000000000001e-05 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831209+0000", 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7253000000000001e-05 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831480+0000", 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000271181 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.831936+0000", 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045593899999999999 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.832289+0000", 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035266399999999998 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.845508+0000", 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013219174 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846268+0000", 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076004299999999996 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846490+0000", 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000222148 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:38.846627+0000", 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136592 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.826 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.827844053000007, 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:40:16.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:40:16.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.746807261000001, 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.832 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.190328398000005, 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:40:16.837 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:40:16.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:40:16.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2743 3.34 3:2f634024:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.412125295000003, 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025426936000000001, 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.843 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2743 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404686+0000", 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.404706+0000", 2024-04-17T15:40:16.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9983000000000002e-05 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408933+0000", 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042273040000000003 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408972+0000", 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8495000000000003e-05 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.408990+0000", 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8219999999999998e-05 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.409170+0000", 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018019600000000001 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.409592+0000", 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042226600000000003 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.410018+0000", 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042519299999999998 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.428938+0000", 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018920248000000001 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430015+0000", 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001077103 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430067+0000", 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2494000000000003e-05 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.430113+0000", 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5433999999999999e-05 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3214 3.1a 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:16.848 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.446317289, 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026716791, 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3214 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370497+0000", 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.394e-06 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375507+0000", 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050097060000000001 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375549+0000", 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2076000000000002e-05 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375568+0000", 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8623000000000001e-05 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375747+0000", 2024-04-17T15:40:16.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017887900000000001 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.376173+0000", 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042638600000000001 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.376641+0000", 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046769599999999998 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.387458+0000", 2024-04-17T15:40:16.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010817069 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397008+0000", 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095501070000000004 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397134+0000", 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125986 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397211+0000", 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6868999999999999e-05 2024-04-17T15:40:16.853 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3248 3.14 3:2bd8a3aa:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.023144517999999, 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036059802000000002, 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.854 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3248 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793670+0000", 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-06 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800168+0000", 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064981429999999996 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800211+0000", 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2647e-05 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800231+0000", 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0075999999999999e-05 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800418+0000", 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000187095 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800689+0000", 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027156800000000003 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800937+0000", 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024735799999999999 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.821838+0000", 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020901405000000001 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829564+0000", 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077253900000000004 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829656+0000", 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2461999999999997e-05 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829726+0000", 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0388000000000004e-05 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3278 3.9 3:901d1baf:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.859 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.638428199, 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036045059999999997, 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3278 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:16.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178386+0000", 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2499999999999998e-06 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182939+0000", 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045523370000000001 2024-04-17T15:40:16.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182973+0000", 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4164e-05 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182990+0000", 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7770000000000001e-05 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.183166+0000", 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175348 2024-04-17T15:40:16.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.183580+0000", 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041376999999999999 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.184017+0000", 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043735900000000001 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.206149+0000", 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022131980999999998 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214134+0000", 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079846440000000008 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214289+0000", 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015586899999999999 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214428+0000", 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013856799999999999 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.864 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3279 3.14 3:2b0d2ba5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.628625054, 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025537218, 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3279 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.865 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188189+0000", 2024-04-17T15:40:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9799999999999998e-06 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193213+0000", 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050239400000000002 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193256+0000", 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3336e-05 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193281+0000", 2024-04-17T15:40:16.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4983000000000001e-05 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193487+0000", 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020554500000000001 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193759+0000", 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027231400000000001 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193995+0000", 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023626800000000001 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.212099+0000", 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018103668999999999 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213400+0000", 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001301202 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213593+0000", 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019239600000000001 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213723+0000", 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013058500000000001 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3284 3.14 3:2971c8f6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.572697643000001, 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025723386000000001, 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.870 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3284 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:16.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244117+0000", 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.224e-06 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247174+0000", 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003057649 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247230+0000", 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5232999999999998e-05 2024-04-17T15:40:16.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247258+0000", 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8232999999999999e-05 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247439+0000", 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000180812 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247896+0000", 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045720999999999999 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.248348+0000", 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045195599999999999 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.266345+0000", 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017997658999999999 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269169+0000", 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028231300000000001 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269701+0000", 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053260500000000001 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269837+0000", 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135675 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3285 3.34 3:2f312a35:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:16.875 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.562978830999999, 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026478687000000001, 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3285 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253835+0000", 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258650+0000", 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048142410000000004 2024-04-17T15:40:16.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258685+0000", 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4953999999999998e-05 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258711+0000", 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258974+0000", 2024-04-17T15:40:16.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026291699999999999 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.259347+0000", 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037358699999999999 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.259801+0000", 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045420600000000002 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.272624+0000", 2024-04-17T15:40:16.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012822452 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280003+0000", 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073793620000000004 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280180+0000", 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000177319 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280311+0000", 2024-04-17T15:40:16.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013058899999999999 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3360 3.1b e98/18 3:d899093f:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_295:head v 98'17, mlcod=96'15)", 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.806266445999999, 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028203004, 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010546+0000", 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9299999999999996e-07 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017091+0000", 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065455590000000003 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017123+0000", 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.146e-05 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017148+0000", 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.514e-05 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017349+0000", 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200931 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017410+0000", 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1489999999999996e-05 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038631+0000", 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021220645 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038748+0000", 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011688600000000001 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3359 3.2c e98/18 3:35140f57:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_294:head v 98'12, mlcod=97'10)", 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.804822766000001, 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026019891, 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.885 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011990+0000", 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.19e-06 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015476+0000", 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034868260000000002 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015505+0000", 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9030000000000002e-05 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015523+0000", 2024-04-17T15:40:16.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7520000000000002e-05 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015719+0000", 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019590499999999999 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015785+0000", 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5988999999999994e-05 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.037812+0000", 2024-04-17T15:40:16.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022027409000000001 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038008+0000", 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019602199999999999 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3739 3.14 3:29f53610:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.444714+0000", 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.372096781, 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024619681000000001, 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.889 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3739 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.444714+0000", 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.444714+0000", 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.444718+0000", 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.523e-06 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.450657+0000", 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059393090000000003 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.450701+0000", 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4079000000000003e-05 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.450720+0000", 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9066999999999999e-05 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.450918+0000", 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000197968 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.451368+0000", 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045007599999999999 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.451800+0000", 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043143000000000001 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.467813+0000", 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016013238999999999 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.469020+0000", 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001207112 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.469200+0000", 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000180139 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.469334+0000", 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013373899999999999 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.894 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3766 3.14 3:290d121d:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.752855+0000", 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.0639561689999999, 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024518808999999999, 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3766 2024-04-17T15:40:16.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.752855+0000", 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.752855+0000", 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.752858+0000", 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3299999999999999e-06 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.757348+0000", 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044896509999999999 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.757389+0000", 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1134000000000003e-05 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.757415+0000", 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5553000000000001e-05 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.757588+0000", 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017307499999999999 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.757859+0000", 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027081400000000003 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:16.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.758129+0000", 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027084100000000002 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.774605+0000", 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016475627999999999 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.777197+0000", 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0025922609999999998 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.777297+0000", 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9648999999999994e-05 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.777374+0000", 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6872999999999994e-05 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3774 3.13 e110/18 3:c861c045:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_41:head v 110'17, mlcod=98'15)", 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.852476+0000", 2024-04-17T15:40:16.900 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.96433524299999995, 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025627451999999998, 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.852476+0000", 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.852476+0000", 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.852478+0000", 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.776e-06 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859607+0000", 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071288250000000001 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859657+0000", 2024-04-17T15:40:16.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0757000000000002e-05 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859682+0000", 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4533e-05 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859886+0000", 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204048 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859961+0000", 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5291999999999997e-05 2024-04-17T15:40:16.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.877957+0000", 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017996232000000001 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.878103+0000", 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014598899999999999 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3783 3.3 3:c008dae6:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:16.904 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.935300+0000", 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.88151149399999995, 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029051576999999999, 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3783 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.935300+0000", 2024-04-17T15:40:16.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.935300+0000", 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.935303+0000", 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0400000000000001e-06 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939240+0000", 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039368299999999997 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939279+0000", 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9946e-05 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939298+0000", 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8130000000000001e-05 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939446+0000", 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014880199999999999 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939721+0000", 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027500099999999998 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939995+0000", 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027332399999999997 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.953189+0000", 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013194743 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.964023+0000", 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010834007 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.964211+0000", 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018785199999999999 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.964351+0000", 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013990199999999999 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3790 3.29 e110/18 3:96669cfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_57:head v 110'14, mlcod=98'12)", 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:16.017195+0000", 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.79961661500000003, 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024923134999999999, 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.910 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.017195+0000", 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.017195+0000", 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.017195+0000", 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7e-07 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.022520+0000", 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053250179999999999 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.022554+0000", 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3803000000000001e-05 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.022570+0000", 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6399999999999999e-05 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.022704+0000", 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000134105 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.022743+0000", 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8680000000000002e-05 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.041989+0000", 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019246180000000002 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.042118+0000", 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000128479 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3798 3.9 3:932f5b49:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:16.097106+0000", 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.71970516299999998, 2024-04-17T15:40:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028636083, 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3798 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.097106+0000", 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.097106+0000", 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.097111+0000", 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.887e-06 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101086+0000", 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039747619999999997 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101129+0000", 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3800000000000001e-05 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101156+0000", 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6792999999999999e-05 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101301+0000", 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145165 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101561+0000", 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025973100000000002 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101810+0000", 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.111492+0000", 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0096819969999999995 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.125526+0000", 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014033982 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.125621+0000", 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5705999999999995e-05 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.125742+0000", 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120862 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3806 3.9 3:92df0c4b:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:16.179237+0000", 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.63757444399999996, 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026296423999999999, 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3806 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.920 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.179237+0000", 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.179237+0000", 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.179240+0000", 2024-04-17T15:40:16.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4599999999999999e-06 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.183827+0000", 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045864110000000003 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.183878+0000", 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0955999999999998e-05 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:16.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.183905+0000", 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7756e-05 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.184118+0000", 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021263200000000001 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.184581+0000", 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046349899999999997 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.185022+0000", 2024-04-17T15:40:16.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044105000000000001 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.197638+0000", 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012615578000000001 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.205242+0000", 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0076035540000000002 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.205386+0000", 2024-04-17T15:40:16.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000144129 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.205533+0000", 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014739899999999999 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:16.925 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:16.927 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:40:16.927 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:16.925+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:17.027 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:17.029+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:17.104 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:17.104 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:40:17.104 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:17.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:40:17.128 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:17.128+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:17.229 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:17.229+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:17.281 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:40:17.295 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:17.295 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:17.295 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:40:17.295 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:40:17.295 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:17.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:40:17.360 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:17.361+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:17.431 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:17.433+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:17.477 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:17.477 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:17.505 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:17.505 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2198 3.3a 3:5df39e65:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 85.384989152000003, 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026029244, 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.506 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2198 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117048+0000", 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.117051+0000", 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9059999999999998e-06 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121284+0000", 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042323589999999998 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121335+0000", 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1643e-05 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121362+0000", 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6650000000000001e-05 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.121586+0000", 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223928 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122021+0000", 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043530199999999999 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.122505+0000", 2024-04-17T15:40:17.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048423599999999998 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.134629+0000", 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012124118 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142907+0000", 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082773959999999994 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.142998+0000", 2024-04-17T15:40:17.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0828999999999994e-05 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.143077+0000", 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9876999999999994e-05 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2206 3.2a 3:554687e0:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 85.296892330000006, 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029258256, 2024-04-17T15:40:17.511 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2206 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205145+0000", 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.205148+0000", 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6900000000000001e-06 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211713+0000", 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065654110000000002 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211744+0000", 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1232999999999997e-05 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211761+0000", 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6994e-05 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.211928+0000", 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166195 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212314+0000", 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000385993 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.212704+0000", 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039051 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.223772+0000", 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011067521 2024-04-17T15:40:17.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234062+0000", 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010289918 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234240+0000", 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000178302 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.234403+0000", 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016348900000000001 2024-04-17T15:40:17.516 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2237 3.2a 3:56c2ec54:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.979353540999995, 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028581945000000001, 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.517 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2237 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522684+0000", 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.522688+0000", 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5260000000000004e-06 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526833+0000", 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004144427 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526875+0000", 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1715999999999998e-05 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.526894+0000", 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9307e-05 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527045+0000", 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151201 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527303+0000", 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025805199999999999 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.527546+0000", 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024263099999999999 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.543539+0000", 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015993657000000001 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.550954+0000", 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074142239999999996 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551129+0000", 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017543100000000001 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.551266+0000", 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136773 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2248 3.1c 3:392dbad4:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:40:17.522 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.867136733999999, 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028561188000000001, 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2248 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634901+0000", 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.634905+0000", 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6530000000000002e-06 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.638983+0000", 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040774130000000002 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639023+0000", 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0703e-05 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639048+0000", 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4437e-05 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639211+0000", 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016346500000000001 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639455+0000", 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000243324 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.639679+0000", 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000223935 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661540+0000", 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021861068000000001 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663140+0000", 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016003860000000001 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663326+0000", 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018592500000000001 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.663462+0000", 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013587899999999999 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.527 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2283 3.1c 3:3810f935:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.497831074999993, 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028433096000000001, 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2283 2024-04-17T15:40:17.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004206+0000", 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.004210+0000", 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2770000000000001e-06 2024-04-17T15:40:17.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008596+0000", 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043866770000000003 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008636+0000", 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9767000000000001e-05 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008655+0000", 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9083e-05 2024-04-17T15:40:17.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.008831+0000", 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017611100000000001 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009255+0000", 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042393699999999999 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.009704+0000", 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044862299999999999 2024-04-17T15:40:17.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.029616+0000", 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019912474999999999 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032482+0000", 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028657439999999999 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032575+0000", 2024-04-17T15:40:17.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3146000000000006e-05 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:53.032639+0000", 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4256000000000003e-05 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2736 3.5 3:a18cd429:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.177512696999997, 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.031892391999999999, 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.533 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2736 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324525+0000", 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.324528+0000", 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.056e-06 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329199+0000", 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004671171 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329244+0000", 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4765999999999998e-05 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329263+0000", 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9426999999999999e-05 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329381+0000", 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117856 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.329387+0000", 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2929999999999997e-06 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.334989+0000", 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056018659999999996 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.335183+0000", 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000194284 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:17.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.335374+0000", 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000190259 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.340432+0000", 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050583310000000001 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356298+0000", 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015865945999999999 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356355+0000", 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7312000000000003e-05 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.356417+0000", 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1824999999999998e-05 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2746 3.22 3:47e1b608:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.066813041000003, 2024-04-17T15:40:17.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025681591, 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2746 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435224+0000", 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.435227+0000", 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.604e-06 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439128+0000", 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003901121 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439155+0000", 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7311999999999999e-05 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439166+0000", 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0437e-05 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439277+0000", 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111181 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439514+0000", 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000237338 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.439734+0000", 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000219681 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.450454+0000", 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010719553 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460592+0000", 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010138263999999999 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460778+0000", 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018652799999999999 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:30.460906+0000", 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000127572 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.544 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3171 3.3a 3:5d66e231:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:51.809528+0000", 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.692508910000001, 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026865923, 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3171 2024-04-17T15:40:17.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.809528+0000", 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.809528+0000", 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.809532+0000", 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5669999999999999e-06 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.814246+0000", 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047142829999999997 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.814294+0000", 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7559000000000003e-05 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.814320+0000", 2024-04-17T15:40:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6333e-05 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.814523+0000", 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020309200000000001 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.814781+0000", 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025771399999999998 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.815014+0000", 2024-04-17T15:40:17.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023273099999999999 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.829754+0000", 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014739795999999999 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.836055+0000", 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006301811 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.836232+0000", 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000176393 2024-04-17T15:40:17.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:51.836394+0000", 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016264400000000001 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3201 3.28 3:145509d9:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.228316+0000", 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.273720931, 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025654250999999999, 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.550 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3201 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.228316+0000", 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.228316+0000", 2024-04-17T15:40:17.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.228319+0000", 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0230000000000001e-06 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.233002+0000", 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046825169999999998 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.233041+0000", 2024-04-17T15:40:17.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9459000000000003e-05 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.233065+0000", 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3773000000000001e-05 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.233187+0000", 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121932 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.233511+0000", 2024-04-17T15:40:17.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032343399999999999 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.233795+0000", 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000284271 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.243504+0000", 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0097086659999999995 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.253647+0000", 2024-04-17T15:40:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010143821000000001 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.253834+0000", 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018668600000000001 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.253971+0000", 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013666899999999999 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3251 3.c 3:3195556a:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.827958+0000", 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.674079784, 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027826344999999999, 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3251 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.827958+0000", 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.827958+0000", 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.827962+0000", 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9469999999999996e-06 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.835239+0000", 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072774700000000003 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.835275+0000", 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6426e-05 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.835293+0000", 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7623999999999999e-05 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.835448+0000", 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015443799999999999 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.835710+0000", 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026295099999999998 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.835972+0000", 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026178799999999999 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.845929+0000", 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099566470000000008 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.855062+0000", 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091335970000000002 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.855267+0000", 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020422800000000001 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.855784+0000", 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051722900000000002 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3283 3.1c 3:3b97d9c9:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.232357+0000", 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.269680324999999, 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026046960000000001, 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.561 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3283 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.232357+0000", 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.232357+0000", 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.232360+0000", 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1769999999999998e-06 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.236401+0000", 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040411509999999998 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.236440+0000", 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8692999999999997e-05 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.236466+0000", 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6166e-05 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.236619+0000", 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015283199999999999 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.236879+0000", 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026018100000000001 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:17.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.237113+0000", 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023399099999999999 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.248680+0000", 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011567203999999999 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258070+0000", 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093892239999999998 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258252+0000", 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018210899999999999 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258404+0000", 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000152232 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3300 3.3a 3:5ca58b68:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.419857+0000", 2024-04-17T15:40:17.566 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.082180451999999, 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026548720000000001, 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3300 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.419857+0000", 2024-04-17T15:40:17.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.419857+0000", 2024-04-17T15:40:17.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.419861+0000", 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1069999999999998e-06 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.424687+0000", 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004825925 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.424729+0000", 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2103e-05 2024-04-17T15:40:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.424749+0000", 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0086999999999999e-05 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.424938+0000", 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018839700000000001 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.425424+0000", 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048676699999999998 2024-04-17T15:40:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.425873+0000", 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044906600000000003 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.438374+0000", 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012500634 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.446098+0000", 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077236340000000001 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.446266+0000", 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000168481 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.446406+0000", 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000139519 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3344 3.3a 3:5f6dbfd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_279:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:17.574 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.822456+0000", 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.679581283000001, 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026641279, 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3344 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.822456+0000", 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.822456+0000", 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.822460+0000", 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7170000000000002e-06 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.826305+0000", 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00384527 2024-04-17T15:40:17.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.826348+0000", 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2972000000000001e-05 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.826392+0000", 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4127e-05 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.826570+0000", 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000177555 2024-04-17T15:40:17.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.826989+0000", 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041957000000000002 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.827441+0000", 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000451712 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.846467+0000", 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.019025651000000001 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.848928+0000", 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024611160000000002 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.849026+0000", 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7771999999999998e-05 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.849097+0000", 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1816999999999994e-05 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3358 3.1c 3:3b42a3df:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.982489+0000", 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.519547957, 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025653612999999999, 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.580 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3358 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.982489+0000", 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.982489+0000", 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.982493+0000", 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3900000000000002e-06 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.986512+0000", 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040192279999999997 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.986556+0000", 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4376999999999999e-05 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.986577+0000", 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.086e-05 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.986736+0000", 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015856400000000001 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.987081+0000", 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034556700000000002 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.987448+0000", 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036662700000000001 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.998790+0000", 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011341591999999999 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.007964+0000", 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091747970000000002 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.008068+0000", 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103152 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.008143+0000", 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5458999999999997e-05 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3362 3.c 3:336ae878:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_297:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.031456+0000", 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.470581836000001, 2024-04-17T15:40:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.035086451999999997, 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3362 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.031456+0000", 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.031456+0000", 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.031459+0000", 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6440000000000002e-06 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.036032+0000", 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045729259999999997 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.036092+0000", 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0083000000000001e-05 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.036121+0000", 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8730000000000001e-05 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.036375+0000", 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025361399999999999 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.036394+0000", 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9167000000000001e-05 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.047155+0000", 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010761643 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.047499+0000", 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00034344399999999999 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.047864+0000", 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036474599999999999 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.059571+0000", 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011707868999999999 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.066206+0000", 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066343260000000003 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.066400+0000", 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019449800000000001 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.066542+0000", 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141762 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3744 3.38 e109/18 3:1cea9432:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_11:head v 109'18, mlcod=97'16)", 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.503205+0000", 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.9988323459999999, 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029868612999999999, 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.503205+0000", 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.503205+0000", 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.503208+0000", 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5299999999999999e-06 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.509780+0000", 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065719999999999997 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.509822+0000", 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2475999999999998e-05 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.509842+0000", 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0193000000000001e-05 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.509994+0000", 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000152039 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.510037+0000", 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2833000000000001e-05 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.532915+0000", 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022878286000000001 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.533074+0000", 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015825600000000001 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3747 3.2a 3:552ab11d:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.535221+0000", 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.9668168260000001, 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.032156972999999998, 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3747 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.596 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.535221+0000", 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.535221+0000", 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.535223+0000", 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6840000000000001e-06 2024-04-17T15:40:17.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.541083+0000", 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058597759999999997 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.541127+0000", 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3886e-05 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.541152+0000", 2024-04-17T15:40:17.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5423e-05 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.541305+0000", 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015246300000000001 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.541320+0000", 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5500000000000001e-05 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.546730+0000", 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054097559999999999 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.546993+0000", 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000262635 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.547218+0000", 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022482099999999999 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.557071+0000", 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098531480000000008 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.567054+0000", 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0099834339999999994 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.567245+0000", 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019062199999999999 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.567378+0000", 2024-04-17T15:40:17.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013282499999999999 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3776 3.1d 3:b8d3ce12:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.863643+0000", 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.6383943140000001, 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029883446000000001, 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.602 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3776 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.863643+0000", 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.863643+0000", 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.863647+0000", 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9430000000000002e-06 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.870087+0000", 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064401750000000002 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.870133+0000", 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5766000000000002e-05 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.870153+0000", 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9700000000000001e-05 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.870330+0000", 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017737499999999999 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.870800+0000", 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000470266 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:17.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.871265+0000", 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046497599999999997 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.892783+0000", 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021517327999999999 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.893252+0000", 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046908900000000001 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.893354+0000", 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102186 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.893527+0000", 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000172642 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3780 3.2a 3:557b8f38:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:17.607 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.904598+0000", 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.59743916, 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027447493, 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3780 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.904598+0000", 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.904598+0000", 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.904601+0000", 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.943e-06 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.910169+0000", 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055679090000000002 2024-04-17T15:40:17.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.910206+0000", 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7373000000000003e-05 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.910225+0000", 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8130000000000001e-05 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.910424+0000", 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000199798 2024-04-17T15:40:17.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.910697+0000", 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027252400000000001 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.910969+0000", 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027205799999999999 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.924164+0000", 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013194902999999999 2024-04-17T15:40:17.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.931865+0000", 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077015299999999998 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.931968+0000", 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102129 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.932046+0000", 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8195999999999995e-05 2024-04-17T15:40:17.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3788 3.22 3:47b0d2aa:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.990634+0000", 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.5114038810000001, 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028170791000000001, 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:17.613 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3788 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.990634+0000", 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.990634+0000", 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:17.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.990636+0000", 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8169999999999999e-06 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.994637+0000", 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040010009999999997 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.994674+0000", 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6247e-05 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.994691+0000", 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7292999999999999e-05 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.994858+0000", 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166942 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.995123+0000", 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026497800000000002 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-04-17T15:40:17.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.995364+0000", 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000241251 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.005599+0000", 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010234735999999999 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.018487+0000", 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012888709 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:17.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.018673+0000", 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018547799999999999 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.018804+0000", 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013133900000000001 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:17.618 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:17.620 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:17.621 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:17.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:40:17.621 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:17.621+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:17.621 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:17.622 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:17.622 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:17.622 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:17.633 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:17.633 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:17.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:40:17.673 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:17.673 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:17.710 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:17.710 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:17.721 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:17.721+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:17.810 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:17.810 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:17.821 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:17.820+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:17.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:40:17.922 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:17.920+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:18.022 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:18.022 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:18.023 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:18.020+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:18.039 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:40:18.124 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:18.124+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:18.180 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:18.180 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:18.199 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:40:18.225 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:18.224+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:18.326 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:18.325+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:18.350 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:18.386 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:18.387 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:40:18.431 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:18.433+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:18.520 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:40:18.528 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:18.529+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:18.577 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:18.577 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:18.594 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:40:18.636 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:18.637+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:18.729 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:18.729+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:18.788 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:18.788 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:18.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-17T15:40:18.856 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:18.856+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:18.930 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:18.928+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:18.967 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:18.967 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:18.988 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-17T15:40:19.032 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:19.032+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:19.131 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:19.133+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:19.194 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:19.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-17T15:40:19.232 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:19.233+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:19.335 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:19.332+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:19.375 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:19.376 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:19.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-17T15:40:19.448 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:19.448+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:19.535 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:19.532+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:19.596 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:19.596 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:19.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-17T15:40:19.636 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:19.637+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:19.738 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-04-17T15:40:19.737+0000 7f6e06f5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25228) UID: 0 2024-04-17T15:40:19.750 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-17T15:40:19.806 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:19.829 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-17T15:40:19.875 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:19.876+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:19.940 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:19.940+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:19.972 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:19.975 INFO:teuthology.orchestra.run.smithi044.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:19.975 INFO:teuthology.orchestra.run.smithi044.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:19.995 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:19.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-17T15:40:20.017 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:20.018 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:20.040 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:20.041+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:20.053 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:20.092 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:20.092 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:20.141 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:20.140+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:20.163 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:20.163 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:20.164 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:20.165 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:20.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-17T15:40:20.193 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:20.193 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:20.242 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:20.241+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:20.338 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:20.339 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:20.339 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:20.342 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:20.340+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:20.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-17T15:40:20.444 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:20.445+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:20.545 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:20.544+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2214 3.2f 3:f4daa8af:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.267834276000002, 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025693277, 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.553 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2214 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.554 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286491+0000", 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.286494+0000", 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0939999999999999e-06 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.555 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288322+0000", 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018278140000000001 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288356+0000", 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3698999999999997e-05 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288369+0000", 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3621999999999999e-05 2024-04-17T15:40:20.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288438+0000", 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9170000000000004e-05 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288612+0000", 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017349800000000001 2024-04-17T15:40:20.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.288737+0000", 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012507800000000001 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.296995+0000", 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0082578849999999995 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312070+0000", 2024-04-17T15:40:20.558 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015074834 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312134+0000", 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4127000000000005e-05 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.312184+0000", 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0455999999999999e-05 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.559 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2238 3.2e 3:7402fc91:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.023280119000006, 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020645427000000001, 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2238 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531045+0000", 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.531048+0000", 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4789999999999999e-06 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.561 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532609+0000", 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015611449999999999 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532641+0000", 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.205e-05 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532655+0000", 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4428e-05 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.562 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532753+0000", 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.7969999999999999e-05 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.532943+0000", 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018985399999999999 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.533106+0000", 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016300599999999999 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.563 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.541938+0000", 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0088315349999999997 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551610+0000", 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0096723810000000007 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551655+0000", 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5262000000000001e-05 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.564 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.551690+0000", 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5317000000000001e-05 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2256 3.24 3:26191b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 87.836784907999998, 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019738722, 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.565 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2256 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717540+0000", 2024-04-17T15:40:20.566 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717543+0000", 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4360000000000001e-06 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719252+0000", 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017092609999999999 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719281+0000", 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9337000000000001e-05 2024-04-17T15:40:20.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719294+0000", 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2258e-05 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719379+0000", 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5389000000000005e-05 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.568 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719574+0000", 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019467 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.719744+0000", 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017056600000000001 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.726549+0000", 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0068046929999999997 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.569 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737152+0000", 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010603458 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737221+0000", 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8620000000000004e-05 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.737279+0000", 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8034e-05 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2655 3.3b e89/18 3:de05f332:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_10:head v 89'7, mlcod=76'5)", 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.622274603999998, 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022625060999999998, 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.571 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.932051+0000", 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.5600000000000004e-07 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.937998+0000", 2024-04-17T15:40:20.572 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0059469739999999998 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938039+0000", 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0113e-05 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938062+0000", 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3807000000000001e-05 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938236+0000", 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017403500000000001 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.573 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.938303+0000", 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.6190000000000002e-05 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954503+0000", 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016200763999999999 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.574 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.954676+0000", 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00017232200000000001 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2656 3.16 3:6ad2ad56:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.603091302000003, 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022969676000000001, 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.575 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2656 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.576 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951234+0000", 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.951237+0000", 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.264e-06 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956406+0000", 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0051685460000000004 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.577 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956439+0000", 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2959000000000001e-05 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956456+0000", 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7217000000000001e-05 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956609+0000", 2024-04-17T15:40:20.578 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015330899999999999 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.956880+0000", 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027084100000000002 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.957130+0000", 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00025006900000000001 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.966230+0000", 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.009099434 2024-04-17T15:40:20.579 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974022+0000", 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077925549999999996 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974126+0000", 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000103706 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.974204+0000", 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7775999999999995e-05 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.580 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2664 3.21 3:84c31c70:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.406159393999999, 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019486428, 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2664 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.581 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148166+0000", 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.582 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.148169+0000", 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0070000000000002e-06 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151347+0000", 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031786599999999998 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151397+0000", 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9317000000000002e-05 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151417+0000", 2024-04-17T15:40:20.583 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.012e-05 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151540+0000", 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012354900000000001 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151802+0000", 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00026111400000000001 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.151955+0000", 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015302 2024-04-17T15:40:20.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.159770+0000", 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078157350000000007 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167530+0000", 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077592989999999999 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167595+0000", 2024-04-17T15:40:20.585 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5320999999999993e-05 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.167652+0000", 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7286e-05 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:2689 3.2d e89/18 3:b5f89bd2:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_44:head v 89'5, mlcod=77'3)", 2024-04-17T15:40:20.586 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.84869398, 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023548848000000001, 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.587 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705631+0000", 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705634+0000", 2024-04-17T15:40:20.588 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0929999999999999e-06 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711102+0000", 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054679810000000002 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711146+0000", 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3940000000000003e-05 2024-04-17T15:40:20.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711170+0000", 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4283000000000001e-05 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711304+0000", 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013349999999999999 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.590 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.711341+0000", 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6803e-05 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729020+0000", 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017679553000000001 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.729180+0000", 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00015969500000000001 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.591 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3188 3.2f 3:f4860977:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.542148660999999, 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019398723999999999, 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.592 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3188 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012177+0000", 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.012181+0000", 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.4129999999999999e-06 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014461+0000", 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0022799539999999998 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014506+0000", 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5529999999999999e-05 2024-04-17T15:40:20.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014526+0000", 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9542999999999999e-05 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014635+0000", 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010869700000000001 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.014813+0000", 2024-04-17T15:40:20.595 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178128 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.015010+0000", 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000197111 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.023029+0000", 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080189619999999993 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031512+0000", 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0084828179999999996 2024-04-17T15:40:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031549+0000", 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6944999999999999e-05 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.031575+0000", 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6622999999999999e-05 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.597 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3195 3.16 3:6892fdae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.407474421, 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021725749999999999, 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.598 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3195 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146851+0000", 2024-04-17T15:40:20.599 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.146855+0000", 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8800000000000001e-06 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150499+0000", 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036446019999999998 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150530+0000", 2024-04-17T15:40:20.600 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1099999999999997e-05 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150543+0000", 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2847000000000001e-05 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150617+0000", 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4294000000000004e-05 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150741+0000", 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123731 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.601 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.150854+0000", 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011274500000000001 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.157302+0000", 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0064475870000000003 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168431+0000", 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011129847 2024-04-17T15:40:20.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168516+0000", 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4331000000000003e-05 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.168577+0000", 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.0785999999999997e-05 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3215 3.16 3:69d29e25:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.17246037, 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020347908000000001, 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3215 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.604 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381865+0000", 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.381869+0000", 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8070000000000001e-06 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384172+0000", 2024-04-17T15:40:20.605 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002302957 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384202+0000", 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0704000000000003e-05 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384216+0000", 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3376e-05 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384299+0000", 2024-04-17T15:40:20.606 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3622000000000007e-05 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384481+0000", 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000182086 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.384646+0000", 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016434199999999999 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.396642+0000", 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011996079 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402122+0000", 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0054798360000000001 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402169+0000", 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7664000000000003e-05 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.402213+0000", 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3435e-05 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3232 3.2e 3:77f4f650:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.977647825999998, 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020894309, 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.609 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3232 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.610 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576677+0000", 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.576681+0000", 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3060000000000002e-06 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578598+0000", 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001917799 2024-04-17T15:40:20.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578637+0000", 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8884000000000002e-05 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578654+0000", 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6578999999999998e-05 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578752+0000", 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.8412000000000006e-05 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.612 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.578884+0000", 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000131359 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.579029+0000", 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014510799999999999 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.584890+0000", 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0058607679999999997 2024-04-17T15:40:20.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597433+0000", 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012543642000000001 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597513+0000", 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.9538999999999999e-05 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.597572+0000", 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8913000000000003e-05 2024-04-17T15:40:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3245 3.24 3:26e56b05:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.813839968, 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020901084, 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.615 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3245 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.616 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740485+0000", 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.740501+0000", 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5823000000000001e-05 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742689+0000", 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0021879009999999999 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.617 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742737+0000", 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8519000000000001e-05 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742759+0000", 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.173e-05 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.742848+0000", 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.9116000000000005e-05 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743031+0000", 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018237599999999999 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.743192+0000", 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000161461 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.749847+0000", 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0066546610000000001 2024-04-17T15:40:20.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761259+0000", 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011411813999999999 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761330+0000", 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1481000000000002e-05 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.620 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.761386+0000", 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6202000000000002e-05 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3254 3.21 3:86770de1:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.690282121999999, 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022547540000000001, 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.621 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3254 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864043+0000", 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.864046+0000", 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.004e-06 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865763+0000", 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017173360000000001 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865809+0000", 2024-04-17T15:40:20.623 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5519999999999998e-05 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865827+0000", 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7716000000000001e-05 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.865933+0000", 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010629 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.624 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866093+0000", 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000159946 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.866220+0000", 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000127164 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.873221+0000", 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0070009570000000004 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.625 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886373+0000", 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013151891000000001 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886502+0000", 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012948500000000001 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.886591+0000", 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.8231000000000003e-05 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3264 3.24 3:26cd557b:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 27.544594506999999, 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020478857, 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3264 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.627 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009731+0000", 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.009734+0000", 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1980000000000001e-06 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.628 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011450+0000", 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017157369999999999 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011475+0000", 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5151999999999999e-05 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011488+0000", 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3740000000000001e-05 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.629 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011581+0000", 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.255e-05 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011705+0000", 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012390900000000001 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.011811+0000", 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000106111 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.630 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.019611+0000", 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077997359999999998 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030126+0000", 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010514977999999999 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030173+0000", 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7451999999999999e-05 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.631 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.030210+0000", 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.6294000000000002e-05 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3343 3.16 3:6ae5c866:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_278:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 26.743781135999999, 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019911570999999999, 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.632 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3343 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810544+0000", 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.810546+0000", 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.357e-06 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812931+0000", 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023841180000000002 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812960+0000", 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9677999999999999e-05 2024-04-17T15:40:20.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.812971+0000", 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.1259e-05 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813071+0000", 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.9406000000000003e-05 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813247+0000", 2024-04-17T15:40:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000176429 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.813415+0000", 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016733000000000001 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.824091+0000", 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010676296 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830354+0000", 2024-04-17T15:40:20.636 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006263294 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830402+0000", 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8155999999999998e-05 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:53.830456+0000", 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3248000000000002e-05 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.637 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3798 3.9 e110/18 3:932f5b49:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_65:head v 110'20, mlcod=110'18)", 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:16.102470+0000", 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.4518550120000002, 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023137291000000001, 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.102470+0000", 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.638 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.102470+0000", 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.102472+0000", 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.869e-06 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.106609+0000", 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0041371669999999998 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.639 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.106645+0000", 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5533e-05 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.106662+0000", 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7323999999999999e-05 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.106776+0000", 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000113616 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.640 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.106809+0000", 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3512e-05 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.125564+0000", 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018754671000000001 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.125607+0000", 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3599e-05 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.641 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3865 3.4 e110/18 3:237ed7f4:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_132:head v 110'12, mlcod=110'10)", 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:17.058161+0000", 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.4961637360000002, 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021558403, 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.058161+0000", 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.642 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.058161+0000", 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.058164+0000", 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6740000000000001e-06 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.062607+0000", 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.004442568 2024-04-17T15:40:20.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.062650+0000", 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3732000000000001e-05 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.062673+0000", 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2218e-05 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.062837+0000", 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000164167 2024-04-17T15:40:20.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.062905+0000", 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8104999999999999e-05 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.079578+0000", 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016672920000000001 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.079720+0000", 2024-04-17T15:40:20.645 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014201900000000001 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3866 3.24 3:246f93f4:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:17.078780+0000", 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.475545152, 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.020716024999999999, 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.646 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3866 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.078780+0000", 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.078780+0000", 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.647 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.078784+0000", 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.963e-06 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.084472+0000", 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0056881620000000001 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.084522+0000", 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9435999999999999e-05 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.648 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.084542+0000", 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0417000000000001e-05 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.084714+0000", 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000171619 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.085118+0000", 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040403699999999999 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.649 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.085530+0000", 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041220699999999999 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.098011+0000", 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.012481347 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.099388+0000", 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001377191 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.650 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.099448+0000", 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9342000000000002e-05 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.099496+0000", 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8303999999999997e-05 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3874 3.2f 3:f65d8f70:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:17.272382+0000", 2024-04-17T15:40:20.651 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 3.2819434379999999, 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021344078999999998, 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3874 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.272382+0000", 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.272382+0000", 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.272387+0000", 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.78e-06 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.275506+0000", 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0031190979999999998 2024-04-17T15:40:20.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.275554+0000", 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8031999999999997e-05 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.275582+0000", 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8473e-05 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.275749+0000", 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167193 2024-04-17T15:40:20.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.276047+0000", 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029780099999999999 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.276331+0000", 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000283589 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.285709+0000", 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093778999999999998 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.293557+0000", 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0078488749999999999 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.293652+0000", 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4204999999999997e-05 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.293726+0000", 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.4133000000000003e-05 2024-04-17T15:40:20.656 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:4138 3.21 3:86de3e95:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_395:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:20.308362+0000", 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.245963352, 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.019492545999999999, 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:20.657 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 4138 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.308362+0000", 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.308362+0000", 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.658 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.308365+0000", 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5049999999999999e-06 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.310220+0000", 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001854238 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.310248+0000", 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8773e-05 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.659 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.310263+0000", 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4219000000000001e-05 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.310354+0000", 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0958000000000006e-05 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.310535+0000", 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018191299999999999 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.660 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.310692+0000", 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000156362 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.321563+0000", 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010870807 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.327731+0000", 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0061680249999999997 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.327804+0000", 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3175000000000003e-05 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.327854+0000", 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0571000000000001e-05 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:20.662 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:20.663 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-17T15:40:20.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-17T15:40:20.665 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:20.665+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:20.765 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:20.765+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:20.856 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:20.856 INFO:teuthology.orchestra.run.smithi044.stdout: "num_ops": 0 2024-04-17T15:40:20.856 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:20.865 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:20.865+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:20.876 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-17T15:40:20.966 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:20.964+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:21.067 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:21.068+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:21.080 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [], 2024-04-17T15:40:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: "complaint_time": 30, 2024-04-17T15:40:21.081 INFO:teuthology.orchestra.run.smithi044.stdout: "num_blocked_ops": 0 2024-04-17T15:40:21.081 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:21.099 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-17T15:40:21.190 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-04-17T15:40:21.188+0000 7f83eb93f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25056) UID: 0 2024-04-17T15:40:21.269 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:21.269+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:40:21.295 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 20, 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 600, 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "ops": [ 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2199 3.7 3:e2f05400:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 89.166875974000007, 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022721206000000001, 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2199 2024-04-17T15:40:21.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129157+0000", 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.129160+0000", 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.4410000000000002e-06 2024-04-17T15:40:21.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131862+0000", 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0027018070000000001 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131886+0000", 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3856e-05 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.131898+0000", 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.2587e-05 2024-04-17T15:40:21.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132025+0000", 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012693000000000001 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132188+0000", 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016297600000000001 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.132296+0000", 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010744200000000001 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142432+0000", 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010136548 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151752+0000", 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0093193830000000005 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151821+0000", 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9082e-05 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.300 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.151878+0000", 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.7154000000000002e-05 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2200 3.1e 3:79e523ee:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 89.155100054000002, 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022713144000000001, 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.301 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2200 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.302 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140933+0000", 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.140934+0000", 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8080000000000001e-06 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142912+0000", 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0019773759999999999 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142936+0000", 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4281e-05 2024-04-17T15:40:21.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.142950+0000", 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4051e-05 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143055+0000", 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000104864 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143239+0000", 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018364 2024-04-17T15:40:21.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.143402+0000", 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016366300000000001 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.152912+0000", 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095098249999999995 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163507+0000", 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.01059473 2024-04-17T15:40:21.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163583+0000", 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.5829999999999997e-05 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.163646+0000", 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.3076000000000004e-05 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.306 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2243 3.2 3:428a0d64:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.713356380999997, 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028309178000000001, 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2243 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582676+0000", 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.582679+0000", 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5189999999999999e-06 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.308 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585366+0000", 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0026876560000000001 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585398+0000", 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1238000000000001e-05 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585413+0000", 2024-04-17T15:40:21.309 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4892000000000001e-05 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585485+0000", 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.224e-05 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585600+0000", 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000115219 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:21.310 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.585715+0000", 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011485900000000001 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.593758+0000", 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080430970000000008 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610893+0000", 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017134947000000001 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610937+0000", 2024-04-17T15:40:21.311 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.3875000000000003e-05 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.610985+0000", 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8636e-05 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2255 3.7 3:e1491af7:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 88.586712417000001, 2024-04-17T15:40:21.312 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023721701000000001, 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2255 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.313 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709320+0000", 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.709323+0000", 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1039999999999998e-06 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711135+0000", 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018113319999999999 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711155+0000", 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0403000000000001e-05 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711168+0000", 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3380000000000001e-05 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711445+0000", 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00027629299999999999 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711567+0000", 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012219499999999999 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.711674+0000", 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010716400000000001 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.717904+0000", 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0062296080000000002 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.732965+0000", 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015061025 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733006+0000", 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.1480000000000003e-05 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:38:52.733042+0000", 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5716999999999997e-05 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.317 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2646 3.8 3:1239e904:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 52.561467665999999, 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.025266311, 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.318 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2646 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734565+0000", 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.734569+0000", 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8099999999999999e-06 2024-04-17T15:40:21.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739260+0000", 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0046916730000000004 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739303+0000", 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.2799000000000001e-05 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739322+0000", 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.8389999999999998e-05 2024-04-17T15:40:21.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739489+0000", 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000167016 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.739896+0000", 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040707699999999999 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.740309+0000", 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00041348699999999998 2024-04-17T15:40:21.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.754426+0000", 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014117002 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759750+0000", 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0053237900000000001 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759800+0000", 2024-04-17T15:40:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0405000000000003e-05 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:28.759831+0000", 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0861999999999997e-05 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2688 3.18 3:1b829d89:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 51.612232069000001, 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023433995999999999, 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.323 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2688 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.324 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683801+0000", 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.683806+0000", 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.2000000000000002e-06 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688730+0000", 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0049237680000000002 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.325 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688789+0000", 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.9469999999999998e-05 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688813+0000", 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4253e-05 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.688955+0000", 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014158899999999999 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689247+0000", 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00029219100000000002 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.689484+0000", 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00023730499999999999 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.705954+0000", 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016469461000000001 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707072+0000", 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001118427 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707163+0000", 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.1199999999999994e-05 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:29.707235+0000", 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1131999999999996e-05 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.328 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:2737 3.8 3:1044985e:::5305729a-6754-489e-9706-ab50dfde728d.4412.10__shadow_.LeyThvEFeVFPftIi9SQDQMJ4L1Gc_RT_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 50.962040762999997, 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024601553000000002, 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2737 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.329 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333992+0000", 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.333996+0000", 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8929999999999998e-06 2024-04-17T15:40:21.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335595+0000", 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0015994550000000001 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335629+0000", 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3559000000000002e-05 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335645+0000", 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6597999999999999e-05 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335729+0000", 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.3633000000000004e-05 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op must wait for map", 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.335735+0000", 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.6189999999999999e-06 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339342+0000", 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0036071340000000001 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339550+0000", 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020780199999999999 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.339728+0000", 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000178734 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.354941+0000", 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015212356 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.333 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358485+0000", 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035443250000000001 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358544+0000", 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.8888000000000003e-05 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:30.358593+0000", 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.9557e-05 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.334 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3208 3.1e 3:7bf3f1fd:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.990319349, 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.024643996000000001, 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.335 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3208 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305713+0000", 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.305716+0000", 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8609999999999998e-06 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307655+0000", 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.001938546 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307680+0000", 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.5238000000000001e-05 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307695+0000", 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5133000000000001e-05 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307786+0000", 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0728000000000003e-05 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.307955+0000", 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00016871400000000001 2024-04-17T15:40:21.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.308078+0000", 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012391 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.317113+0000", 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0090349109999999996 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330212+0000", 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.013098344 2024-04-17T15:40:21.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330292+0000", 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.0183000000000001e-05 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.330357+0000", 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.5427999999999998e-05 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.340 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3237 3.33 3:cc5684ed:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.665084413999999, 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022846793000000001, 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3237 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.341 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630948+0000", 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.630950+0000", 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.7039999999999999e-06 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.342 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632791+0000", 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0018406119999999999 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632820+0000", 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9380999999999999e-05 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632834+0000", 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.4345000000000001e-05 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.343 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.632926+0000", 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.2145999999999995e-05 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633056+0000", 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012976700000000001 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.633198+0000", 2024-04-17T15:40:21.344 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000141342 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.639250+0000", 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.006052605 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653695+0000", 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.014444988000000001 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653741+0000", 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.5556000000000002e-05 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.345 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.653795+0000", 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.4347e-05 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3250 3.7 3:e148f750:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.478749630999999, 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021674067000000002, 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.346 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3250 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817283+0000", 2024-04-17T15:40:21.347 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.817288+0000", 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7299999999999996e-06 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820832+0000", 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0035441740000000002 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820870+0000", 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7565999999999999e-05 2024-04-17T15:40:21.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.820885+0000", 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5132e-05 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821009+0000", 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000124475 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821146+0000", 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013711600000000001 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.349 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.821247+0000", 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00010072400000000001 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.827312+0000", 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0060654389999999997 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838765+0000", 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011452208 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838888+0000", 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000123771 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.838957+0000", 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.8732000000000005e-05 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3252 3.2 3:40c9ca30:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.459257792999999, 2024-04-17T15:40:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022557901000000002, 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3252 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.352 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836775+0000", 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.836777+0000", 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.4949999999999998e-06 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843566+0000", 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0067891239999999997 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.353 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843599+0000", 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.2002999999999998e-05 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843614+0000", 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5957e-05 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843705+0000", 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.0276000000000001e-05 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.354 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.843902+0000", 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019734200000000001 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.844063+0000", 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000160512 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.854965+0000", 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.010902593 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.355 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859208+0000", 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0042428580000000004 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859279+0000", 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0858000000000005e-05 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.859333+0000", 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3882999999999999e-05 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3257 3.29 3:97b19dae:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.383425367000001, 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021952833000000001, 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3257 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.357 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912607+0000", 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.912611+0000", 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0330000000000002e-06 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.358 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916649+0000", 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0040378489999999996 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916685+0000", 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.5646999999999999e-05 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916701+0000", 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.6328e-05 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.359 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.916812+0000", 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011056 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917015+0000", 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020336400000000001 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.917200+0000", 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00018441900000000001 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.926337+0000", 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0091371060000000007 2024-04-17T15:40:21.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934459+0000", 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0081220489999999992 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934506+0000", 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.7534999999999998e-05 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.934560+0000", 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3943000000000002e-05 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.361 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3259 3.29 3:97b435f0:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 28.350143868, 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.021828215000000002, 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3259 2024-04-17T15:40:21.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945889+0000", 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.945892+0000", 2024-04-17T15:40:21.363 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.9679999999999998e-06 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.947986+0000", 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020939650000000001 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948032+0000", 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.6180999999999997e-05 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948055+0000", 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.3031999999999999e-05 2024-04-17T15:40:21.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948167+0000", 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00011191700000000001 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948370+0000", 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00020330599999999999 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.948569+0000", 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00019869199999999999 2024-04-17T15:40:21.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.956337+0000", 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0077678039999999997 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967491+0000", 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.011154393 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967620+0000", 2024-04-17T15:40:21.366 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012935299999999999 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:39:52.967717+0000", 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6603999999999999e-05 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3744 3.38 3:1cea9432:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:15.499761+0000", 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.7962716729999997, 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.034184783000000003, 2024-04-17T15:40:21.367 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3744 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.499761+0000", 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.499761+0000", 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.499765+0000", 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.8020000000000002e-06 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.502594+0000", 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0028294739999999998 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.502632+0000", 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.7731000000000002e-05 2024-04-17T15:40:21.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.502651+0000", 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9412e-05 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.502780+0000", 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000128283 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.503084+0000", 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030429399999999998 2024-04-17T15:40:21.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 5", 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.503390+0000", 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00030586399999999998 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.511435+0000", 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0080451340000000007 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.533807+0000", 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022372103000000001 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.533884+0000", 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.7272000000000001e-05 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.533946+0000", 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.1414000000000005e-05 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3765 3.1e 3:78f300bf:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:15.743090+0000", 2024-04-17T15:40:21.372 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.5529424199999999, 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.030025725, 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3765 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.743090+0000", 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.743090+0000", 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.743093+0000", 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7690000000000001e-06 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745449+0000", 2024-04-17T15:40:21.374 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0023559660000000001 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745482+0000", 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.3259999999999997e-05 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745496+0000", 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3821e-05 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.375 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745590+0000", 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.4205999999999999e-05 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745774+0000", 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000183838 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.745927+0000", 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000152435 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.376 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.755467+0000", 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0095402170000000001 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.772992+0000", 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.017525171999999999 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.773063+0000", 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.0629000000000004e-05 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.377 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.773116+0000", 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.3412000000000003e-05 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_repop(client.4412.0:3788 3.22 e110/18 3:47b0d2aa:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_55:head v 110'12, mlcod=98'10)", 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:15.995986+0000", 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.3000464699999998, 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.022398136999999999, 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.995986+0000", 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.995986+0000", 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.995987+0000", 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.0389999999999999e-06 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.379 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999790+0000", 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0038026620000000001 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999811+0000", 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.0925999999999999e-05 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999821+0000", 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 9.6970000000000005e-06 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999894+0000", 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3466000000000004e-05 2024-04-17T15:40:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:15.999922+0000", 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8187e-05 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.018320+0000", 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.018398136999999998 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.018384+0000", 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.4022999999999993e-05 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.381 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3790 3.29 3:96669cfd:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:16.014771+0000", 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 5.2812618990000004, 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.028223696, 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3790 2024-04-17T15:40:21.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.014771+0000", 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.014771+0000", 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.014773+0000", 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.2019999999999998e-06 2024-04-17T15:40:21.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.016832+0000", 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0020591260000000001 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.016864+0000", 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.1594000000000003e-05 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.016879+0000", 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5517000000000001e-05 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.016964+0000", 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.4588999999999999e-05 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.017134+0000", 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000170106 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.017276+0000", 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000142132 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.026225+0000", 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0089493890000000003 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.042851+0000", 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016625725000000001 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.042925+0000", 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.3726999999999994e-05 2024-04-17T15:40:21.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:16.042994+0000", 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 6.9589000000000001e-05 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:3864 3.18 3:1827d020:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:17.027201+0000", 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 4.2688313999999998, 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.023678237000000001, 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.387 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 3864 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.027201+0000", 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.388 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.027201+0000", 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.027205+0000", 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.0239999999999999e-06 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.032792+0000", 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.005586606 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.389 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.032840+0000", 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 4.8223999999999998e-05 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.032860+0000", 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.9850000000000001e-05 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.033035+0000", 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000174668 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.390 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.033461+0000", 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00042599000000000001 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.033869+0000", 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00040805099999999999 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.049331+0000", 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.015462518 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.391 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.050706+0000", 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0013751169999999999 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.050808+0000", 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000101703 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:17.050880+0000", 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.1486e-05 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:4121 3.29 3:96210a07:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_378:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:20.131500+0000", 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 1.1645322280000001, 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.027575795, 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 4121 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.393 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.131500+0000", 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.131500+0000", 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.131503+0000", 2024-04-17T15:40:21.394 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.8289999999999999e-06 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.133249+0000", 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0017458770000000001 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.133276+0000", 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.6641000000000001e-05 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.133290+0000", 2024-04-17T15:40:21.395 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.3957999999999999e-05 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.133377+0000", 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 8.6862999999999998e-05 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.133564+0000", 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000187641 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.133733+0000", 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000168753 2024-04-17T15:40:21.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.142456+0000", 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0087232430000000003 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.158764+0000", 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016307764999999998 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.158939+0000", 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000175408 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.397 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.159076+0000", 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00013681699999999999 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "description": "osd_op(client.4412.0:4174 3.29 3:940edac3:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_431:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "initiated_at": "2024-04-17T15:40:20.669752+0000", 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.62628115900000003, 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.026251930999999999, 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "continuous": false, 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "type_data": { 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.398 INFO:teuthology.orchestra.run.smithi044.stdout: "client_info": { 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "client": "client.4412", 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 4174 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "events": [ 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "initiated", 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.669752+0000", 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "header_read", 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.669752+0000", 2024-04-17T15:40:21.399 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "throttled", 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.669754+0000", 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 2.7300000000000001e-06 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "all_read", 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.672232+0000", 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.002478194 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "dispatched", 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.672263+0000", 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 3.0552000000000002e-05 2024-04-17T15:40:21.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.672279+0000", 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 1.5709000000000002e-05 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "reached_pg", 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.672357+0000", 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 7.8364999999999999e-05 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "started", 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.672497+0000", 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00014028000000000001 2024-04-17T15:40:21.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "waiting for subops from 4", 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.672621+0000", 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.00012324699999999999 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "op_commit", 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.679578+0000", 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.0069572460000000003 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.695846+0000", 2024-04-17T15:40:21.402 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.016267692 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "commit_sent", 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.695953+0000", 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 0.000107131 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: "event": "done", 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: "time": "2024-04-17T15:40:20.696003+0000", 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: "duration": 5.0785000000000003e-05 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-17T15:40:21.403 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:40:21.405 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-17T15:40:21.405 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-04-17T15:40:21.404+0000 7f29cbab2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25053) UID: 0 2024-04-17T15:40:21.506 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:21.505+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:21.520 INFO:tasks.workunit.client.0.smithi044.stdout:quota disabled for the bucket: buck_2024_03_17_15_40_10 2024-04-17T15:40:21.520 INFO:tasks.workunit.client.0.smithi044.stdout:adding file to bucket: 2Gb. 2024-04-17T15:40:21.520 INFO:tasks.workunit.client.0.smithi044.stdout:upload file successful 2024-04-17T15:40:21.520 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:40:21.520 INFO:tasks.workunit.client.0.smithi044.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-04-17T15:40:21.520 INFO:tasks.workunit.client.0.smithi044.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T15:40:21.534 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-17T15:40:21.549 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:21.549 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:21.549 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:40:21.549 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:21.563 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-17T15:40:21.608 INFO:tasks.ceph.osd.7.smithi063.stderr:2024-04-17T15:40:21.609+0000 7f3582750640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25234) UID: 0 2024-04-17T15:40:21.707 INFO:tasks.ceph.osd.6.smithi063.stderr:2024-04-17T15:40:21.709+0000 7f3015a0c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25231) UID: 0 2024-04-17T15:40:21.743 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:21.744 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:21.744 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:40:21.744 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:40:21.744 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:21.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-17T15:40:21.774 INFO:tasks.workunit.client.0.smithi044.stdout:user qa_user deleted 2024-04-17T15:40:21.774 INFO:tasks.workunit.client.0.smithi044.stdout:bucket delete succeeded 2024-04-17T15:40:21.779 INFO:tasks.workunit.client.0.smithi044.stdout:OK 2024-04-17T15:40:21.779 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-17T15:40:21.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-17T15:40:21.792 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-04-17T15:40:21.792 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-17T15:40:21.847 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:21.849+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:21.910 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-04-17T15:40:21.908+0000 7fda1f5ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25050) UID: 0 2024-04-17T15:40:21.935 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2186 3.3 3:c39ed755:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.945089924000001, 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025603819999999999, 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.936 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2186 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988967+0000", 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.988970+0000", 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0199999999999999e-06 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994765+0000", 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057953479999999996 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994817+0000", 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1212999999999999e-05 2024-04-17T15:40:21.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994839+0000", 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2500000000000001e-05 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.994996+0000", 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015727100000000001 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995269+0000", 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027263100000000001 2024-04-17T15:40:21.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:51.995547+0000", 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000278201 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.012834+0000", 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017286286000000001 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014324+0000", 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014908230000000001 2024-04-17T15:40:21.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014440+0000", 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115189 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.014571+0000", 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000131338 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.941 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2193 3.1a 3:5ab143c5:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.864053131999995, 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029438796999999999, 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2193 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070004+0000", 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.070007+0000", 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073915+0000", 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039083679999999997 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073973+0000", 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7330000000000002e-05 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.073991+0000", 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7932999999999999e-05 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074132+0000", 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000141395 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074415+0000", 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028309100000000002 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.074656+0000", 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024097800000000001 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.085954+0000", 2024-04-17T15:40:21.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011298335 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099221+0000", 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266712 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099326+0000", 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104769 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.099443+0000", 2024-04-17T15:40:21.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116839 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:2247 3.34 3:2f393940:::5305729a-6754-489e-9706-ab50dfde728d.4412.9__shadow_.8IsB9opV4KoiJn4trMETXmbnNRVR5ZN_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.307574269, 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036193349999999999, 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.947 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 2247 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626483+0000", 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.626486+0000", 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2669999999999998e-06 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630331+0000", 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038445049999999998 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630409+0000", 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8083000000000004e-05 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630429+0000", 2024-04-17T15:40:21.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0866e-05 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630585+0000", 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015545899999999999 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.630874+0000", 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028923399999999998 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.631109+0000", 2024-04-17T15:40:21.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023491500000000001 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.661356+0000", 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.03024729 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662304+0000", 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094733700000000003 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662521+0000", 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021693799999999999 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:38:52.662676+0000", 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000155456 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3214 3.1a 3:5af05094:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.563563160000001, 2024-04-17T15:40:21.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026716791, 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3214 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370494+0000", 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.370497+0000", 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.394e-06 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375507+0000", 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050097060000000001 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375549+0000", 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2076000000000002e-05 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375568+0000", 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8623000000000001e-05 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.375747+0000", 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017887900000000001 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.376173+0000", 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042638600000000001 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.376641+0000", 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046769599999999998 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.387458+0000", 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010817069 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397008+0000", 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095501070000000004 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397134+0000", 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000125986 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.397211+0000", 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6868999999999999e-05 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3248 3.14 3:2bd8a3aa:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.140390389, 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036059802000000002, 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3248 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793667+0000", 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.793670+0000", 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.27e-06 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800168+0000", 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064981429999999996 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800211+0000", 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2647e-05 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800231+0000", 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0075999999999999e-05 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800418+0000", 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000187095 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800689+0000", 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027156800000000003 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.800937+0000", 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024735799999999999 2024-04-17T15:40:21.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.821838+0000", 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020901405000000001 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829564+0000", 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077253900000000004 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829656+0000", 2024-04-17T15:40:21.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2461999999999997e-05 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:52.829726+0000", 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0388000000000004e-05 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3278 3.9 3:901d1baf:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.755674070000001, 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.036045059999999997, 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3278 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178383+0000", 2024-04-17T15:40:21.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.178386+0000", 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2499999999999998e-06 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182939+0000", 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045523370000000001 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182973+0000", 2024-04-17T15:40:21.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4164e-05 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.182990+0000", 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7770000000000001e-05 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.183166+0000", 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000175348 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.183580+0000", 2024-04-17T15:40:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041376999999999999 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.184017+0000", 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00043735900000000001 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.206149+0000", 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022131980999999998 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214134+0000", 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079846440000000008 2024-04-17T15:40:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214289+0000", 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015586899999999999 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.214428+0000", 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013856799999999999 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3279 3.14 3:2b0d2ba5:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.968 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.745870924999998, 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025537218, 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3279 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:21.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188186+0000", 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.188189+0000", 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9799999999999998e-06 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193213+0000", 2024-04-17T15:40:21.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050239400000000002 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193256+0000", 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3336e-05 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193281+0000", 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4983000000000001e-05 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193487+0000", 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020554500000000001 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193759+0000", 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027231400000000001 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.193995+0000", 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023626800000000001 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.212099+0000", 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018103668999999999 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213400+0000", 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001301202 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213593+0000", 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019239600000000001 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.213723+0000", 2024-04-17T15:40:21.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013058500000000001 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3284 3.14 3:2971c8f6:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.689943513999999, 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025723386000000001, 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3284 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244114+0000", 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.244117+0000", 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.224e-06 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247174+0000", 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003057649 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247230+0000", 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5232999999999998e-05 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247258+0000", 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8232999999999999e-05 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247439+0000", 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000180812 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.247896+0000", 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045720999999999999 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:21.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.248348+0000", 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045195599999999999 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.266345+0000", 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017997658999999999 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269169+0000", 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028231300000000001 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269701+0000", 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053260500000000001 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.269837+0000", 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000135675 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3285 3.34 3:2f312a35:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.680224702, 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026478687000000001, 2024-04-17T15:40:21.979 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3285 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253832+0000", 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.253835+0000", 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.14e-06 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258650+0000", 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048142410000000004 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258685+0000", 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4953999999999998e-05 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258711+0000", 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5919999999999999e-05 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.258974+0000", 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026291699999999999 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.259347+0000", 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00037358699999999999 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.259801+0000", 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045420600000000002 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.272624+0000", 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012822452 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280003+0000", 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073793620000000004 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280180+0000", 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000177319 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:53.280311+0000", 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013058899999999999 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.984 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3360 3.1b e98/18 3:d899093f:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_295:head v 98'17, mlcod=96'15)", 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.923512317, 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028203004, 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010545+0000", 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.010546+0000", 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9299999999999996e-07 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017091+0000", 2024-04-17T15:40:21.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065455590000000003 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017123+0000", 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.146e-05 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017148+0000", 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.514e-05 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017349+0000", 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000200931 2024-04-17T15:40:21.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.017410+0000", 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1489999999999996e-05 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038631+0000", 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.021220645 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038748+0000", 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011688600000000001 2024-04-17T15:40:21.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3359 3.2c e98/18 3:35140f57:::5305729a-6754-489e-9706-ab50dfde728d.4412.11__shadow_.1Ekf5r-qqqMZ0-crpuy69qefRa1JnZT_294:head v 98'12, mlcod=97'10)", 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.922068636999999, 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026019891, 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011988+0000", 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.011990+0000", 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.19e-06 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015476+0000", 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034868260000000002 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015505+0000", 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9030000000000002e-05 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015523+0000", 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7520000000000002e-05 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015719+0000", 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019590499999999999 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.015785+0000", 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5988999999999994e-05 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.037812+0000", 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.022027409000000001 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:39:54.038008+0000", 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019602199999999999 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:3774 3.13 e110/18 3:c861c045:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_41:head v 110'17, mlcod=98'15)", 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.852476+0000", 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.0815811139999996, 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025627451999999998, 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.993 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.852476+0000", 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.852476+0000", 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.852478+0000", 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.776e-06 2024-04-17T15:40:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859607+0000", 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071288250000000001 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859657+0000", 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0757000000000002e-05 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859682+0000", 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4533e-05 2024-04-17T15:40:21.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859886+0000", 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204048 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.859961+0000", 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5291999999999997e-05 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.877957+0000", 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017996232000000001 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.878103+0000", 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014598899999999999 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3783 3.3 3:c008dae6:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:15.935300+0000", 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.9987573650000003, 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.029051576999999999, 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:21.997 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3783 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.935300+0000", 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.935300+0000", 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:21.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.935303+0000", 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0400000000000001e-06 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939240+0000", 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039368299999999997 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939279+0000", 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9946e-05 2024-04-17T15:40:21.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939298+0000", 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8130000000000001e-05 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939446+0000", 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014880199999999999 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939721+0000", 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027500099999999998 2024-04-17T15:40:22.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.939995+0000", 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00027332399999999997 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.953189+0000", 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013194743 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.964023+0000", 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010834007 2024-04-17T15:40:22.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.964211+0000", 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018785199999999999 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:15.964351+0000", 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013990199999999999 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3798 3.9 3:932f5b49:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:16.097106+0000", 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.8369510340000001, 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.028636083, 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3798 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.097106+0000", 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.097106+0000", 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.097111+0000", 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.887e-06 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:22.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101086+0000", 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039747619999999997 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101129+0000", 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3800000000000001e-05 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101156+0000", 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6792999999999999e-05 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:22.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101301+0000", 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000145165 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101561+0000", 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025973100000000002 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.101810+0000", 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024839799999999999 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.111492+0000", 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0096819969999999995 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.125526+0000", 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014033982 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.125621+0000", 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5705999999999995e-05 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:22.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.125742+0000", 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120862 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:3806 3.9 3:92df0c4b:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:16.179237+0000", 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.7548203149999999, 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026296423999999999, 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:22.008 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 3806 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.179237+0000", 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.179237+0000", 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.179240+0000", 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4599999999999999e-06 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.183827+0000", 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045864110000000003 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.183878+0000", 2024-04-17T15:40:22.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0955999999999998e-05 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.183905+0000", 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7756e-05 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.184118+0000", 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021263200000000001 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:22.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.184581+0000", 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046349899999999997 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 2", 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.185022+0000", 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044105000000000001 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.197638+0000", 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012615578000000001 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.205242+0000", 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0076035540000000002 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.205386+0000", 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000144129 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:16.205533+0000", 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014739899999999999 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:4128 3.34 3:2e051985:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:20.204782+0000", 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.729275452, 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026190082, 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 4128 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.014 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.204782+0000", 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.204782+0000", 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.204803+0000", 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1084e-05 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.209731+0000", 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004928567 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.209768+0000", 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6566000000000002e-05 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.209785+0000", 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7609999999999999e-05 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.209956+0000", 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000170686 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.210405+0000", 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044918600000000002 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.210832+0000", 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00042685899999999997 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.228577+0000", 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017744471000000001 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.230672+0000", 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020951379999999999 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.230785+0000", 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011320900000000001 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:20.230972+0000", 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000186706 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:4212 3.14 3:28854104:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_469:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:21.100235+0000", 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.83382229600000002, 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026806632, 2024-04-17T15:40:22.019 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 4212 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.100235+0000", 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.100235+0000", 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.100243+0000", 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.96e-06 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.105575+0000", 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053321870000000004 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.105624+0000", 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8628999999999998e-05 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.105650+0000", 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6043000000000001e-05 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.105829+0000", 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017896899999999999 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.106658+0000", 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082930299999999998 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.106952+0000", 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00029457099999999998 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.118910+0000", 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01195772 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.126704+0000", 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077937759999999997 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.126896+0000", 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019169200000000001 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.127041+0000", 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014578200000000001 2024-04-17T15:40:22.024 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:4229 3.11 e111/18 3:8bb239d3:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_486:head v 111'31, mlcod=111'29)", 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:21.279387+0000", 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.65466954600000005, 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.026523865000000001, 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:22.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.279387+0000", 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.279387+0000", 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.279390+0000", 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9830000000000001e-06 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:22.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.282149+0000", 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002758169 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.282197+0000", 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8096999999999997e-05 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.282222+0000", 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5677000000000002e-05 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:22.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.282394+0000", 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000171588 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.282460+0000", 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5536000000000004e-05 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.305784+0000", 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.023324633000000001 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:22.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.305911+0000", 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012718199999999999 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4412.0:4230 3.11 e111/18 3:8be6428d:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_487:head v 111'32, mlcod=111'29)", 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:21.290205+0000", 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.64385163599999995, 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.027623693000000001, 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:22.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.290205+0000", 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.290205+0000", 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.290208+0000", 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6199999999999999e-06 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.292896+0000", 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026878470000000002 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.292934+0000", 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8133000000000002e-05 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.292951+0000", 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7368999999999999e-05 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.293131+0000", 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000179383 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.293206+0000", 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5055000000000006e-05 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.317707+0000", 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.024501189999999999 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.317829+0000", 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000122096 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4412.0:4234 3.3 3:c1980684:::5305729a-6754-489e-9706-ab50dfde728d.4412.12__shadow_.JYNERoiqDzJ3jzOAt77I3ed0FIg8T4Y_491:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-04-17T15:40:21.333404+0000", 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.60065328399999995, 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.025715662, 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-04-17T15:40:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4412", 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.44:0/1493800902", 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 4234 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.333404+0000", 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-04-17T15:40:22.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.333404+0000", 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.333408+0000", 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6199999999999998e-06 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.337467+0000", 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040581749999999998 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.337509+0000", 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2299000000000003e-05 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.337529+0000", 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0020000000000001e-05 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.337734+0000", 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020487899999999999 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.337999+0000", 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026574699999999999 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 0", 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.338243+0000", 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024362200000000001 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.347781+0000", 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095375080000000001 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.358940+0000", 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011159057 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.359039+0000", 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8828999999999999e-05 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-04-17T15:40:21.359119+0000", 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0906000000000001e-05 2024-04-17T15:40:22.038 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.039 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-04-17T15:40:22.039 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-04-17T15:40:22.039 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:22.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-17T15:40:22.041 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-04-17T15:40:22.041+0000 7f397eff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25230) UID: 0 2024-04-17T15:40:22.142 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:22.140+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:22.150 DEBUG:teuthology.parallel:result is None 2024-04-17T15:40:22.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T15:40:22.210 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T15:40:22.210 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-17T15:40:22.218 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:22.219 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:22.219 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-04-17T15:40:22.219 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:22.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-17T15:40:22.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-17T15:40:22.252 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-04-17T15:40:22.252+0000 7f43e633d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25052) UID: 0 2024-04-17T15:40:22.269 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T15:40:22.269 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-17T15:40:22.278 INFO:tasks.thrashosds:joining thrashosds 2024-04-17T15:40:22.361 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-04-17T15:40:22.361 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-04-17T15:40:22.362 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-04-17T15:40:22.362 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-04-17T15:40:22.362 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-04-17T15:40:22.376 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-17T15:40:22.400 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-17T15:40:22.400 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-17T15:40:22.416 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-17T15:40:22.417 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-17T15:40:22.433 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-17T15:40:22.433 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-17T15:40:22.449 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3: {} 2024-04-17T15:40:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-17T15:40:22.470 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4: {} 2024-04-17T15:40:22.470 INFO:teuthology.orchestra.run.smithi044.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-17T15:40:22.491 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5: {} 2024-04-17T15:40:22.491 INFO:teuthology.orchestra.run.smithi044.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-17T15:40:22.506 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:22.506 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:22.511 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6: {} 2024-04-17T15:40:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-17T15:40:22.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-17T15:40:22.531 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7: {} 2024-04-17T15:40:22.531 INFO:teuthology.orchestra.run.smithi044.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-17T15:40:22.641 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:22.641 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:22.656 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-17T15:40:22.776 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:22.777 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:22.791 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-17T15:40:22.911 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:22.911 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:22.927 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-17T15:40:23.052 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:23.052 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:23.067 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-17T15:40:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:23.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-17T15:40:23.328 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-04-17T15:40:23.328 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-17T15:40:23.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-17T15:40:23.936 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-17T15:40:23.962 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-17T15:40:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-17T15:40:41.826 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-17T15:40:41.976 INFO:teuthology.orchestra.run.smithi044.stdout:mon.a: {} 2024-04-17T15:40:41.976 INFO:teuthology.orchestra.run.smithi044.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-17T15:40:41.989 INFO:teuthology.orchestra.run.smithi044.stdout:mon.b: {} 2024-04-17T15:40:41.989 INFO:teuthology.orchestra.run.smithi044.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-17T15:40:41.998 INFO:teuthology.orchestra.run.smithi044.stdout:mon.c: {} 2024-04-17T15:40:41.999 INFO:teuthology.orchestra.run.smithi044.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-17T15:40:42.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-17T15:40:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-17T15:40:43.051 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-17T15:40:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-17T15:40:44.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-17T15:40:45.061 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-17T15:40:45.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-17T15:40:46.056 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-17T15:40:46.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-17T15:40:47.077 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-17T15:40:47.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-17T15:40:48.081 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-17T15:40:48.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-17T15:40:49.102 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.3 to 1 (10000) 2024-04-17T15:40:49.137 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-17T15:40:50.114 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-17T15:40:50.137 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-17T15:40:51.125 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.4 to 1 (10000) 2024-04-17T15:40:51.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-17T15:40:52.138 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-17T15:40:52.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-17T15:40:53.160 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.5 to 1 (10000) 2024-04-17T15:40:53.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-17T15:40:54.168 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-17T15:40:54.197 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-17T15:40:55.171 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.6 to 1 (10000) 2024-04-17T15:40:55.198 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-17T15:40:56.174 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-17T15:40:56.206 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-17T15:40:57.206 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.7 to 1 (10000) 2024-04-17T15:40:57.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-17T15:40:58.205 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-17T15:40:58.232 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-17T15:40:58.232 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-17T15:40:58.232 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-17T15:40:58.232 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-17T15:40:58.233 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-17T15:40:58.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:40:58.541 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:40:58.542 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":130,"fsid":"b60ce601-dc23-41b0-bc9a-dbbec538ec02","created":"2024-04-17T15:36:35.284161+0000","modified":"2024-04-17T15:40:58.197858+0000","last_up_change":"2024-04-17T15:36:46.049817+0000","last_in_change":"2024-04-17T15:36:37.641404+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T15:36:46.270784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T15:36:46.444362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-17T15:36:52.871633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-17T15:36:54.513126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-17T15:36:56.413136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-17T15:36:58.364100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-17T15:37:00.271798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-17T15:37:02.420124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c841b259-219b-4f39-a952-8ef354c8a4d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6825","nonce":4073594120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6827","nonce":4073594120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6831","nonce":4073594120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6829","nonce":4073594120}]},"public_addr":"172.21.15.44:6825/4073594120","cluster_addr":"172.21.15.44:6827/4073594120","heartbeat_back_addr":"172.21.15.44:6831/4073594120","heartbeat_front_addr":"172.21.15.44:6829/4073594120","state":["exists","up"]},{"osd":1,"uuid":"daffe35c-9fda-4a02-81e2-b40855ff3e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6801","nonce":3956479268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6803","nonce":3956479268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6807","nonce":3956479268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6805","nonce":3956479268}]},"public_addr":"172.21.15.44:6801/3956479268","cluster_addr":"172.21.15.44:6803/3956479268","heartbeat_back_addr":"172.21.15.44:6807/3956479268","heartbeat_front_addr":"172.21.15.44:6805/3956479268","state":["exists","up"]},{"osd":2,"uuid":"653abe6b-68bd-4e83-b0a7-2691e1d0dd0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6810","nonce":2986857736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6814","nonce":2986857736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6822","nonce":2986857736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6818","nonce":2986857736}]},"public_addr":"172.21.15.44:6810/2986857736","cluster_addr":"172.21.15.44:6814/2986857736","heartbeat_back_addr":"172.21.15.44:6822/2986857736","heartbeat_front_addr":"172.21.15.44:6818/2986857736","state":["exists","up"]},{"osd":3,"uuid":"71cbfda2-d611-49da-b314-284be425b041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6811","nonce":3785559761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6815","nonce":3785559761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6823","nonce":3785559761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6819","nonce":3785559761}]},"public_addr":"172.21.15.44:6811/3785559761","cluster_addr":"172.21.15.44:6815/3785559761","heartbeat_back_addr":"172.21.15.44:6823/3785559761","heartbeat_front_addr":"172.21.15.44:6819/3785559761","state":["exists","up"]},{"osd":4,"uuid":"c68cb5c7-9093-418d-be3c-db3e3bd8eab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6821","nonce":466020694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6825","nonce":466020694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6831","nonce":466020694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6829","nonce":466020694}]},"public_addr":"172.21.15.63:6821/466020694","cluster_addr":"172.21.15.63:6825/466020694","heartbeat_back_addr":"172.21.15.63:6831/466020694","heartbeat_front_addr":"172.21.15.63:6829/466020694","state":["exists","up"]},{"osd":5,"uuid":"638215dd-8efa-4141-8ae7-3aa44152ab5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6802","nonce":1787755738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6806","nonce":1787755738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6814","nonce":1787755738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6810","nonce":1787755738}]},"public_addr":"172.21.15.63:6802/1787755738","cluster_addr":"172.21.15.63:6806/1787755738","heartbeat_back_addr":"172.21.15.63:6814/1787755738","heartbeat_front_addr":"172.21.15.63:6810/1787755738","state":["exists","up"]},{"osd":6,"uuid":"b0cb7f79-bc86-4f01-9185-35d3b5166fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6801","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6803","nonce":1209539994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6805","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6807","nonce":1209539994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6813","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6815","nonce":1209539994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6811","nonce":1209539994}]},"public_addr":"172.21.15.63:6803/1209539994","cluster_addr":"172.21.15.63:6807/1209539994","heartbeat_back_addr":"172.21.15.63:6815/1209539994","heartbeat_front_addr":"172.21.15.63:6811/1209539994","state":["exists","up"]},{"osd":7,"uuid":"dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6817","nonce":573406477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6820","nonce":573406477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6828","nonce":573406477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6824","nonce":573406477}]},"public_addr":"172.21.15.63:6817/573406477","cluster_addr":"172.21.15.63:6820/573406477","heartbeat_back_addr":"172.21.15.63:6828/573406477","heartbeat_front_addr":"172.21.15.63:6824/573406477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.230218+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.131179+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.228760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.255261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.248671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.197037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.153100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.201227+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:40:58.562 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-17T15:40:58.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:40:58.861 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:40:58.861 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":130,"fsid":"b60ce601-dc23-41b0-bc9a-dbbec538ec02","created":"2024-04-17T15:36:35.284161+0000","modified":"2024-04-17T15:40:58.197858+0000","last_up_change":"2024-04-17T15:36:46.049817+0000","last_in_change":"2024-04-17T15:36:37.641404+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T15:36:46.270784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T15:36:46.444362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-17T15:36:52.871633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-17T15:36:54.513126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-17T15:36:56.413136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-17T15:36:58.364100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-17T15:37:00.271798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-17T15:37:02.420124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c841b259-219b-4f39-a952-8ef354c8a4d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6825","nonce":4073594120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6827","nonce":4073594120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6831","nonce":4073594120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6829","nonce":4073594120}]},"public_addr":"172.21.15.44:6825/4073594120","cluster_addr":"172.21.15.44:6827/4073594120","heartbeat_back_addr":"172.21.15.44:6831/4073594120","heartbeat_front_addr":"172.21.15.44:6829/4073594120","state":["exists","up"]},{"osd":1,"uuid":"daffe35c-9fda-4a02-81e2-b40855ff3e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6801","nonce":3956479268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6803","nonce":3956479268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6807","nonce":3956479268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6805","nonce":3956479268}]},"public_addr":"172.21.15.44:6801/3956479268","cluster_addr":"172.21.15.44:6803/3956479268","heartbeat_back_addr":"172.21.15.44:6807/3956479268","heartbeat_front_addr":"172.21.15.44:6805/3956479268","state":["exists","up"]},{"osd":2,"uuid":"653abe6b-68bd-4e83-b0a7-2691e1d0dd0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6810","nonce":2986857736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6814","nonce":2986857736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6822","nonce":2986857736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6818","nonce":2986857736}]},"public_addr":"172.21.15.44:6810/2986857736","cluster_addr":"172.21.15.44:6814/2986857736","heartbeat_back_addr":"172.21.15.44:6822/2986857736","heartbeat_front_addr":"172.21.15.44:6818/2986857736","state":["exists","up"]},{"osd":3,"uuid":"71cbfda2-d611-49da-b314-284be425b041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6811","nonce":3785559761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6815","nonce":3785559761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6823","nonce":3785559761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6819","nonce":3785559761}]},"public_addr":"172.21.15.44:6811/3785559761","cluster_addr":"172.21.15.44:6815/3785559761","heartbeat_back_addr":"172.21.15.44:6823/3785559761","heartbeat_front_addr":"172.21.15.44:6819/3785559761","state":["exists","up"]},{"osd":4,"uuid":"c68cb5c7-9093-418d-be3c-db3e3bd8eab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6821","nonce":466020694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6825","nonce":466020694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6831","nonce":466020694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6829","nonce":466020694}]},"public_addr":"172.21.15.63:6821/466020694","cluster_addr":"172.21.15.63:6825/466020694","heartbeat_back_addr":"172.21.15.63:6831/466020694","heartbeat_front_addr":"172.21.15.63:6829/466020694","state":["exists","up"]},{"osd":5,"uuid":"638215dd-8efa-4141-8ae7-3aa44152ab5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6802","nonce":1787755738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6806","nonce":1787755738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6814","nonce":1787755738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6810","nonce":1787755738}]},"public_addr":"172.21.15.63:6802/1787755738","cluster_addr":"172.21.15.63:6806/1787755738","heartbeat_back_addr":"172.21.15.63:6814/1787755738","heartbeat_front_addr":"172.21.15.63:6810/1787755738","state":["exists","up"]},{"osd":6,"uuid":"b0cb7f79-bc86-4f01-9185-35d3b5166fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6801","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6803","nonce":1209539994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6805","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6807","nonce":1209539994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6813","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6815","nonce":1209539994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6811","nonce":1209539994}]},"public_addr":"172.21.15.63:6803/1209539994","cluster_addr":"172.21.15.63:6807/1209539994","heartbeat_back_addr":"172.21.15.63:6815/1209539994","heartbeat_front_addr":"172.21.15.63:6811/1209539994","state":["exists","up"]},{"osd":7,"uuid":"dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6817","nonce":573406477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6820","nonce":573406477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6828","nonce":573406477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6824","nonce":573406477}]},"public_addr":"172.21.15.63:6817/573406477","cluster_addr":"172.21.15.63:6820/573406477","heartbeat_back_addr":"172.21.15.63:6828/573406477","heartbeat_front_addr":"172.21.15.63:6824/573406477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.230218+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.131179+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.228760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.255261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.248671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.197037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.153100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.201227+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:40:58.883 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-17T15:40:58.883 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-17T15:40:58.883 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-17T15:40:58.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-17T15:40:58.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-17T15:40:58.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-17T15:40:58.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-17T15:40:58.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-17T15:40:59.152 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:40:59.152 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T15:40:59.154 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:40:59.154 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T15:40:59.160 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:40:59.161 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T15:40:59.162 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:40:59.163 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T15:40:59.166 INFO:teuthology.orchestra.run.smithi044.stdout:60129542200 2024-04-17T15:40:59.167 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T15:40:59.171 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:40:59.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T15:40:59.173 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:40:59.173 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T15:40:59.180 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:40:59.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T15:40:59.657 INFO:teuthology.orchestra.run.smithi044.stdout:60129542197 2024-04-17T15:40:59.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542198 got 60129542197 for osd.0 2024-04-17T15:40:59.688 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:40:59.689 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:40:59.699 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:40:59.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542198 for osd.4 2024-04-17T15:40:59.712 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:40:59.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542198 for osd.5 2024-04-17T15:40:59.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542198 for osd.6 2024-04-17T15:40:59.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542200 got 60129542199 for osd.7 2024-04-17T15:40:59.740 INFO:teuthology.orchestra.run.smithi044.stdout:60129542197 2024-04-17T15:40:59.748 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:40:59.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542198 got 60129542197 for osd.3 2024-04-17T15:40:59.766 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:40:59.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542198 for osd.2 2024-04-17T15:40:59.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542198 for osd.1 2024-04-17T15:41:00.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T15:41:00.710 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T15:41:00.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T15:41:00.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T15:41:00.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T15:41:00.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T15:41:00.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T15:41:00.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T15:41:01.201 INFO:teuthology.orchestra.run.smithi044.stdout:60129542197 2024-04-17T15:41:01.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542198 got 60129542197 for osd.0 2024-04-17T15:41:01.245 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:41:01.256 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:41:01.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542199 for osd.5 2024-04-17T15:41:01.266 DEBUG:teuthology.parallel:result is None 2024-04-17T15:41:01.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542199 for osd.4 2024-04-17T15:41:01.279 DEBUG:teuthology.parallel:result is None 2024-04-17T15:41:01.293 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:41:01.298 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:41:01.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542199 for osd.2 2024-04-17T15:41:01.317 DEBUG:teuthology.parallel:result is None 2024-04-17T15:41:01.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542198 got 60129542198 for osd.3 2024-04-17T15:41:01.318 DEBUG:teuthology.parallel:result is None 2024-04-17T15:41:01.325 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:41:01.328 INFO:teuthology.orchestra.run.smithi044.stdout:60129542200 2024-04-17T15:41:01.340 INFO:teuthology.orchestra.run.smithi044.stdout:60129542199 2024-04-17T15:41:01.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542199 for osd.6 2024-04-17T15:41:01.353 DEBUG:teuthology.parallel:result is None 2024-04-17T15:41:01.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542200 got 60129542200 for osd.7 2024-04-17T15:41:01.355 DEBUG:teuthology.parallel:result is None 2024-04-17T15:41:01.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542199 got 60129542199 for osd.1 2024-04-17T15:41:01.360 DEBUG:teuthology.parallel:result is None 2024-04-17T15:41:02.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T15:41:02.534 INFO:teuthology.orchestra.run.smithi044.stdout:60129542198 2024-04-17T15:41:02.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542198 got 60129542198 for osd.0 2024-04-17T15:41:02.553 DEBUG:teuthology.parallel:result is None 2024-04-17T15:41:02.553 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-17T15:41:02.553 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:41:02.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:02.882 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:41:02.892 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-04-17T15:41:02.323848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300811955,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3304,"num_read_kb":2996,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3889,"ondisk_log_size":3889,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12576516,"kb_used_data":12318720,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":742398204,"statfs":{"total":773094113280,"available":760215760896,"internally_reserved":0,"allocated":12614369280,"data_stored":12609005810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":263835186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.142591"},"pg_stats":[{"pgid":"3.3f","version":"111'19","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513697+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:40:58.513697+0000","last_peered":"2024-04-17T15:40:58.513697+0000","last_clean":"2024-04-17T15:40:58.513697+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:40:58.513697+0000","last_undegraded":"2024-04-17T15:40:58.513697+0000","last_fullsized":"2024-04-17T15:40:58.513697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205015+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:40:58.205015+0000","last_peered":"2024-04-17T15:40:58.205015+0000","last_clean":"2024-04-17T15:40:58.205015+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:40:58.205015+0000","last_undegraded":"2024-04-17T15:40:58.205015+0000","last_fullsized":"2024-04-17T15:40:58.205015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"111'27","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207822+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:40:58.207822+0000","last_peered":"2024-04-17T15:40:58.207822+0000","last_clean":"2024-04-17T15:40:58.207822+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:40:58.207822+0000","last_undegraded":"2024-04-17T15:40:58.207822+0000","last_fullsized":"2024-04-17T15:40:58.207822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511785+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:40:58.511785+0000","last_peered":"2024-04-17T15:40:58.511785+0000","last_clean":"2024-04-17T15:40:58.511785+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:40:58.511785+0000","last_undegraded":"2024-04-17T15:40:58.511785+0000","last_fullsized":"2024-04-17T15:40:58.511785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870721+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:40:58.870721+0000","last_peered":"2024-04-17T15:40:58.870721+0000","last_clean":"2024-04-17T15:40:58.870721+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:40:58.870721+0000","last_undegraded":"2024-04-17T15:40:58.870721+0000","last_fullsized":"2024-04-17T15:40:58.870721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208399+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:40:58.208399+0000","last_peered":"2024-04-17T15:40:58.208399+0000","last_clean":"2024-04-17T15:40:58.208399+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:40:58.208399+0000","last_undegraded":"2024-04-17T15:40:58.208399+0000","last_fullsized":"2024-04-17T15:40:58.208399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'19","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206655+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:40:58.206655+0000","last_peered":"2024-04-17T15:40:58.206655+0000","last_clean":"2024-04-17T15:40:58.206655+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:40:58.206655+0000","last_undegraded":"2024-04-17T15:40:58.206655+0000","last_fullsized":"2024-04-17T15:40:58.206655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869758+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:40:58.869758+0000","last_peered":"2024-04-17T15:40:58.869758+0000","last_clean":"2024-04-17T15:40:58.869758+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:40:58.869758+0000","last_undegraded":"2024-04-17T15:40:58.869758+0000","last_fullsized":"2024-04-17T15:40:58.869758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'31","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512574+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:40:58.512574+0000","last_peered":"2024-04-17T15:40:58.512574+0000","last_clean":"2024-04-17T15:40:58.512574+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:40:58.512574+0000","last_undegraded":"2024-04-17T15:40:58.512574+0000","last_fullsized":"2024-04-17T15:40:58.512574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551803+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:40:58.551803+0000","last_peered":"2024-04-17T15:40:58.551803+0000","last_clean":"2024-04-17T15:40:58.551803+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:40:58.551803+0000","last_undegraded":"2024-04-17T15:40:58.551803+0000","last_fullsized":"2024-04-17T15:40:58.551803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'19","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206172+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:40:58.206172+0000","last_peered":"2024-04-17T15:40:58.206172+0000","last_clean":"2024-04-17T15:40:58.206172+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:40:58.206172+0000","last_undegraded":"2024-04-17T15:40:58.206172+0000","last_fullsized":"2024-04-17T15:40:58.206172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208445+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:40:58.208445+0000","last_peered":"2024-04-17T15:40:58.208445+0000","last_clean":"2024-04-17T15:40:58.208445+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:40:58.208445+0000","last_undegraded":"2024-04-17T15:40:58.208445+0000","last_fullsized":"2024-04-17T15:40:58.208445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512091+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:40:58.512091+0000","last_peered":"2024-04-17T15:40:58.512091+0000","last_clean":"2024-04-17T15:40:58.512091+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:40:58.512091+0000","last_undegraded":"2024-04-17T15:40:58.512091+0000","last_fullsized":"2024-04-17T15:40:58.512091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210498+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:40:58.210498+0000","last_peered":"2024-04-17T15:40:58.210498+0000","last_clean":"2024-04-17T15:40:58.210498+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:40:58.210498+0000","last_undegraded":"2024-04-17T15:40:58.210498+0000","last_fullsized":"2024-04-17T15:40:58.210498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544985+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:40:58.544985+0000","last_peered":"2024-04-17T15:40:58.544985+0000","last_clean":"2024-04-17T15:40:58.544985+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:40:58.544985+0000","last_undegraded":"2024-04-17T15:40:58.544985+0000","last_fullsized":"2024-04-17T15:40:58.544985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832646+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:40:58.832646+0000","last_peered":"2024-04-17T15:40:58.832646+0000","last_clean":"2024-04-17T15:40:58.832646+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:40:58.832646+0000","last_undegraded":"2024-04-17T15:40:58.832646+0000","last_fullsized":"2024-04-17T15:40:58.832646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206425+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:40:58.206425+0000","last_peered":"2024-04-17T15:40:58.206425+0000","last_clean":"2024-04-17T15:40:58.206425+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:40:58.206425+0000","last_undegraded":"2024-04-17T15:40:58.206425+0000","last_fullsized":"2024-04-17T15:40:58.206425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'15","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513874+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:40:58.513874+0000","last_peered":"2024-04-17T15:40:58.513874+0000","last_clean":"2024-04-17T15:40:58.513874+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:40:58.513874+0000","last_undegraded":"2024-04-17T15:40:58.513874+0000","last_fullsized":"2024-04-17T15:40:58.513874+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511961+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:40:58.511961+0000","last_peered":"2024-04-17T15:40:58.511961+0000","last_clean":"2024-04-17T15:40:58.511961+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:40:58.511961+0000","last_undegraded":"2024-04-17T15:40:58.511961+0000","last_fullsized":"2024-04-17T15:40:58.511961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'19","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553294+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:40:58.553294+0000","last_peered":"2024-04-17T15:40:58.553294+0000","last_clean":"2024-04-17T15:40:58.553294+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:40:58.553294+0000","last_undegraded":"2024-04-17T15:40:58.553294+0000","last_fullsized":"2024-04-17T15:40:58.553294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206650+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:40:58.206650+0000","last_peered":"2024-04-17T15:40:58.206650+0000","last_clean":"2024-04-17T15:40:58.206650+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:40:58.206650+0000","last_undegraded":"2024-04-17T15:40:58.206650+0000","last_fullsized":"2024-04-17T15:40:58.206650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553053+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:40:58.553053+0000","last_peered":"2024-04-17T15:40:58.553053+0000","last_clean":"2024-04-17T15:40:58.553053+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:40:58.553053+0000","last_undegraded":"2024-04-17T15:40:58.553053+0000","last_fullsized":"2024-04-17T15:40:58.553053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831158+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:40:58.831158+0000","last_peered":"2024-04-17T15:40:58.831158+0000","last_clean":"2024-04-17T15:40:58.831158+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:40:58.831158+0000","last_undegraded":"2024-04-17T15:40:58.831158+0000","last_fullsized":"2024-04-17T15:40:58.831158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207591+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:40:58.207591+0000","last_peered":"2024-04-17T15:40:58.207591+0000","last_clean":"2024-04-17T15:40:58.207591+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:40:58.207591+0000","last_undegraded":"2024-04-17T15:40:58.207591+0000","last_fullsized":"2024-04-17T15:40:58.207591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"111'20","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545679+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:40:58.545679+0000","last_peered":"2024-04-17T15:40:58.545679+0000","last_clean":"2024-04-17T15:40:58.545679+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:40:58.545679+0000","last_undegraded":"2024-04-17T15:40:58.545679+0000","last_fullsized":"2024-04-17T15:40:58.545679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208742+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:40:58.208742+0000","last_peered":"2024-04-17T15:40:58.208742+0000","last_clean":"2024-04-17T15:40:58.208742+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:40:58.208742+0000","last_undegraded":"2024-04-17T15:40:58.208742+0000","last_fullsized":"2024-04-17T15:40:58.208742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869682+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:40:58.869682+0000","last_peered":"2024-04-17T15:40:58.869682+0000","last_clean":"2024-04-17T15:40:58.869682+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:40:58.869682+0000","last_undegraded":"2024-04-17T15:40:58.869682+0000","last_fullsized":"2024-04-17T15:40:58.869682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206151+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:58.206151+0000","last_peered":"2024-04-17T15:40:58.206151+0000","last_clean":"2024-04-17T15:40:58.206151+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:58.206151+0000","last_undegraded":"2024-04-17T15:40:58.206151+0000","last_fullsized":"2024-04-17T15:40:58.206151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546278+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:40:58.546278+0000","last_peered":"2024-04-17T15:40:58.546278+0000","last_clean":"2024-04-17T15:40:58.546278+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:40:58.546278+0000","last_undegraded":"2024-04-17T15:40:58.546278+0000","last_fullsized":"2024-04-17T15:40:58.546278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'26","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512797+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:40:58.512797+0000","last_peered":"2024-04-17T15:40:58.512797+0000","last_clean":"2024-04-17T15:40:58.512797+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:40:58.512797+0000","last_undegraded":"2024-04-17T15:40:58.512797+0000","last_fullsized":"2024-04-17T15:40:58.512797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210023+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:40:58.210023+0000","last_peered":"2024-04-17T15:40:58.210023+0000","last_clean":"2024-04-17T15:40:58.210023+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:40:58.210023+0000","last_undegraded":"2024-04-17T15:40:58.210023+0000","last_fullsized":"2024-04-17T15:40:58.210023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"112'17","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869909+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:40:58.869909+0000","last_peered":"2024-04-17T15:40:58.869909+0000","last_clean":"2024-04-17T15:40:58.869909+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:40:58.869909+0000","last_undegraded":"2024-04-17T15:40:58.869909+0000","last_fullsized":"2024-04-17T15:40:58.869909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513403+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:58.513403+0000","last_peered":"2024-04-17T15:40:58.513403+0000","last_clean":"2024-04-17T15:40:58.513403+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:58.513403+0000","last_undegraded":"2024-04-17T15:40:58.513403+0000","last_fullsized":"2024-04-17T15:40:58.513403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"112'52","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205103+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:58.205103+0000","last_peered":"2024-04-17T15:40:58.205103+0000","last_clean":"2024-04-17T15:40:58.205103+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:58.205103+0000","last_undegraded":"2024-04-17T15:40:58.205103+0000","last_fullsized":"2024-04-17T15:40:58.205103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211084+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:40:58.211084+0000","last_peered":"2024-04-17T15:40:58.211084+0000","last_clean":"2024-04-17T15:40:58.211084+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:40:58.211084+0000","last_undegraded":"2024-04-17T15:40:58.211084+0000","last_fullsized":"2024-04-17T15:40:58.211084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'18","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869692+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:40:58.869692+0000","last_peered":"2024-04-17T15:40:58.869692+0000","last_clean":"2024-04-17T15:40:58.869692+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:40:58.869692+0000","last_undegraded":"2024-04-17T15:40:58.869692+0000","last_fullsized":"2024-04-17T15:40:58.869692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546176+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:58.546176+0000","last_peered":"2024-04-17T15:40:58.546176+0000","last_clean":"2024-04-17T15:40:58.546176+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:58.546176+0000","last_undegraded":"2024-04-17T15:40:58.546176+0000","last_fullsized":"2024-04-17T15:40:58.546176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212440+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:40:58.212440+0000","last_peered":"2024-04-17T15:40:58.212440+0000","last_clean":"2024-04-17T15:40:58.212440+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:40:58.212440+0000","last_undegraded":"2024-04-17T15:40:58.212440+0000","last_fullsized":"2024-04-17T15:40:58.212440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209905+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:58.209905+0000","last_peered":"2024-04-17T15:40:58.209905+0000","last_clean":"2024-04-17T15:40:58.209905+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:58.209905+0000","last_undegraded":"2024-04-17T15:40:58.209905+0000","last_fullsized":"2024-04-17T15:40:58.209905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869399+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:58.869399+0000","last_peered":"2024-04-17T15:40:58.869399+0000","last_clean":"2024-04-17T15:40:58.869399+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:58.869399+0000","last_undegraded":"2024-04-17T15:40:58.869399+0000","last_fullsized":"2024-04-17T15:40:58.869399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870379+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:40:58.870379+0000","last_peered":"2024-04-17T15:40:58.870379+0000","last_clean":"2024-04-17T15:40:58.870379+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:40:58.870379+0000","last_undegraded":"2024-04-17T15:40:58.870379+0000","last_fullsized":"2024-04-17T15:40:58.870379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'32","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512271+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:40:58.512271+0000","last_peered":"2024-04-17T15:40:58.512271+0000","last_clean":"2024-04-17T15:40:58.512271+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:40:58.512271+0000","last_undegraded":"2024-04-17T15:40:58.512271+0000","last_fullsized":"2024-04-17T15:40:58.512271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544211+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:40:58.544211+0000","last_peered":"2024-04-17T15:40:58.544211+0000","last_clean":"2024-04-17T15:40:58.544211+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:40:58.544211+0000","last_undegraded":"2024-04-17T15:40:58.544211+0000","last_fullsized":"2024-04-17T15:40:58.544211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"73'11","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"112'134","reported_seq":396,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513122+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:40:58.513122+0000","last_peered":"2024-04-17T15:40:58.513122+0000","last_clean":"2024-04-17T15:40:58.513122+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:40:58.513122+0000","last_undegraded":"2024-04-17T15:40:58.513122+0000","last_fullsized":"2024-04-17T15:40:58.513122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207086+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:58.207086+0000","last_peered":"2024-04-17T15:40:58.207086+0000","last_clean":"2024-04-17T15:40:58.207086+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:58.207086+0000","last_undegraded":"2024-04-17T15:40:58.207086+0000","last_fullsized":"2024-04-17T15:40:58.207086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546763+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:40:58.546763+0000","last_peered":"2024-04-17T15:40:58.546763+0000","last_clean":"2024-04-17T15:40:58.546763+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:40:58.546763+0000","last_undegraded":"2024-04-17T15:40:58.546763+0000","last_fullsized":"2024-04-17T15:40:58.546763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'33","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550912+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:40:58.550912+0000","last_peered":"2024-04-17T15:40:58.550912+0000","last_clean":"2024-04-17T15:40:58.550912+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:40:58.550912+0000","last_undegraded":"2024-04-17T15:40:58.550912+0000","last_fullsized":"2024-04-17T15:40:58.550912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210404+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:40:58.210404+0000","last_peered":"2024-04-17T15:40:58.210404+0000","last_clean":"2024-04-17T15:40:58.210404+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:40:58.210404+0000","last_undegraded":"2024-04-17T15:40:58.210404+0000","last_fullsized":"2024-04-17T15:40:58.210404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"112'17","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513209+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:40:58.513209+0000","last_peered":"2024-04-17T15:40:58.513209+0000","last_clean":"2024-04-17T15:40:58.513209+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:40:58.513209+0000","last_undegraded":"2024-04-17T15:40:58.513209+0000","last_fullsized":"2024-04-17T15:40:58.513209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"112'134","reported_seq":476,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546008+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:40:58.546008+0000","last_peered":"2024-04-17T15:40:58.546008+0000","last_clean":"2024-04-17T15:40:58.546008+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:40:58.546008+0000","last_undegraded":"2024-04-17T15:40:58.546008+0000","last_fullsized":"2024-04-17T15:40:58.546008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205567+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:40:58.205567+0000","last_peered":"2024-04-17T15:40:58.205567+0000","last_clean":"2024-04-17T15:40:58.205567+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:40:58.205567+0000","last_undegraded":"2024-04-17T15:40:58.205567+0000","last_fullsized":"2024-04-17T15:40:58.205567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513868+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:40:58.513868+0000","last_peered":"2024-04-17T15:40:58.513868+0000","last_clean":"2024-04-17T15:40:58.513868+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:40:58.513868+0000","last_undegraded":"2024-04-17T15:40:58.513868+0000","last_fullsized":"2024-04-17T15:40:58.513868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511485+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:40:58.511485+0000","last_peered":"2024-04-17T15:40:58.511485+0000","last_clean":"2024-04-17T15:40:58.511485+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:40:58.511485+0000","last_undegraded":"2024-04-17T15:40:58.511485+0000","last_fullsized":"2024-04-17T15:40:58.511485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"112'27","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205385+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:40:58.205385+0000","last_peered":"2024-04-17T15:40:58.205385+0000","last_clean":"2024-04-17T15:40:58.205385+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:40:58.205385+0000","last_undegraded":"2024-04-17T15:40:58.205385+0000","last_fullsized":"2024-04-17T15:40:58.205385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206195+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:40:58.206195+0000","last_peered":"2024-04-17T15:40:58.206195+0000","last_clean":"2024-04-17T15:40:58.206195+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:40:58.206195+0000","last_undegraded":"2024-04-17T15:40:58.206195+0000","last_fullsized":"2024-04-17T15:40:58.206195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206198+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:40:58.206198+0000","last_peered":"2024-04-17T15:40:58.206198+0000","last_clean":"2024-04-17T15:40:58.206198+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:40:58.206198+0000","last_undegraded":"2024-04-17T15:40:58.206198+0000","last_fullsized":"2024-04-17T15:40:58.206198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207810+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:40:58.207810+0000","last_peered":"2024-04-17T15:40:58.207810+0000","last_clean":"2024-04-17T15:40:58.207810+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:40:58.207810+0000","last_undegraded":"2024-04-17T15:40:58.207810+0000","last_fullsized":"2024-04-17T15:40:58.207810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'11","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513901+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:40:58.513901+0000","last_peered":"2024-04-17T15:40:58.513901+0000","last_clean":"2024-04-17T15:40:58.513901+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:40:58.513901+0000","last_undegraded":"2024-04-17T15:40:58.513901+0000","last_fullsized":"2024-04-17T15:40:58.513901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830647+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:40:58.830647+0000","last_peered":"2024-04-17T15:40:58.830647+0000","last_clean":"2024-04-17T15:40:58.830647+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:40:58.830647+0000","last_undegraded":"2024-04-17T15:40:58.830647+0000","last_fullsized":"2024-04-17T15:40:58.830647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"112'18","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546024+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:40:58.546024+0000","last_peered":"2024-04-17T15:40:58.546024+0000","last_clean":"2024-04-17T15:40:58.546024+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:40:58.546024+0000","last_undegraded":"2024-04-17T15:40:58.546024+0000","last_fullsized":"2024-04-17T15:40:58.546024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544949+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:40:58.544949+0000","last_peered":"2024-04-17T15:40:58.544949+0000","last_clean":"2024-04-17T15:40:58.544949+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:40:58.544949+0000","last_undegraded":"2024-04-17T15:40:58.544949+0000","last_fullsized":"2024-04-17T15:40:58.544949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553003+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:40:58.553003+0000","last_peered":"2024-04-17T15:40:58.553003+0000","last_clean":"2024-04-17T15:40:58.553003+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:40:58.553003+0000","last_undegraded":"2024-04-17T15:40:58.553003+0000","last_fullsized":"2024-04-17T15:40:58.553003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551609+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:40:58.551609+0000","last_peered":"2024-04-17T15:40:58.551609+0000","last_clean":"2024-04-17T15:40:58.551609+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:40:58.551609+0000","last_undegraded":"2024-04-17T15:40:58.551609+0000","last_fullsized":"2024-04-17T15:40:58.551609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'20","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513891+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:40:58.513891+0000","last_peered":"2024-04-17T15:40:58.513891+0000","last_clean":"2024-04-17T15:40:58.513891+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:40:58.513891+0000","last_undegraded":"2024-04-17T15:40:58.513891+0000","last_fullsized":"2024-04-17T15:40:58.513891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831481+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:40:58.831481+0000","last_peered":"2024-04-17T15:40:58.831481+0000","last_clean":"2024-04-17T15:40:58.831481+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:40:58.831481+0000","last_undegraded":"2024-04-17T15:40:58.831481+0000","last_fullsized":"2024-04-17T15:40:58.831481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"112'25","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512245+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:40:58.512245+0000","last_peered":"2024-04-17T15:40:58.512245+0000","last_clean":"2024-04-17T15:40:58.512245+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:40:58.512245+0000","last_undegraded":"2024-04-17T15:40:58.512245+0000","last_fullsized":"2024-04-17T15:40:58.512245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62305,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"112'134","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868968+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:40:58.868968+0000","last_peered":"2024-04-17T15:40:58.868968+0000","last_clean":"2024-04-17T15:40:58.868968+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:40:58.868968+0000","last_undegraded":"2024-04-17T15:40:58.868968+0000","last_fullsized":"2024-04-17T15:40:58.868968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869978+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:40:58.869978+0000","last_peered":"2024-04-17T15:40:58.869978+0000","last_clean":"2024-04-17T15:40:58.869978+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:40:58.869978+0000","last_undegraded":"2024-04-17T15:40:58.869978+0000","last_fullsized":"2024-04-17T15:40:58.869978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870694+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:40:58.870694+0000","last_peered":"2024-04-17T15:40:58.870694+0000","last_clean":"2024-04-17T15:40:58.870694+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:40:58.870694+0000","last_undegraded":"2024-04-17T15:40:58.870694+0000","last_fullsized":"2024-04-17T15:40:58.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207153+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:40:58.207153+0000","last_peered":"2024-04-17T15:40:58.207153+0000","last_clean":"2024-04-17T15:40:58.207153+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:40:58.207153+0000","last_undegraded":"2024-04-17T15:40:58.207153+0000","last_fullsized":"2024-04-17T15:40:58.207153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830470+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:40:58.830470+0000","last_peered":"2024-04-17T15:40:58.830470+0000","last_clean":"2024-04-17T15:40:58.830470+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:40:58.830470+0000","last_undegraded":"2024-04-17T15:40:58.830470+0000","last_fullsized":"2024-04-17T15:40:58.830470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"112'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869252+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:40:58.869252+0000","last_peered":"2024-04-17T15:40:58.869252+0000","last_clean":"2024-04-17T15:40:58.869252+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:40:58.869252+0000","last_undegraded":"2024-04-17T15:40:58.869252+0000","last_fullsized":"2024-04-17T15:40:58.869252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830535+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:40:58.830535+0000","last_peered":"2024-04-17T15:40:58.830535+0000","last_clean":"2024-04-17T15:40:58.830535+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:40:58.830535+0000","last_undegraded":"2024-04-17T15:40:58.830535+0000","last_fullsized":"2024-04-17T15:40:58.830535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207046+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:40:58.207046+0000","last_peered":"2024-04-17T15:40:58.207046+0000","last_clean":"2024-04-17T15:40:58.207046+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:40:58.207046+0000","last_undegraded":"2024-04-17T15:40:58.207046+0000","last_fullsized":"2024-04-17T15:40:58.207046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208754+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:40:58.208754+0000","last_peered":"2024-04-17T15:40:58.208754+0000","last_clean":"2024-04-17T15:40:58.208754+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:40:58.208754+0000","last_undegraded":"2024-04-17T15:40:58.208754+0000","last_fullsized":"2024-04-17T15:40:58.208754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545192+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:40:58.545192+0000","last_peered":"2024-04-17T15:40:58.545192+0000","last_clean":"2024-04-17T15:40:58.545192+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:40:58.545192+0000","last_undegraded":"2024-04-17T15:40:58.545192+0000","last_fullsized":"2024-04-17T15:40:58.545192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"112'19","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209917+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:40:58.209917+0000","last_peered":"2024-04-17T15:40:58.209917+0000","last_clean":"2024-04-17T15:40:58.209917+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:40:58.209917+0000","last_undegraded":"2024-04-17T15:40:58.209917+0000","last_fullsized":"2024-04-17T15:40:58.209917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870126+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:40:58.870126+0000","last_peered":"2024-04-17T15:40:58.870126+0000","last_clean":"2024-04-17T15:40:58.870126+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:40:58.870126+0000","last_undegraded":"2024-04-17T15:40:58.870126+0000","last_fullsized":"2024-04-17T15:40:58.870126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544375+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:40:58.544375+0000","last_peered":"2024-04-17T15:40:58.544375+0000","last_clean":"2024-04-17T15:40:58.544375+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:40:58.544375+0000","last_undegraded":"2024-04-17T15:40:58.544375+0000","last_fullsized":"2024-04-17T15:40:58.544375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209073+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:40:58.209073+0000","last_peered":"2024-04-17T15:40:58.209073+0000","last_clean":"2024-04-17T15:40:58.209073+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:40:58.209073+0000","last_undegraded":"2024-04-17T15:40:58.209073+0000","last_fullsized":"2024-04-17T15:40:58.209073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551850+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:40:58.551850+0000","last_peered":"2024-04-17T15:40:58.551850+0000","last_clean":"2024-04-17T15:40:58.551850+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:40:58.551850+0000","last_undegraded":"2024-04-17T15:40:58.551850+0000","last_fullsized":"2024-04-17T15:40:58.551850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206959+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:40:58.206959+0000","last_peered":"2024-04-17T15:40:58.206959+0000","last_clean":"2024-04-17T15:40:58.206959+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:40:58.206959+0000","last_undegraded":"2024-04-17T15:40:58.206959+0000","last_fullsized":"2024-04-17T15:40:58.206959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"112'23","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832235+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:40:58.832235+0000","last_peered":"2024-04-17T15:40:58.832235+0000","last_clean":"2024-04-17T15:40:58.832235+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:40:58.832235+0000","last_undegraded":"2024-04-17T15:40:58.832235+0000","last_fullsized":"2024-04-17T15:40:58.832235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"112'134","reported_seq":442,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831725+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:40:58.831725+0000","last_peered":"2024-04-17T15:40:58.831725+0000","last_clean":"2024-04-17T15:40:58.831725+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:40:58.831725+0000","last_undegraded":"2024-04-17T15:40:58.831725+0000","last_fullsized":"2024-04-17T15:40:58.831725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205716+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:40:58.205716+0000","last_peered":"2024-04-17T15:40:58.205716+0000","last_clean":"2024-04-17T15:40:58.205716+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:40:58.205716+0000","last_undegraded":"2024-04-17T15:40:58.205716+0000","last_fullsized":"2024-04-17T15:40:58.205716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212582+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:40:58.212582+0000","last_peered":"2024-04-17T15:40:58.212582+0000","last_clean":"2024-04-17T15:40:58.212582+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:40:58.212582+0000","last_undegraded":"2024-04-17T15:40:58.212582+0000","last_fullsized":"2024-04-17T15:40:58.212582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208751+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:40:58.208751+0000","last_peered":"2024-04-17T15:40:58.208751+0000","last_clean":"2024-04-17T15:40:58.208751+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:40:58.208751+0000","last_undegraded":"2024-04-17T15:40:58.208751+0000","last_fullsized":"2024-04-17T15:40:58.208751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210704+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:40:58.210704+0000","last_peered":"2024-04-17T15:40:58.210704+0000","last_clean":"2024-04-17T15:40:58.210704+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:40:58.210704+0000","last_undegraded":"2024-04-17T15:40:58.210704+0000","last_fullsized":"2024-04-17T15:40:58.210704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545986+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:40:58.545986+0000","last_peered":"2024-04-17T15:40:58.545986+0000","last_clean":"2024-04-17T15:40:58.545986+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:40:58.545986+0000","last_undegraded":"2024-04-17T15:40:58.545986+0000","last_fullsized":"2024-04-17T15:40:58.545986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"112'134","reported_seq":449,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551979+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:40:58.551979+0000","last_peered":"2024-04-17T15:40:58.551979+0000","last_clean":"2024-04-17T15:40:58.551979+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:40:58.551979+0000","last_undegraded":"2024-04-17T15:40:58.551979+0000","last_fullsized":"2024-04-17T15:40:58.551979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208093+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:40:58.208093+0000","last_peered":"2024-04-17T15:40:58.208093+0000","last_clean":"2024-04-17T15:40:58.208093+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:40:58.208093+0000","last_undegraded":"2024-04-17T15:40:58.208093+0000","last_fullsized":"2024-04-17T15:40:58.208093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208922+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:40:58.208922+0000","last_peered":"2024-04-17T15:40:58.208922+0000","last_clean":"2024-04-17T15:40:58.208922+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:40:58.208922+0000","last_undegraded":"2024-04-17T15:40:58.208922+0000","last_fullsized":"2024-04-17T15:40:58.208922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545320+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:40:58.545320+0000","last_peered":"2024-04-17T15:40:58.545320+0000","last_clean":"2024-04-17T15:40:58.545320+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:40:58.545320+0000","last_undegraded":"2024-04-17T15:40:58.545320+0000","last_fullsized":"2024-04-17T15:40:58.545320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212265+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:40:58.212265+0000","last_peered":"2024-04-17T15:40:58.212265+0000","last_clean":"2024-04-17T15:40:58.212265+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:40:58.212265+0000","last_undegraded":"2024-04-17T15:40:58.212265+0000","last_fullsized":"2024-04-17T15:40:58.212265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"112'25","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209728+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:40:58.209728+0000","last_peered":"2024-04-17T15:40:58.209728+0000","last_clean":"2024-04-17T15:40:58.209728+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:40:58.209728+0000","last_undegraded":"2024-04-17T15:40:58.209728+0000","last_fullsized":"2024-04-17T15:40:58.209728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551513+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:40:58.551513+0000","last_peered":"2024-04-17T15:40:58.551513+0000","last_clean":"2024-04-17T15:40:58.551513+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:40:58.551513+0000","last_undegraded":"2024-04-17T15:40:58.551513+0000","last_fullsized":"2024-04-17T15:40:58.551513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206128+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:40:58.206128+0000","last_peered":"2024-04-17T15:40:58.206128+0000","last_clean":"2024-04-17T15:40:58.206128+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:40:58.206128+0000","last_undegraded":"2024-04-17T15:40:58.206128+0000","last_fullsized":"2024-04-17T15:40:58.206128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552553+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:40:58.552553+0000","last_peered":"2024-04-17T15:40:58.552553+0000","last_clean":"2024-04-17T15:40:58.552553+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:40:58.552553+0000","last_undegraded":"2024-04-17T15:40:58.552553+0000","last_fullsized":"2024-04-17T15:40:58.552553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":387,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512174+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:58.512174+0000","last_peered":"2024-04-17T15:40:58.512174+0000","last_clean":"2024-04-17T15:40:58.512174+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:58.512174+0000","last_undegraded":"2024-04-17T15:40:58.512174+0000","last_fullsized":"2024-04-17T15:40:58.512174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206221+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:40:58.206221+0000","last_peered":"2024-04-17T15:40:58.206221+0000","last_clean":"2024-04-17T15:40:58.206221+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:40:58.206221+0000","last_undegraded":"2024-04-17T15:40:58.206221+0000","last_fullsized":"2024-04-17T15:40:58.206221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"112'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545240+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:40:58.545240+0000","last_peered":"2024-04-17T15:40:58.545240+0000","last_clean":"2024-04-17T15:40:58.545240+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:40:58.545240+0000","last_undegraded":"2024-04-17T15:40:58.545240+0000","last_fullsized":"2024-04-17T15:40:58.545240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512461+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:40:58.512461+0000","last_peered":"2024-04-17T15:40:58.512461+0000","last_clean":"2024-04-17T15:40:58.512461+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:40:58.512461+0000","last_undegraded":"2024-04-17T15:40:58.512461+0000","last_fullsized":"2024-04-17T15:40:58.512461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"112'37","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210978+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:40:58.210978+0000","last_peered":"2024-04-17T15:40:58.210978+0000","last_clean":"2024-04-17T15:40:58.210978+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:40:58.210978+0000","last_undegraded":"2024-04-17T15:40:58.210978+0000","last_fullsized":"2024-04-17T15:40:58.210978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870042+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:40:58.870042+0000","last_peered":"2024-04-17T15:40:58.870042+0000","last_clean":"2024-04-17T15:40:58.870042+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:40:58.870042+0000","last_undegraded":"2024-04-17T15:40:58.870042+0000","last_fullsized":"2024-04-17T15:40:58.870042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550525+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:40:58.550525+0000","last_peered":"2024-04-17T15:40:58.550525+0000","last_clean":"2024-04-17T15:40:58.550525+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:40:58.550525+0000","last_undegraded":"2024-04-17T15:40:58.550525+0000","last_fullsized":"2024-04-17T15:40:58.550525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870224+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:40:58.870224+0000","last_peered":"2024-04-17T15:40:58.870224+0000","last_clean":"2024-04-17T15:40:58.870224+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:40:58.870224+0000","last_undegraded":"2024-04-17T15:40:58.870224+0000","last_fullsized":"2024-04-17T15:40:58.870224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511901+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:58.511901+0000","last_peered":"2024-04-17T15:40:58.511901+0000","last_clean":"2024-04-17T15:40:58.511901+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:58.511901+0000","last_undegraded":"2024-04-17T15:40:58.511901+0000","last_fullsized":"2024-04-17T15:40:58.511901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869298+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:40:58.869298+0000","last_peered":"2024-04-17T15:40:58.869298+0000","last_clean":"2024-04-17T15:40:58.869298+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:40:58.869298+0000","last_undegraded":"2024-04-17T15:40:58.869298+0000","last_fullsized":"2024-04-17T15:40:58.869298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211844+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:40:58.211844+0000","last_peered":"2024-04-17T15:40:58.211844+0000","last_clean":"2024-04-17T15:40:58.211844+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:40:58.211844+0000","last_undegraded":"2024-04-17T15:40:58.211844+0000","last_fullsized":"2024-04-17T15:40:58.211844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"112'137","reported_seq":468,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206768+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:40:58.206768+0000","last_peered":"2024-04-17T15:40:58.206768+0000","last_clean":"2024-04-17T15:40:58.206768+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:40:58.206768+0000","last_undegraded":"2024-04-17T15:40:58.206768+0000","last_fullsized":"2024-04-17T15:40:58.206768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513073+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:40:58.513073+0000","last_peered":"2024-04-17T15:40:58.513073+0000","last_clean":"2024-04-17T15:40:58.513073+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:40:58.513073+0000","last_undegraded":"2024-04-17T15:40:58.513073+0000","last_fullsized":"2024-04-17T15:40:58.513073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205369+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:40:58.205369+0000","last_peered":"2024-04-17T15:40:58.205369+0000","last_clean":"2024-04-17T15:40:58.205369+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:40:58.205369+0000","last_undegraded":"2024-04-17T15:40:58.205369+0000","last_fullsized":"2024-04-17T15:40:58.205369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208927+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:40:58.208927+0000","last_peered":"2024-04-17T15:40:58.208927+0000","last_clean":"2024-04-17T15:40:58.208927+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:40:58.208927+0000","last_undegraded":"2024-04-17T15:40:58.208927+0000","last_fullsized":"2024-04-17T15:40:58.208927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831329+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:40:58.831329+0000","last_peered":"2024-04-17T15:40:58.831329+0000","last_clean":"2024-04-17T15:40:58.831329+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:40:58.831329+0000","last_undegraded":"2024-04-17T15:40:58.831329+0000","last_fullsized":"2024-04-17T15:40:58.831329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205552+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:40:58.205552+0000","last_peered":"2024-04-17T15:40:58.205552+0000","last_clean":"2024-04-17T15:40:58.205552+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:40:58.205552+0000","last_undegraded":"2024-04-17T15:40:58.205552+0000","last_fullsized":"2024-04-17T15:40:58.205552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830548+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:40:58.830548+0000","last_peered":"2024-04-17T15:40:58.830548+0000","last_clean":"2024-04-17T15:40:58.830548+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:40:58.830548+0000","last_undegraded":"2024-04-17T15:40:58.830548+0000","last_fullsized":"2024-04-17T15:40:58.830548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"71'16","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513547+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:40:58.513547+0000","last_peered":"2024-04-17T15:40:58.513547+0000","last_clean":"2024-04-17T15:40:58.513547+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:40:58.513547+0000","last_undegraded":"2024-04-17T15:40:58.513547+0000","last_fullsized":"2024-04-17T15:40:58.513547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869471+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:40:58.869471+0000","last_peered":"2024-04-17T15:40:58.869471+0000","last_clean":"2024-04-17T15:40:58.869471+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:40:58.869471+0000","last_undegraded":"2024-04-17T15:40:58.869471+0000","last_fullsized":"2024-04-17T15:40:58.869471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545821+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:40:58.545821+0000","last_peered":"2024-04-17T15:40:58.545821+0000","last_clean":"2024-04-17T15:40:58.545821+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:40:58.545821+0000","last_undegraded":"2024-04-17T15:40:58.545821+0000","last_fullsized":"2024-04-17T15:40:58.545821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207410+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:40:58.207410+0000","last_peered":"2024-04-17T15:40:58.207410+0000","last_clean":"2024-04-17T15:40:58.207410+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:40:58.207410+0000","last_undegraded":"2024-04-17T15:40:58.207410+0000","last_fullsized":"2024-04-17T15:40:58.207410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207531+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:58.207531+0000","last_peered":"2024-04-17T15:40:58.207531+0000","last_clean":"2024-04-17T15:40:58.207531+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:58.207531+0000","last_undegraded":"2024-04-17T15:40:58.207531+0000","last_fullsized":"2024-04-17T15:40:58.207531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208780+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:40:58.208780+0000","last_peered":"2024-04-17T15:40:58.208780+0000","last_clean":"2024-04-17T15:40:58.208780+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:40:58.208780+0000","last_undegraded":"2024-04-17T15:40:58.208780+0000","last_fullsized":"2024-04-17T15:40:58.208780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868736+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:40:58.868736+0000","last_peered":"2024-04-17T15:40:58.868736+0000","last_clean":"2024-04-17T15:40:58.868736+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:40:58.868736+0000","last_undegraded":"2024-04-17T15:40:58.868736+0000","last_fullsized":"2024-04-17T15:40:58.868736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547104+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:40:58.547104+0000","last_peered":"2024-04-17T15:40:58.547104+0000","last_clean":"2024-04-17T15:40:58.547104+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:40:58.547104+0000","last_undegraded":"2024-04-17T15:40:58.547104+0000","last_fullsized":"2024-04-17T15:40:58.547104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553452+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:40:58.553452+0000","last_peered":"2024-04-17T15:40:58.553452+0000","last_clean":"2024-04-17T15:40:58.553452+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:40:58.553452+0000","last_undegraded":"2024-04-17T15:40:58.553452+0000","last_fullsized":"2024-04-17T15:40:58.553452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.204708+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:40:58.204708+0000","last_peered":"2024-04-17T15:40:58.204708+0000","last_clean":"2024-04-17T15:40:58.204708+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:40:58.204708+0000","last_undegraded":"2024-04-17T15:40:58.204708+0000","last_fullsized":"2024-04-17T15:40:58.204708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205907+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:40:58.205907+0000","last_peered":"2024-04-17T15:40:58.205907+0000","last_clean":"2024-04-17T15:40:58.205907+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:40:58.205907+0000","last_undegraded":"2024-04-17T15:40:58.205907+0000","last_fullsized":"2024-04-17T15:40:58.205907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211627+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:40:58.211627+0000","last_peered":"2024-04-17T15:40:58.211627+0000","last_clean":"2024-04-17T15:40:58.211627+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:40:58.211627+0000","last_undegraded":"2024-04-17T15:40:58.211627+0000","last_fullsized":"2024-04-17T15:40:58.211627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208313+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:40:58.208313+0000","last_peered":"2024-04-17T15:40:58.208313+0000","last_clean":"2024-04-17T15:40:58.208313+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:40:58.208313+0000","last_undegraded":"2024-04-17T15:40:58.208313+0000","last_fullsized":"2024-04-17T15:40:58.208313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870049+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:40:58.870049+0000","last_peered":"2024-04-17T15:40:58.870049+0000","last_clean":"2024-04-17T15:40:58.870049+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:40:58.870049+0000","last_undegraded":"2024-04-17T15:40:58.870049+0000","last_fullsized":"2024-04-17T15:40:58.870049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"112'34","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869261+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:40:58.869261+0000","last_peered":"2024-04-17T15:40:58.869261+0000","last_clean":"2024-04-17T15:40:58.869261+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:40:58.869261+0000","last_undegraded":"2024-04-17T15:40:58.869261+0000","last_fullsized":"2024-04-17T15:40:58.869261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207208+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:40:58.207208+0000","last_peered":"2024-04-17T15:40:58.207208+0000","last_clean":"2024-04-17T15:40:58.207208+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:40:58.207208+0000","last_undegraded":"2024-04-17T15:40:58.207208+0000","last_fullsized":"2024-04-17T15:40:58.207208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869786+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:40:58.869786+0000","last_peered":"2024-04-17T15:40:58.869786+0000","last_clean":"2024-04-17T15:40:58.869786+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:40:58.869786+0000","last_undegraded":"2024-04-17T15:40:58.869786+0000","last_fullsized":"2024-04-17T15:40:58.869786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870620+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:40:58.870620+0000","last_peered":"2024-04-17T15:40:58.870620+0000","last_clean":"2024-04-17T15:40:58.870620+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:40:58.870620+0000","last_undegraded":"2024-04-17T15:40:58.870620+0000","last_fullsized":"2024-04-17T15:40:58.870620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207704+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:40:58.207704+0000","last_peered":"2024-04-17T15:40:58.207704+0000","last_clean":"2024-04-17T15:40:58.207704+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:40:58.207704+0000","last_undegraded":"2024-04-17T15:40:58.207704+0000","last_fullsized":"2024-04-17T15:40:58.207704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514348+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:40:58.514348+0000","last_peered":"2024-04-17T15:40:58.514348+0000","last_clean":"2024-04-17T15:40:58.514348+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:40:58.514348+0000","last_undegraded":"2024-04-17T15:40:58.514348+0000","last_fullsized":"2024-04-17T15:40:58.514348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551315+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:40:58.551315+0000","last_peered":"2024-04-17T15:40:58.551315+0000","last_clean":"2024-04-17T15:40:58.551315+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:40:58.551315+0000","last_undegraded":"2024-04-17T15:40:58.551315+0000","last_fullsized":"2024-04-17T15:40:58.551315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205169+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:40:58.205169+0000","last_peered":"2024-04-17T15:40:58.205169+0000","last_clean":"2024-04-17T15:40:58.205169+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:40:58.205169+0000","last_undegraded":"2024-04-17T15:40:58.205169+0000","last_fullsized":"2024-04-17T15:40:58.205169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"112'134","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.516289+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:40:58.516289+0000","last_peered":"2024-04-17T15:40:58.516289+0000","last_clean":"2024-04-17T15:40:58.516289+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:40:58.516289+0000","last_undegraded":"2024-04-17T15:40:58.516289+0000","last_fullsized":"2024-04-17T15:40:58.516289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546955+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:40:58.546955+0000","last_peered":"2024-04-17T15:40:58.546955+0000","last_clean":"2024-04-17T15:40:58.546955+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:40:58.546955+0000","last_undegraded":"2024-04-17T15:40:58.546955+0000","last_fullsized":"2024-04-17T15:40:58.546955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544700+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:40:58.544700+0000","last_peered":"2024-04-17T15:40:58.544700+0000","last_clean":"2024-04-17T15:40:58.544700+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:40:58.544700+0000","last_undegraded":"2024-04-17T15:40:58.544700+0000","last_fullsized":"2024-04-17T15:40:58.544700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'20","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546637+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:40:58.546637+0000","last_peered":"2024-04-17T15:40:58.546637+0000","last_clean":"2024-04-17T15:40:58.546637+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:40:58.546637+0000","last_undegraded":"2024-04-17T15:40:58.546637+0000","last_fullsized":"2024-04-17T15:40:58.546637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207967+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:40:58.207967+0000","last_peered":"2024-04-17T15:40:58.207967+0000","last_clean":"2024-04-17T15:40:58.207967+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:40:58.207967+0000","last_undegraded":"2024-04-17T15:40:58.207967+0000","last_fullsized":"2024-04-17T15:40:58.207967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207721+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:40:58.207721+0000","last_peered":"2024-04-17T15:40:58.207721+0000","last_clean":"2024-04-17T15:40:58.207721+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:40:58.207721+0000","last_undegraded":"2024-04-17T15:40:58.207721+0000","last_fullsized":"2024-04-17T15:40:58.207721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208760+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:40:58.208760+0000","last_peered":"2024-04-17T15:40:58.208760+0000","last_clean":"2024-04-17T15:40:58.208760+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:40:58.208760+0000","last_undegraded":"2024-04-17T15:40:58.208760+0000","last_fullsized":"2024-04-17T15:40:58.208760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"112'134","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546363+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:40:58.546363+0000","last_peered":"2024-04-17T15:40:58.546363+0000","last_clean":"2024-04-17T15:40:58.546363+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:40:58.546363+0000","last_undegraded":"2024-04-17T15:40:58.546363+0000","last_fullsized":"2024-04-17T15:40:58.546363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869584+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:40:58.869584+0000","last_peered":"2024-04-17T15:40:58.869584+0000","last_clean":"2024-04-17T15:40:58.869584+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:40:58.869584+0000","last_undegraded":"2024-04-17T15:40:58.869584+0000","last_fullsized":"2024-04-17T15:40:58.869584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208025+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:40:58.208025+0000","last_peered":"2024-04-17T15:40:58.208025+0000","last_clean":"2024-04-17T15:40:58.208025+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:40:58.208025+0000","last_undegraded":"2024-04-17T15:40:58.208025+0000","last_fullsized":"2024-04-17T15:40:58.208025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870384+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:40:58.870384+0000","last_peered":"2024-04-17T15:40:58.870384+0000","last_clean":"2024-04-17T15:40:58.870384+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:40:58.870384+0000","last_undegraded":"2024-04-17T15:40:58.870384+0000","last_fullsized":"2024-04-17T15:40:58.870384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553838+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:40:58.553838+0000","last_peered":"2024-04-17T15:40:58.553838+0000","last_clean":"2024-04-17T15:40:58.553838+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:40:58.553838+0000","last_undegraded":"2024-04-17T15:40:58.553838+0000","last_fullsized":"2024-04-17T15:40:58.553838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544172+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:40:58.544172+0000","last_peered":"2024-04-17T15:40:58.544172+0000","last_clean":"2024-04-17T15:40:58.544172+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:40:58.544172+0000","last_undegraded":"2024-04-17T15:40:58.544172+0000","last_fullsized":"2024-04-17T15:40:58.544172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"112'46","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511814+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:40:58.511814+0000","last_peered":"2024-04-17T15:40:58.511814+0000","last_clean":"2024-04-17T15:40:58.511814+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:40:58.511814+0000","last_undegraded":"2024-04-17T15:40:58.511814+0000","last_fullsized":"2024-04-17T15:40:58.511814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":28,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545031+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:40:58.545031+0000","last_peered":"2024-04-17T15:40:58.545031+0000","last_clean":"2024-04-17T15:40:58.545031+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:40:58.545031+0000","last_undegraded":"2024-04-17T15:40:58.545031+0000","last_fullsized":"2024-04-17T15:40:58.545031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205831+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:40:58.205831+0000","last_peered":"2024-04-17T15:40:58.205831+0000","last_clean":"2024-04-17T15:40:58.205831+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:40:58.205831+0000","last_undegraded":"2024-04-17T15:40:58.205831+0000","last_fullsized":"2024-04-17T15:40:58.205831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869887+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:40:58.869887+0000","last_peered":"2024-04-17T15:40:58.869887+0000","last_clean":"2024-04-17T15:40:58.869887+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:40:58.869887+0000","last_undegraded":"2024-04-17T15:40:58.869887+0000","last_fullsized":"2024-04-17T15:40:58.869887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207678+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:40:58.207678+0000","last_peered":"2024-04-17T15:40:58.207678+0000","last_clean":"2024-04-17T15:40:58.207678+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:40:58.207678+0000","last_undegraded":"2024-04-17T15:40:58.207678+0000","last_fullsized":"2024-04-17T15:40:58.207678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'27","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207428+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:40:58.207428+0000","last_peered":"2024-04-17T15:40:58.207428+0000","last_clean":"2024-04-17T15:40:58.207428+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:40:58.207428+0000","last_undegraded":"2024-04-17T15:40:58.207428+0000","last_fullsized":"2024-04-17T15:40:58.207428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205988+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:40:58.205988+0000","last_peered":"2024-04-17T15:40:58.205988+0000","last_clean":"2024-04-17T15:40:58.205988+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:40:58.205988+0000","last_undegraded":"2024-04-17T15:40:58.205988+0000","last_fullsized":"2024-04-17T15:40:58.205988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"112'19","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544621+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:40:58.544621+0000","last_peered":"2024-04-17T15:40:58.544621+0000","last_clean":"2024-04-17T15:40:58.544621+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:40:58.544621+0000","last_undegraded":"2024-04-17T15:40:58.544621+0000","last_fullsized":"2024-04-17T15:40:58.544621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544482+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:40:58.544482+0000","last_peered":"2024-04-17T15:40:58.544482+0000","last_clean":"2024-04-17T15:40:58.544482+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:40:58.544482+0000","last_undegraded":"2024-04-17T15:40:58.544482+0000","last_fullsized":"2024-04-17T15:40:58.544482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546509+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:40:58.546509+0000","last_peered":"2024-04-17T15:40:58.546509+0000","last_clean":"2024-04-17T15:40:58.546509+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:40:58.546509+0000","last_undegraded":"2024-04-17T15:40:58.546509+0000","last_fullsized":"2024-04-17T15:40:58.546509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":195,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205059+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:58.205059+0000","last_peered":"2024-04-17T15:40:58.205059+0000","last_clean":"2024-04-17T15:40:58.205059+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:58.205059+0000","last_undegraded":"2024-04-17T15:40:58.205059+0000","last_fullsized":"2024-04-17T15:40:58.205059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513793+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:40:58.513793+0000","last_peered":"2024-04-17T15:40:58.513793+0000","last_clean":"2024-04-17T15:40:58.513793+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:40:58.513793+0000","last_undegraded":"2024-04-17T15:40:58.513793+0000","last_fullsized":"2024-04-17T15:40:58.513793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545728+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:40:58.545728+0000","last_peered":"2024-04-17T15:40:58.545728+0000","last_clean":"2024-04-17T15:40:58.545728+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:40:58.545728+0000","last_undegraded":"2024-04-17T15:40:58.545728+0000","last_fullsized":"2024-04-17T15:40:58.545728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'9","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869028+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:58.869028+0000","last_peered":"2024-04-17T15:40:58.869028+0000","last_clean":"2024-04-17T15:40:58.869028+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:58.869028+0000","last_undegraded":"2024-04-17T15:40:58.869028+0000","last_fullsized":"2024-04-17T15:40:58.869028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511688+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:58.511688+0000","last_peered":"2024-04-17T15:40:58.511688+0000","last_clean":"2024-04-17T15:40:58.511688+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:58.511688+0000","last_undegraded":"2024-04-17T15:40:58.511688+0000","last_fullsized":"2024-04-17T15:40:58.511688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870459+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:58.870459+0000","last_peered":"2024-04-17T15:40:58.870459+0000","last_clean":"2024-04-17T15:40:58.870459+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:58.870459+0000","last_undegraded":"2024-04-17T15:40:58.870459+0000","last_fullsized":"2024-04-17T15:40:58.870459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544795+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:40:58.544795+0000","last_peered":"2024-04-17T15:40:58.544795+0000","last_clean":"2024-04-17T15:40:58.544795+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:40:58.544795+0000","last_undegraded":"2024-04-17T15:40:58.544795+0000","last_fullsized":"2024-04-17T15:40:58.544795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'31","reported_seq":209,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831790+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:40:58.831790+0000","last_peered":"2024-04-17T15:40:58.831790+0000","last_clean":"2024-04-17T15:40:58.831790+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:40:58.831790+0000","last_undegraded":"2024-04-17T15:40:58.831790+0000","last_fullsized":"2024-04-17T15:40:58.831790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510907+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:40:58.510907+0000","last_peered":"2024-04-17T15:40:58.510907+0000","last_clean":"2024-04-17T15:40:58.510907+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:40:58.510907+0000","last_undegraded":"2024-04-17T15:40:58.510907+0000","last_fullsized":"2024-04-17T15:40:58.510907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"112'19","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545552+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:40:58.545552+0000","last_peered":"2024-04-17T15:40:58.545552+0000","last_clean":"2024-04-17T15:40:58.545552+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:40:58.545552+0000","last_undegraded":"2024-04-17T15:40:58.545552+0000","last_fullsized":"2024-04-17T15:40:58.545552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551183+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:40:58.551183+0000","last_peered":"2024-04-17T15:40:58.551183+0000","last_clean":"2024-04-17T15:40:58.551183+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:40:58.551183+0000","last_undegraded":"2024-04-17T15:40:58.551183+0000","last_fullsized":"2024-04-17T15:40:58.551183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205899+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:58.205899+0000","last_peered":"2024-04-17T15:40:58.205899+0000","last_clean":"2024-04-17T15:40:58.205899+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:58.205899+0000","last_undegraded":"2024-04-17T15:40:58.205899+0000","last_fullsized":"2024-04-17T15:40:58.205899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544812+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:40:58.544812+0000","last_peered":"2024-04-17T15:40:58.544812+0000","last_clean":"2024-04-17T15:40:58.544812+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:40:58.544812+0000","last_undegraded":"2024-04-17T15:40:58.544812+0000","last_fullsized":"2024-04-17T15:40:58.544812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870440+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:40:58.870440+0000","last_peered":"2024-04-17T15:40:58.870440+0000","last_clean":"2024-04-17T15:40:58.870440+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:40:58.870440+0000","last_undegraded":"2024-04-17T15:40:58.870440+0000","last_fullsized":"2024-04-17T15:40:58.870440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550102+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:40:58.550102+0000","last_peered":"2024-04-17T15:40:58.550102+0000","last_clean":"2024-04-17T15:40:58.550102+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:40:58.550102+0000","last_undegraded":"2024-04-17T15:40:58.550102+0000","last_fullsized":"2024-04-17T15:40:58.550102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"112'18","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511513+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:40:58.511513+0000","last_peered":"2024-04-17T15:40:58.511513+0000","last_clean":"2024-04-17T15:40:58.511513+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:40:58.511513+0000","last_undegraded":"2024-04-17T15:40:58.511513+0000","last_fullsized":"2024-04-17T15:40:58.511513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870490+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:40:58.870490+0000","last_peered":"2024-04-17T15:40:58.870490+0000","last_clean":"2024-04-17T15:40:58.870490+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:40:58.870490+0000","last_undegraded":"2024-04-17T15:40:58.870490+0000","last_fullsized":"2024-04-17T15:40:58.870490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553654+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:40:58.553654+0000","last_peered":"2024-04-17T15:40:58.553654+0000","last_clean":"2024-04-17T15:40:58.553654+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:40:58.553654+0000","last_undegraded":"2024-04-17T15:40:58.553654+0000","last_fullsized":"2024-04-17T15:40:58.553654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545267+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:40:58.545267+0000","last_peered":"2024-04-17T15:40:58.545267+0000","last_clean":"2024-04-17T15:40:58.545267+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:40:58.545267+0000","last_undegraded":"2024-04-17T15:40:58.545267+0000","last_fullsized":"2024-04-17T15:40:58.545267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870131+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:40:58.870131+0000","last_peered":"2024-04-17T15:40:58.870131+0000","last_clean":"2024-04-17T15:40:58.870131+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:40:58.870131+0000","last_undegraded":"2024-04-17T15:40:58.870131+0000","last_fullsized":"2024-04-17T15:40:58.870131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"112'28","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206882+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:40:58.206882+0000","last_peered":"2024-04-17T15:40:58.206882+0000","last_clean":"2024-04-17T15:40:58.206882+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:40:58.206882+0000","last_undegraded":"2024-04-17T15:40:58.206882+0000","last_fullsized":"2024-04-17T15:40:58.206882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206391+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:40:58.206391+0000","last_peered":"2024-04-17T15:40:58.206391+0000","last_clean":"2024-04-17T15:40:58.206391+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:40:58.206391+0000","last_undegraded":"2024-04-17T15:40:58.206391+0000","last_fullsized":"2024-04-17T15:40:58.206391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545154+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:58.545154+0000","last_peered":"2024-04-17T15:40:58.545154+0000","last_clean":"2024-04-17T15:40:58.545154+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:58.545154+0000","last_undegraded":"2024-04-17T15:40:58.545154+0000","last_fullsized":"2024-04-17T15:40:58.545154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870197+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:40:58.870197+0000","last_peered":"2024-04-17T15:40:58.870197+0000","last_clean":"2024-04-17T15:40:58.870197+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:40:58.870197+0000","last_undegraded":"2024-04-17T15:40:58.870197+0000","last_fullsized":"2024-04-17T15:40:58.870197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206746+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:40:58.206746+0000","last_peered":"2024-04-17T15:40:58.206746+0000","last_clean":"2024-04-17T15:40:58.206746+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:40:58.206746+0000","last_undegraded":"2024-04-17T15:40:58.206746+0000","last_fullsized":"2024-04-17T15:40:58.206746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550274+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:40:58.550274+0000","last_peered":"2024-04-17T15:40:58.550274+0000","last_clean":"2024-04-17T15:40:58.550274+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:40:58.550274+0000","last_undegraded":"2024-04-17T15:40:58.550274+0000","last_fullsized":"2024-04-17T15:40:58.550274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"112'23","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512168+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:40:58.512168+0000","last_peered":"2024-04-17T15:40:58.512168+0000","last_clean":"2024-04-17T15:40:58.512168+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:40:58.512168+0000","last_undegraded":"2024-04-17T15:40:58.512168+0000","last_fullsized":"2024-04-17T15:40:58.512168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207231+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:58.207231+0000","last_peered":"2024-04-17T15:40:58.207231+0000","last_clean":"2024-04-17T15:40:58.207231+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:58.207231+0000","last_undegraded":"2024-04-17T15:40:58.207231+0000","last_fullsized":"2024-04-17T15:40:58.207231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550842+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:58.550842+0000","last_peered":"2024-04-17T15:40:58.550842+0000","last_clean":"2024-04-17T15:40:58.550842+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:58.550842+0000","last_undegraded":"2024-04-17T15:40:58.550842+0000","last_fullsized":"2024-04-17T15:40:58.550842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546595+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:40:58.546595+0000","last_peered":"2024-04-17T15:40:58.546595+0000","last_clean":"2024-04-17T15:40:58.546595+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:40:58.546595+0000","last_undegraded":"2024-04-17T15:40:58.546595+0000","last_fullsized":"2024-04-17T15:40:58.546595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'28","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209461+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:40:58.209461+0000","last_peered":"2024-04-17T15:40:58.209461+0000","last_clean":"2024-04-17T15:40:58.209461+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:40:58.209461+0000","last_undegraded":"2024-04-17T15:40:58.209461+0000","last_fullsized":"2024-04-17T15:40:58.209461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209537+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:58.209537+0000","last_peered":"2024-04-17T15:40:58.209537+0000","last_clean":"2024-04-17T15:40:58.209537+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:58.209537+0000","last_undegraded":"2024-04-17T15:40:58.209537+0000","last_fullsized":"2024-04-17T15:40:58.209537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"112'21","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547094+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:40:58.547094+0000","last_peered":"2024-04-17T15:40:58.547094+0000","last_clean":"2024-04-17T15:40:58.547094+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:40:58.547094+0000","last_undegraded":"2024-04-17T15:40:58.547094+0000","last_fullsized":"2024-04-17T15:40:58.547094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206857+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:40:58.206857+0000","last_peered":"2024-04-17T15:40:58.206857+0000","last_clean":"2024-04-17T15:40:58.206857+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:40:58.206857+0000","last_undegraded":"2024-04-17T15:40:58.206857+0000","last_fullsized":"2024-04-17T15:40:58.206857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205399+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:58.205399+0000","last_peered":"2024-04-17T15:40:58.205399+0000","last_clean":"2024-04-17T15:40:58.205399+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:58.205399+0000","last_undegraded":"2024-04-17T15:40:58.205399+0000","last_fullsized":"2024-04-17T15:40:58.205399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832037+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:40:58.832037+0000","last_peered":"2024-04-17T15:40:58.832037+0000","last_clean":"2024-04-17T15:40:58.832037+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:40:58.832037+0000","last_undegraded":"2024-04-17T15:40:58.832037+0000","last_fullsized":"2024-04-17T15:40:58.832037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'27","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869598+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:40:58.869598+0000","last_peered":"2024-04-17T15:40:58.869598+0000","last_clean":"2024-04-17T15:40:58.869598+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:40:58.869598+0000","last_undegraded":"2024-04-17T15:40:58.869598+0000","last_fullsized":"2024-04-17T15:40:58.869598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207897+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:40:58.207897+0000","last_peered":"2024-04-17T15:40:58.207897+0000","last_clean":"2024-04-17T15:40:58.207897+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:40:58.207897+0000","last_undegraded":"2024-04-17T15:40:58.207897+0000","last_fullsized":"2024-04-17T15:40:58.207897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"98'12","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210312+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:40:58.210312+0000","last_peered":"2024-04-17T15:40:58.210312+0000","last_clean":"2024-04-17T15:40:58.210312+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:40:58.210312+0000","last_undegraded":"2024-04-17T15:40:58.210312+0000","last_fullsized":"2024-04-17T15:40:58.210312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"112'134","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553367+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:40:58.553367+0000","last_peered":"2024-04-17T15:40:58.553367+0000","last_clean":"2024-04-17T15:40:58.553367+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:40:58.553367+0000","last_undegraded":"2024-04-17T15:40:58.553367+0000","last_fullsized":"2024-04-17T15:40:58.553367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511119+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:58.511119+0000","last_peered":"2024-04-17T15:40:58.511119+0000","last_clean":"2024-04-17T15:40:58.511119+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:58.511119+0000","last_undegraded":"2024-04-17T15:40:58.511119+0000","last_fullsized":"2024-04-17T15:40:58.511119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207401+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:58.207401+0000","last_peered":"2024-04-17T15:40:58.207401+0000","last_clean":"2024-04-17T15:40:58.207401+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:58.207401+0000","last_undegraded":"2024-04-17T15:40:58.207401+0000","last_fullsized":"2024-04-17T15:40:58.207401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206878+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:40:58.206878+0000","last_peered":"2024-04-17T15:40:58.206878+0000","last_clean":"2024-04-17T15:40:58.206878+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:40:58.206878+0000","last_undegraded":"2024-04-17T15:40:58.206878+0000","last_fullsized":"2024-04-17T15:40:58.206878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510932+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:40:58.510932+0000","last_peered":"2024-04-17T15:40:58.510932+0000","last_clean":"2024-04-17T15:40:58.510932+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:40:58.510932+0000","last_undegraded":"2024-04-17T15:40:58.510932+0000","last_fullsized":"2024-04-17T15:40:58.510932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"112'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206404+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:40:58.206404+0000","last_peered":"2024-04-17T15:40:58.206404+0000","last_clean":"2024-04-17T15:40:58.206404+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:40:58.206404+0000","last_undegraded":"2024-04-17T15:40:58.206404+0000","last_fullsized":"2024-04-17T15:40:58.206404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868782+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:40:58.868782+0000","last_peered":"2024-04-17T15:40:58.868782+0000","last_clean":"2024-04-17T15:40:58.868782+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:40:58.868782+0000","last_undegraded":"2024-04-17T15:40:58.868782+0000","last_fullsized":"2024-04-17T15:40:58.868782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514028+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:58.514028+0000","last_peered":"2024-04-17T15:40:58.514028+0000","last_clean":"2024-04-17T15:40:58.514028+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:58.514028+0000","last_undegraded":"2024-04-17T15:40:58.514028+0000","last_fullsized":"2024-04-17T15:40:58.514028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208859+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:58.208859+0000","last_peered":"2024-04-17T15:40:58.208859+0000","last_clean":"2024-04-17T15:40:58.208859+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:58.208859+0000","last_undegraded":"2024-04-17T15:40:58.208859+0000","last_fullsized":"2024-04-17T15:40:58.208859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211358+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:40:58.211358+0000","last_peered":"2024-04-17T15:40:58.211358+0000","last_clean":"2024-04-17T15:40:58.211358+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:40:58.211358+0000","last_undegraded":"2024-04-17T15:40:58.211358+0000","last_fullsized":"2024-04-17T15:40:58.211358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205705+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:58.205705+0000","last_peered":"2024-04-17T15:40:58.205705+0000","last_clean":"2024-04-17T15:40:58.205705+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:58.205705+0000","last_undegraded":"2024-04-17T15:40:58.205705+0000","last_fullsized":"2024-04-17T15:40:58.205705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"112'18","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868852+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:40:58.868852+0000","last_peered":"2024-04-17T15:40:58.868852+0000","last_clean":"2024-04-17T15:40:58.868852+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:40:58.868852+0000","last_undegraded":"2024-04-17T15:40:58.868852+0000","last_fullsized":"2024-04-17T15:40:58.868852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550780+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:40:58.550780+0000","last_peered":"2024-04-17T15:40:58.550780+0000","last_clean":"2024-04-17T15:40:58.550780+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:40:58.550780+0000","last_undegraded":"2024-04-17T15:40:58.550780+0000","last_fullsized":"2024-04-17T15:40:58.550780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546804+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:58.546804+0000","last_peered":"2024-04-17T15:40:58.546804+0000","last_clean":"2024-04-17T15:40:58.546804+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:58.546804+0000","last_undegraded":"2024-04-17T15:40:58.546804+0000","last_fullsized":"2024-04-17T15:40:58.546804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544901+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:40:58.544901+0000","last_peered":"2024-04-17T15:40:58.544901+0000","last_clean":"2024-04-17T15:40:58.544901+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:40:58.544901+0000","last_undegraded":"2024-04-17T15:40:58.544901+0000","last_fullsized":"2024-04-17T15:40:58.544901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547319+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:40:58.547319+0000","last_peered":"2024-04-17T15:40:58.547319+0000","last_clean":"2024-04-17T15:40:58.547319+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:40:58.547319+0000","last_undegraded":"2024-04-17T15:40:58.547319+0000","last_fullsized":"2024-04-17T15:40:58.547319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205607+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:40:58.205607+0000","last_peered":"2024-04-17T15:40:58.205607+0000","last_clean":"2024-04-17T15:40:58.205607+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:40:58.205607+0000","last_undegraded":"2024-04-17T15:40:58.205607+0000","last_fullsized":"2024-04-17T15:40:58.205607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"112'13","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546215+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:40:58.546215+0000","last_peered":"2024-04-17T15:40:58.546215+0000","last_clean":"2024-04-17T15:40:58.546215+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:40:58.546215+0000","last_undegraded":"2024-04-17T15:40:58.546215+0000","last_fullsized":"2024-04-17T15:40:58.546215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207130+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:58.207130+0000","last_peered":"2024-04-17T15:40:58.207130+0000","last_clean":"2024-04-17T15:40:58.207130+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:58.207130+0000","last_undegraded":"2024-04-17T15:40:58.207130+0000","last_fullsized":"2024-04-17T15:40:58.207130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513344+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:58.513344+0000","last_peered":"2024-04-17T15:40:58.513344+0000","last_clean":"2024-04-17T15:40:58.513344+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:58.513344+0000","last_undegraded":"2024-04-17T15:40:58.513344+0000","last_fullsized":"2024-04-17T15:40:58.513344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206775+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:40:58.206775+0000","last_peered":"2024-04-17T15:40:58.206775+0000","last_clean":"2024-04-17T15:40:58.206775+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:40:58.206775+0000","last_undegraded":"2024-04-17T15:40:58.206775+0000","last_fullsized":"2024-04-17T15:40:58.206775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870374+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:40:58.870374+0000","last_peered":"2024-04-17T15:40:58.870374+0000","last_clean":"2024-04-17T15:40:58.870374+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:40:58.870374+0000","last_undegraded":"2024-04-17T15:40:58.870374+0000","last_fullsized":"2024-04-17T15:40:58.870374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205395+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:40:58.205395+0000","last_peered":"2024-04-17T15:40:58.205395+0000","last_clean":"2024-04-17T15:40:58.205395+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:40:58.205395+0000","last_undegraded":"2024-04-17T15:40:58.205395+0000","last_fullsized":"2024-04-17T15:40:58.205395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"112'18","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207629+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:40:58.207629+0000","last_peered":"2024-04-17T15:40:58.207629+0000","last_clean":"2024-04-17T15:40:58.207629+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:40:58.207629+0000","last_undegraded":"2024-04-17T15:40:58.207629+0000","last_fullsized":"2024-04-17T15:40:58.207629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869445+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:40:58.869445+0000","last_peered":"2024-04-17T15:40:58.869445+0000","last_clean":"2024-04-17T15:40:58.869445+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:40:58.869445+0000","last_undegraded":"2024-04-17T15:40:58.869445+0000","last_fullsized":"2024-04-17T15:40:58.869445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209600+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:58.209600+0000","last_peered":"2024-04-17T15:40:58.209600+0000","last_clean":"2024-04-17T15:40:58.209600+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:58.209600+0000","last_undegraded":"2024-04-17T15:40:58.209600+0000","last_fullsized":"2024-04-17T15:40:58.209600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208657+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:40:58.208657+0000","last_peered":"2024-04-17T15:40:58.208657+0000","last_clean":"2024-04-17T15:40:58.208657+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:40:58.208657+0000","last_undegraded":"2024-04-17T15:40:58.208657+0000","last_fullsized":"2024-04-17T15:40:58.208657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'28","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550688+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:40:58.550688+0000","last_peered":"2024-04-17T15:40:58.550688+0000","last_clean":"2024-04-17T15:40:58.550688+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:40:58.550688+0000","last_undegraded":"2024-04-17T15:40:58.550688+0000","last_fullsized":"2024-04-17T15:40:58.550688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207501+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:40:58.207501+0000","last_peered":"2024-04-17T15:40:58.207501+0000","last_clean":"2024-04-17T15:40:58.207501+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:40:58.207501+0000","last_undegraded":"2024-04-17T15:40:58.207501+0000","last_fullsized":"2024-04-17T15:40:58.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831064+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:40:58.831064+0000","last_peered":"2024-04-17T15:40:58.831064+0000","last_clean":"2024-04-17T15:40:58.831064+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:40:58.831064+0000","last_undegraded":"2024-04-17T15:40:58.831064+0000","last_fullsized":"2024-04-17T15:40:58.831064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210291+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:40:58.210291+0000","last_peered":"2024-04-17T15:40:58.210291+0000","last_clean":"2024-04-17T15:40:58.210291+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:40:58.210291+0000","last_undegraded":"2024-04-17T15:40:58.210291+0000","last_fullsized":"2024-04-17T15:40:58.210291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207176+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:40:58.207176+0000","last_peered":"2024-04-17T15:40:58.207176+0000","last_clean":"2024-04-17T15:40:58.207176+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:40:58.207176+0000","last_undegraded":"2024-04-17T15:40:58.207176+0000","last_fullsized":"2024-04-17T15:40:58.207176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207964+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:40:58.207964+0000","last_peered":"2024-04-17T15:40:58.207964+0000","last_clean":"2024-04-17T15:40:58.207964+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:40:58.207964+0000","last_undegraded":"2024-04-17T15:40:58.207964+0000","last_fullsized":"2024-04-17T15:40:58.207964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869898+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:40:58.869898+0000","last_peered":"2024-04-17T15:40:58.869898+0000","last_clean":"2024-04-17T15:40:58.869898+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:40:58.869898+0000","last_undegraded":"2024-04-17T15:40:58.869898+0000","last_fullsized":"2024-04-17T15:40:58.869898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545971+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:40:58.545971+0000","last_peered":"2024-04-17T15:40:58.545971+0000","last_clean":"2024-04-17T15:40:58.545971+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:40:58.545971+0000","last_undegraded":"2024-04-17T15:40:58.545971+0000","last_fullsized":"2024-04-17T15:40:58.545971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"111'25","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831752+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:40:58.831752+0000","last_peered":"2024-04-17T15:40:58.831752+0000","last_clean":"2024-04-17T15:40:58.831752+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:40:58.831752+0000","last_undegraded":"2024-04-17T15:40:58.831752+0000","last_fullsized":"2024-04-17T15:40:58.831752+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209353+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:40:58.209353+0000","last_peered":"2024-04-17T15:40:58.209353+0000","last_clean":"2024-04-17T15:40:58.209353+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:40:58.209353+0000","last_undegraded":"2024-04-17T15:40:58.209353+0000","last_fullsized":"2024-04-17T15:40:58.209353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'32","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208331+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:40:58.208331+0000","last_peered":"2024-04-17T15:40:58.208331+0000","last_clean":"2024-04-17T15:40:58.208331+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:40:58.208331+0000","last_undegraded":"2024-04-17T15:40:58.208331+0000","last_fullsized":"2024-04-17T15:40:58.208331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544712+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:40:58.544712+0000","last_peered":"2024-04-17T15:40:58.544712+0000","last_clean":"2024-04-17T15:40:58.544712+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:40:58.544712+0000","last_undegraded":"2024-04-17T15:40:58.544712+0000","last_fullsized":"2024-04-17T15:40:58.544712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553487+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:40:58.553487+0000","last_peered":"2024-04-17T15:40:58.553487+0000","last_clean":"2024-04-17T15:40:58.553487+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:40:58.553487+0000","last_undegraded":"2024-04-17T15:40:58.553487+0000","last_fullsized":"2024-04-17T15:40:58.553487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550512+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:40:58.550512+0000","last_peered":"2024-04-17T15:40:58.550512+0000","last_clean":"2024-04-17T15:40:58.550512+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:40:58.550512+0000","last_undegraded":"2024-04-17T15:40:58.550512+0000","last_fullsized":"2024-04-17T15:40:58.550512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546883+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:40:58.546883+0000","last_peered":"2024-04-17T15:40:58.546883+0000","last_clean":"2024-04-17T15:40:58.546883+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:40:58.546883+0000","last_undegraded":"2024-04-17T15:40:58.546883+0000","last_fullsized":"2024-04-17T15:40:58.546883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870300+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:40:58.870300+0000","last_peered":"2024-04-17T15:40:58.870300+0000","last_clean":"2024-04-17T15:40:58.870300+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:40:58.870300+0000","last_undegraded":"2024-04-17T15:40:58.870300+0000","last_fullsized":"2024-04-17T15:40:58.870300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205823+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:40:58.205823+0000","last_peered":"2024-04-17T15:40:58.205823+0000","last_clean":"2024-04-17T15:40:58.205823+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:40:58.205823+0000","last_undegraded":"2024-04-17T15:40:58.205823+0000","last_fullsized":"2024-04-17T15:40:58.205823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212281+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:40:58.212281+0000","last_peered":"2024-04-17T15:40:58.212281+0000","last_clean":"2024-04-17T15:40:58.212281+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:40:58.212281+0000","last_undegraded":"2024-04-17T15:40:58.212281+0000","last_fullsized":"2024-04-17T15:40:58.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544966+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:40:58.544966+0000","last_peered":"2024-04-17T15:40:58.544966+0000","last_clean":"2024-04-17T15:40:58.544966+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:40:58.544966+0000","last_undegraded":"2024-04-17T15:40:58.544966+0000","last_fullsized":"2024-04-17T15:40:58.544966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832094+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:40:58.832094+0000","last_peered":"2024-04-17T15:40:58.832094+0000","last_clean":"2024-04-17T15:40:58.832094+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:40:58.832094+0000","last_undegraded":"2024-04-17T15:40:58.832094+0000","last_fullsized":"2024-04-17T15:40:58.832094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'24","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206917+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:40:58.206917+0000","last_peered":"2024-04-17T15:40:58.206917+0000","last_clean":"2024-04-17T15:40:58.206917+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:40:58.206917+0000","last_undegraded":"2024-04-17T15:40:58.206917+0000","last_fullsized":"2024-04-17T15:40:58.206917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209083+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:40:58.209083+0000","last_peered":"2024-04-17T15:40:58.209083+0000","last_clean":"2024-04-17T15:40:58.209083+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:40:58.209083+0000","last_undegraded":"2024-04-17T15:40:58.209083+0000","last_fullsized":"2024-04-17T15:40:58.209083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870191+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:40:58.870191+0000","last_peered":"2024-04-17T15:40:58.870191+0000","last_clean":"2024-04-17T15:40:58.870191+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:40:58.870191+0000","last_undegraded":"2024-04-17T15:40:58.870191+0000","last_fullsized":"2024-04-17T15:40:58.870191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512328+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:40:58.512328+0000","last_peered":"2024-04-17T15:40:58.512328+0000","last_clean":"2024-04-17T15:40:58.512328+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:40:58.512328+0000","last_undegraded":"2024-04-17T15:40:58.512328+0000","last_fullsized":"2024-04-17T15:40:58.512328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552057+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:40:58.552057+0000","last_peered":"2024-04-17T15:40:58.552057+0000","last_clean":"2024-04-17T15:40:58.552057+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:40:58.552057+0000","last_undegraded":"2024-04-17T15:40:58.552057+0000","last_fullsized":"2024-04-17T15:40:58.552057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869267+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:40:58.869267+0000","last_peered":"2024-04-17T15:40:58.869267+0000","last_clean":"2024-04-17T15:40:58.869267+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:40:58.869267+0000","last_undegraded":"2024-04-17T15:40:58.869267+0000","last_fullsized":"2024-04-17T15:40:58.869267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'20","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514166+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:40:58.514166+0000","last_peered":"2024-04-17T15:40:58.514166+0000","last_clean":"2024-04-17T15:40:58.514166+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:40:58.514166+0000","last_undegraded":"2024-04-17T15:40:58.514166+0000","last_fullsized":"2024-04-17T15:40:58.514166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830799+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:40:58.830799+0000","last_peered":"2024-04-17T15:40:58.830799+0000","last_clean":"2024-04-17T15:40:58.830799+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:40:58.830799+0000","last_undegraded":"2024-04-17T15:40:58.830799+0000","last_fullsized":"2024-04-17T15:40:58.830799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"111'16","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832080+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:40:58.832080+0000","last_peered":"2024-04-17T15:40:58.832080+0000","last_clean":"2024-04-17T15:40:58.832080+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:40:58.832080+0000","last_undegraded":"2024-04-17T15:40:58.832080+0000","last_fullsized":"2024-04-17T15:40:58.832080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511460+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:40:58.511460+0000","last_peered":"2024-04-17T15:40:58.511460+0000","last_clean":"2024-04-17T15:40:58.511460+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:40:58.511460+0000","last_undegraded":"2024-04-17T15:40:58.511460+0000","last_fullsized":"2024-04-17T15:40:58.511460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'24","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"111'33","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205512+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:40:58.205512+0000","last_peered":"2024-04-17T15:40:58.205512+0000","last_clean":"2024-04-17T15:40:58.205512+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:40:58.205512+0000","last_undegraded":"2024-04-17T15:40:58.205512+0000","last_fullsized":"2024-04-17T15:40:58.205512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870275+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:40:58.870275+0000","last_peered":"2024-04-17T15:40:58.870275+0000","last_clean":"2024-04-17T15:40:58.870275+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:40:58.870275+0000","last_undegraded":"2024-04-17T15:40:58.870275+0000","last_fullsized":"2024-04-17T15:40:58.870275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'14","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206299+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:40:58.206299+0000","last_peered":"2024-04-17T15:40:58.206299+0000","last_clean":"2024-04-17T15:40:58.206299+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:40:58.206299+0000","last_undegraded":"2024-04-17T15:40:58.206299+0000","last_fullsized":"2024-04-17T15:40:58.206299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210809+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:40:58.210809+0000","last_peered":"2024-04-17T15:40:58.210809+0000","last_clean":"2024-04-17T15:40:58.210809+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:40:58.210809+0000","last_undegraded":"2024-04-17T15:40:58.210809+0000","last_fullsized":"2024-04-17T15:40:58.210809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1072,"ondisk_log_size":1072,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":374963,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":619,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":710066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1817384,"kb_used_data":1786196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92554456,"statfs":{"total":96636764160,"available":94775762944,"internally_reserved":0,"allocated":1829064704,"data_stored":1828373077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1179784,"kb_used_data":1148600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93192056,"statfs":{"total":96636764160,"available":95428665344,"internally_reserved":0,"allocated":1176166400,"data_stored":1175509012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716416,"kb_used_data":1681072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92655424,"statfs":{"total":96636764160,"available":94879154176,"internally_reserved":0,"allocated":1721417728,"data_stored":1720711657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898444,"kb_used_data":1867260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473396,"statfs":{"total":96636764160,"available":94692757504,"internally_reserved":0,"allocated":1912074240,"data_stored":1911433504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542199,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812528,"kb_used_data":1777188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92559312,"statfs":{"total":96636764160,"available":94780735488,"internally_reserved":0,"allocated":1819840512,"data_stored":1819161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079304,"kb_used_data":1048120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93292536,"statfs":{"total":96636764160,"available":95531556864,"internally_reserved":0,"allocated":1073274880,"data_stored":1072630977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1103972,"kb_used_data":1072788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93267868,"statfs":{"total":96636764160,"available":95506296832,"internally_reserved":0,"allocated":1098534912,"data_stored":1097857316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1968684,"kb_used_data":1937496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92403156,"statfs":{"total":96636764160,"available":94620831744,"internally_reserved":0,"allocated":1983995904,"data_stored":1983329157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1981808640,"data_stored":1981808640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1096810496,"data_stored":1096810496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1071644672,"data_stored":1071644672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1719664640,"data_stored":1719664640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1174405120,"data_stored":1174405120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1826619392,"data_stored":1826619392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":58539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":118666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":176172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:41:02.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:41:03.280 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:03.286 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:41:03.295 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-04-17T15:41:02.323848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300811955,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3304,"num_read_kb":2996,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3889,"ondisk_log_size":3889,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12576516,"kb_used_data":12318720,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":742398204,"statfs":{"total":773094113280,"available":760215760896,"internally_reserved":0,"allocated":12614369280,"data_stored":12609005810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":263835186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.142591"},"pg_stats":[{"pgid":"3.3f","version":"111'19","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513697+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:40:58.513697+0000","last_peered":"2024-04-17T15:40:58.513697+0000","last_clean":"2024-04-17T15:40:58.513697+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:40:58.513697+0000","last_undegraded":"2024-04-17T15:40:58.513697+0000","last_fullsized":"2024-04-17T15:40:58.513697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205015+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:40:58.205015+0000","last_peered":"2024-04-17T15:40:58.205015+0000","last_clean":"2024-04-17T15:40:58.205015+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:40:58.205015+0000","last_undegraded":"2024-04-17T15:40:58.205015+0000","last_fullsized":"2024-04-17T15:40:58.205015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"111'27","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207822+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:40:58.207822+0000","last_peered":"2024-04-17T15:40:58.207822+0000","last_clean":"2024-04-17T15:40:58.207822+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:40:58.207822+0000","last_undegraded":"2024-04-17T15:40:58.207822+0000","last_fullsized":"2024-04-17T15:40:58.207822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511785+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:40:58.511785+0000","last_peered":"2024-04-17T15:40:58.511785+0000","last_clean":"2024-04-17T15:40:58.511785+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:40:58.511785+0000","last_undegraded":"2024-04-17T15:40:58.511785+0000","last_fullsized":"2024-04-17T15:40:58.511785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870721+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:40:58.870721+0000","last_peered":"2024-04-17T15:40:58.870721+0000","last_clean":"2024-04-17T15:40:58.870721+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:40:58.870721+0000","last_undegraded":"2024-04-17T15:40:58.870721+0000","last_fullsized":"2024-04-17T15:40:58.870721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208399+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:40:58.208399+0000","last_peered":"2024-04-17T15:40:58.208399+0000","last_clean":"2024-04-17T15:40:58.208399+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:40:58.208399+0000","last_undegraded":"2024-04-17T15:40:58.208399+0000","last_fullsized":"2024-04-17T15:40:58.208399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'19","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206655+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:40:58.206655+0000","last_peered":"2024-04-17T15:40:58.206655+0000","last_clean":"2024-04-17T15:40:58.206655+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:40:58.206655+0000","last_undegraded":"2024-04-17T15:40:58.206655+0000","last_fullsized":"2024-04-17T15:40:58.206655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869758+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:40:58.869758+0000","last_peered":"2024-04-17T15:40:58.869758+0000","last_clean":"2024-04-17T15:40:58.869758+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:40:58.869758+0000","last_undegraded":"2024-04-17T15:40:58.869758+0000","last_fullsized":"2024-04-17T15:40:58.869758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'31","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512574+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:40:58.512574+0000","last_peered":"2024-04-17T15:40:58.512574+0000","last_clean":"2024-04-17T15:40:58.512574+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:40:58.512574+0000","last_undegraded":"2024-04-17T15:40:58.512574+0000","last_fullsized":"2024-04-17T15:40:58.512574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551803+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:40:58.551803+0000","last_peered":"2024-04-17T15:40:58.551803+0000","last_clean":"2024-04-17T15:40:58.551803+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:40:58.551803+0000","last_undegraded":"2024-04-17T15:40:58.551803+0000","last_fullsized":"2024-04-17T15:40:58.551803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'19","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206172+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:40:58.206172+0000","last_peered":"2024-04-17T15:40:58.206172+0000","last_clean":"2024-04-17T15:40:58.206172+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:40:58.206172+0000","last_undegraded":"2024-04-17T15:40:58.206172+0000","last_fullsized":"2024-04-17T15:40:58.206172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208445+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:40:58.208445+0000","last_peered":"2024-04-17T15:40:58.208445+0000","last_clean":"2024-04-17T15:40:58.208445+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:40:58.208445+0000","last_undegraded":"2024-04-17T15:40:58.208445+0000","last_fullsized":"2024-04-17T15:40:58.208445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512091+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:40:58.512091+0000","last_peered":"2024-04-17T15:40:58.512091+0000","last_clean":"2024-04-17T15:40:58.512091+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:40:58.512091+0000","last_undegraded":"2024-04-17T15:40:58.512091+0000","last_fullsized":"2024-04-17T15:40:58.512091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210498+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:40:58.210498+0000","last_peered":"2024-04-17T15:40:58.210498+0000","last_clean":"2024-04-17T15:40:58.210498+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:40:58.210498+0000","last_undegraded":"2024-04-17T15:40:58.210498+0000","last_fullsized":"2024-04-17T15:40:58.210498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544985+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:40:58.544985+0000","last_peered":"2024-04-17T15:40:58.544985+0000","last_clean":"2024-04-17T15:40:58.544985+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:40:58.544985+0000","last_undegraded":"2024-04-17T15:40:58.544985+0000","last_fullsized":"2024-04-17T15:40:58.544985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832646+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:40:58.832646+0000","last_peered":"2024-04-17T15:40:58.832646+0000","last_clean":"2024-04-17T15:40:58.832646+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:40:58.832646+0000","last_undegraded":"2024-04-17T15:40:58.832646+0000","last_fullsized":"2024-04-17T15:40:58.832646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206425+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:40:58.206425+0000","last_peered":"2024-04-17T15:40:58.206425+0000","last_clean":"2024-04-17T15:40:58.206425+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:40:58.206425+0000","last_undegraded":"2024-04-17T15:40:58.206425+0000","last_fullsized":"2024-04-17T15:40:58.206425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'15","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513874+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:40:58.513874+0000","last_peered":"2024-04-17T15:40:58.513874+0000","last_clean":"2024-04-17T15:40:58.513874+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:40:58.513874+0000","last_undegraded":"2024-04-17T15:40:58.513874+0000","last_fullsized":"2024-04-17T15:40:58.513874+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511961+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:40:58.511961+0000","last_peered":"2024-04-17T15:40:58.511961+0000","last_clean":"2024-04-17T15:40:58.511961+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:40:58.511961+0000","last_undegraded":"2024-04-17T15:40:58.511961+0000","last_fullsized":"2024-04-17T15:40:58.511961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'19","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553294+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:40:58.553294+0000","last_peered":"2024-04-17T15:40:58.553294+0000","last_clean":"2024-04-17T15:40:58.553294+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:40:58.553294+0000","last_undegraded":"2024-04-17T15:40:58.553294+0000","last_fullsized":"2024-04-17T15:40:58.553294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206650+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:40:58.206650+0000","last_peered":"2024-04-17T15:40:58.206650+0000","last_clean":"2024-04-17T15:40:58.206650+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:40:58.206650+0000","last_undegraded":"2024-04-17T15:40:58.206650+0000","last_fullsized":"2024-04-17T15:40:58.206650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553053+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:40:58.553053+0000","last_peered":"2024-04-17T15:40:58.553053+0000","last_clean":"2024-04-17T15:40:58.553053+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:40:58.553053+0000","last_undegraded":"2024-04-17T15:40:58.553053+0000","last_fullsized":"2024-04-17T15:40:58.553053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831158+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:40:58.831158+0000","last_peered":"2024-04-17T15:40:58.831158+0000","last_clean":"2024-04-17T15:40:58.831158+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:40:58.831158+0000","last_undegraded":"2024-04-17T15:40:58.831158+0000","last_fullsized":"2024-04-17T15:40:58.831158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207591+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:40:58.207591+0000","last_peered":"2024-04-17T15:40:58.207591+0000","last_clean":"2024-04-17T15:40:58.207591+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:40:58.207591+0000","last_undegraded":"2024-04-17T15:40:58.207591+0000","last_fullsized":"2024-04-17T15:40:58.207591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"111'20","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545679+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:40:58.545679+0000","last_peered":"2024-04-17T15:40:58.545679+0000","last_clean":"2024-04-17T15:40:58.545679+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:40:58.545679+0000","last_undegraded":"2024-04-17T15:40:58.545679+0000","last_fullsized":"2024-04-17T15:40:58.545679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208742+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:40:58.208742+0000","last_peered":"2024-04-17T15:40:58.208742+0000","last_clean":"2024-04-17T15:40:58.208742+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:40:58.208742+0000","last_undegraded":"2024-04-17T15:40:58.208742+0000","last_fullsized":"2024-04-17T15:40:58.208742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869682+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:40:58.869682+0000","last_peered":"2024-04-17T15:40:58.869682+0000","last_clean":"2024-04-17T15:40:58.869682+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:40:58.869682+0000","last_undegraded":"2024-04-17T15:40:58.869682+0000","last_fullsized":"2024-04-17T15:40:58.869682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206151+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:58.206151+0000","last_peered":"2024-04-17T15:40:58.206151+0000","last_clean":"2024-04-17T15:40:58.206151+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:58.206151+0000","last_undegraded":"2024-04-17T15:40:58.206151+0000","last_fullsized":"2024-04-17T15:40:58.206151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546278+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:40:58.546278+0000","last_peered":"2024-04-17T15:40:58.546278+0000","last_clean":"2024-04-17T15:40:58.546278+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:40:58.546278+0000","last_undegraded":"2024-04-17T15:40:58.546278+0000","last_fullsized":"2024-04-17T15:40:58.546278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'26","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512797+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:40:58.512797+0000","last_peered":"2024-04-17T15:40:58.512797+0000","last_clean":"2024-04-17T15:40:58.512797+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:40:58.512797+0000","last_undegraded":"2024-04-17T15:40:58.512797+0000","last_fullsized":"2024-04-17T15:40:58.512797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210023+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:40:58.210023+0000","last_peered":"2024-04-17T15:40:58.210023+0000","last_clean":"2024-04-17T15:40:58.210023+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:40:58.210023+0000","last_undegraded":"2024-04-17T15:40:58.210023+0000","last_fullsized":"2024-04-17T15:40:58.210023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"112'17","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869909+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:40:58.869909+0000","last_peered":"2024-04-17T15:40:58.869909+0000","last_clean":"2024-04-17T15:40:58.869909+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:40:58.869909+0000","last_undegraded":"2024-04-17T15:40:58.869909+0000","last_fullsized":"2024-04-17T15:40:58.869909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513403+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:58.513403+0000","last_peered":"2024-04-17T15:40:58.513403+0000","last_clean":"2024-04-17T15:40:58.513403+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:58.513403+0000","last_undegraded":"2024-04-17T15:40:58.513403+0000","last_fullsized":"2024-04-17T15:40:58.513403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"112'52","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205103+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:58.205103+0000","last_peered":"2024-04-17T15:40:58.205103+0000","last_clean":"2024-04-17T15:40:58.205103+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:58.205103+0000","last_undegraded":"2024-04-17T15:40:58.205103+0000","last_fullsized":"2024-04-17T15:40:58.205103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211084+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:40:58.211084+0000","last_peered":"2024-04-17T15:40:58.211084+0000","last_clean":"2024-04-17T15:40:58.211084+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:40:58.211084+0000","last_undegraded":"2024-04-17T15:40:58.211084+0000","last_fullsized":"2024-04-17T15:40:58.211084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'18","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869692+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:40:58.869692+0000","last_peered":"2024-04-17T15:40:58.869692+0000","last_clean":"2024-04-17T15:40:58.869692+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:40:58.869692+0000","last_undegraded":"2024-04-17T15:40:58.869692+0000","last_fullsized":"2024-04-17T15:40:58.869692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546176+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:58.546176+0000","last_peered":"2024-04-17T15:40:58.546176+0000","last_clean":"2024-04-17T15:40:58.546176+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:58.546176+0000","last_undegraded":"2024-04-17T15:40:58.546176+0000","last_fullsized":"2024-04-17T15:40:58.546176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212440+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:40:58.212440+0000","last_peered":"2024-04-17T15:40:58.212440+0000","last_clean":"2024-04-17T15:40:58.212440+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:40:58.212440+0000","last_undegraded":"2024-04-17T15:40:58.212440+0000","last_fullsized":"2024-04-17T15:40:58.212440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209905+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:58.209905+0000","last_peered":"2024-04-17T15:40:58.209905+0000","last_clean":"2024-04-17T15:40:58.209905+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:58.209905+0000","last_undegraded":"2024-04-17T15:40:58.209905+0000","last_fullsized":"2024-04-17T15:40:58.209905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869399+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:58.869399+0000","last_peered":"2024-04-17T15:40:58.869399+0000","last_clean":"2024-04-17T15:40:58.869399+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:58.869399+0000","last_undegraded":"2024-04-17T15:40:58.869399+0000","last_fullsized":"2024-04-17T15:40:58.869399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870379+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:40:58.870379+0000","last_peered":"2024-04-17T15:40:58.870379+0000","last_clean":"2024-04-17T15:40:58.870379+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:40:58.870379+0000","last_undegraded":"2024-04-17T15:40:58.870379+0000","last_fullsized":"2024-04-17T15:40:58.870379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'32","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512271+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:40:58.512271+0000","last_peered":"2024-04-17T15:40:58.512271+0000","last_clean":"2024-04-17T15:40:58.512271+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:40:58.512271+0000","last_undegraded":"2024-04-17T15:40:58.512271+0000","last_fullsized":"2024-04-17T15:40:58.512271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544211+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:40:58.544211+0000","last_peered":"2024-04-17T15:40:58.544211+0000","last_clean":"2024-04-17T15:40:58.544211+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:40:58.544211+0000","last_undegraded":"2024-04-17T15:40:58.544211+0000","last_fullsized":"2024-04-17T15:40:58.544211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"73'11","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"112'134","reported_seq":396,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513122+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:40:58.513122+0000","last_peered":"2024-04-17T15:40:58.513122+0000","last_clean":"2024-04-17T15:40:58.513122+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:40:58.513122+0000","last_undegraded":"2024-04-17T15:40:58.513122+0000","last_fullsized":"2024-04-17T15:40:58.513122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207086+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:58.207086+0000","last_peered":"2024-04-17T15:40:58.207086+0000","last_clean":"2024-04-17T15:40:58.207086+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:58.207086+0000","last_undegraded":"2024-04-17T15:40:58.207086+0000","last_fullsized":"2024-04-17T15:40:58.207086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546763+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:40:58.546763+0000","last_peered":"2024-04-17T15:40:58.546763+0000","last_clean":"2024-04-17T15:40:58.546763+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:40:58.546763+0000","last_undegraded":"2024-04-17T15:40:58.546763+0000","last_fullsized":"2024-04-17T15:40:58.546763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'33","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550912+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:40:58.550912+0000","last_peered":"2024-04-17T15:40:58.550912+0000","last_clean":"2024-04-17T15:40:58.550912+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:40:58.550912+0000","last_undegraded":"2024-04-17T15:40:58.550912+0000","last_fullsized":"2024-04-17T15:40:58.550912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210404+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:40:58.210404+0000","last_peered":"2024-04-17T15:40:58.210404+0000","last_clean":"2024-04-17T15:40:58.210404+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:40:58.210404+0000","last_undegraded":"2024-04-17T15:40:58.210404+0000","last_fullsized":"2024-04-17T15:40:58.210404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"112'17","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513209+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:40:58.513209+0000","last_peered":"2024-04-17T15:40:58.513209+0000","last_clean":"2024-04-17T15:40:58.513209+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:40:58.513209+0000","last_undegraded":"2024-04-17T15:40:58.513209+0000","last_fullsized":"2024-04-17T15:40:58.513209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"112'134","reported_seq":476,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546008+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:40:58.546008+0000","last_peered":"2024-04-17T15:40:58.546008+0000","last_clean":"2024-04-17T15:40:58.546008+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:40:58.546008+0000","last_undegraded":"2024-04-17T15:40:58.546008+0000","last_fullsized":"2024-04-17T15:40:58.546008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205567+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:40:58.205567+0000","last_peered":"2024-04-17T15:40:58.205567+0000","last_clean":"2024-04-17T15:40:58.205567+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:40:58.205567+0000","last_undegraded":"2024-04-17T15:40:58.205567+0000","last_fullsized":"2024-04-17T15:40:58.205567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513868+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:40:58.513868+0000","last_peered":"2024-04-17T15:40:58.513868+0000","last_clean":"2024-04-17T15:40:58.513868+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:40:58.513868+0000","last_undegraded":"2024-04-17T15:40:58.513868+0000","last_fullsized":"2024-04-17T15:40:58.513868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511485+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:40:58.511485+0000","last_peered":"2024-04-17T15:40:58.511485+0000","last_clean":"2024-04-17T15:40:58.511485+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:40:58.511485+0000","last_undegraded":"2024-04-17T15:40:58.511485+0000","last_fullsized":"2024-04-17T15:40:58.511485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"112'27","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205385+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:40:58.205385+0000","last_peered":"2024-04-17T15:40:58.205385+0000","last_clean":"2024-04-17T15:40:58.205385+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:40:58.205385+0000","last_undegraded":"2024-04-17T15:40:58.205385+0000","last_fullsized":"2024-04-17T15:40:58.205385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206195+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:40:58.206195+0000","last_peered":"2024-04-17T15:40:58.206195+0000","last_clean":"2024-04-17T15:40:58.206195+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:40:58.206195+0000","last_undegraded":"2024-04-17T15:40:58.206195+0000","last_fullsized":"2024-04-17T15:40:58.206195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206198+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:40:58.206198+0000","last_peered":"2024-04-17T15:40:58.206198+0000","last_clean":"2024-04-17T15:40:58.206198+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:40:58.206198+0000","last_undegraded":"2024-04-17T15:40:58.206198+0000","last_fullsized":"2024-04-17T15:40:58.206198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207810+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:40:58.207810+0000","last_peered":"2024-04-17T15:40:58.207810+0000","last_clean":"2024-04-17T15:40:58.207810+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:40:58.207810+0000","last_undegraded":"2024-04-17T15:40:58.207810+0000","last_fullsized":"2024-04-17T15:40:58.207810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'11","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513901+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:40:58.513901+0000","last_peered":"2024-04-17T15:40:58.513901+0000","last_clean":"2024-04-17T15:40:58.513901+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:40:58.513901+0000","last_undegraded":"2024-04-17T15:40:58.513901+0000","last_fullsized":"2024-04-17T15:40:58.513901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830647+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:40:58.830647+0000","last_peered":"2024-04-17T15:40:58.830647+0000","last_clean":"2024-04-17T15:40:58.830647+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:40:58.830647+0000","last_undegraded":"2024-04-17T15:40:58.830647+0000","last_fullsized":"2024-04-17T15:40:58.830647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"112'18","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546024+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:40:58.546024+0000","last_peered":"2024-04-17T15:40:58.546024+0000","last_clean":"2024-04-17T15:40:58.546024+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:40:58.546024+0000","last_undegraded":"2024-04-17T15:40:58.546024+0000","last_fullsized":"2024-04-17T15:40:58.546024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544949+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:40:58.544949+0000","last_peered":"2024-04-17T15:40:58.544949+0000","last_clean":"2024-04-17T15:40:58.544949+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:40:58.544949+0000","last_undegraded":"2024-04-17T15:40:58.544949+0000","last_fullsized":"2024-04-17T15:40:58.544949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553003+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:40:58.553003+0000","last_peered":"2024-04-17T15:40:58.553003+0000","last_clean":"2024-04-17T15:40:58.553003+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:40:58.553003+0000","last_undegraded":"2024-04-17T15:40:58.553003+0000","last_fullsized":"2024-04-17T15:40:58.553003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551609+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:40:58.551609+0000","last_peered":"2024-04-17T15:40:58.551609+0000","last_clean":"2024-04-17T15:40:58.551609+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:40:58.551609+0000","last_undegraded":"2024-04-17T15:40:58.551609+0000","last_fullsized":"2024-04-17T15:40:58.551609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'20","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513891+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:40:58.513891+0000","last_peered":"2024-04-17T15:40:58.513891+0000","last_clean":"2024-04-17T15:40:58.513891+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:40:58.513891+0000","last_undegraded":"2024-04-17T15:40:58.513891+0000","last_fullsized":"2024-04-17T15:40:58.513891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831481+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:40:58.831481+0000","last_peered":"2024-04-17T15:40:58.831481+0000","last_clean":"2024-04-17T15:40:58.831481+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:40:58.831481+0000","last_undegraded":"2024-04-17T15:40:58.831481+0000","last_fullsized":"2024-04-17T15:40:58.831481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"112'25","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512245+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:40:58.512245+0000","last_peered":"2024-04-17T15:40:58.512245+0000","last_clean":"2024-04-17T15:40:58.512245+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:40:58.512245+0000","last_undegraded":"2024-04-17T15:40:58.512245+0000","last_fullsized":"2024-04-17T15:40:58.512245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62305,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"112'134","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868968+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:40:58.868968+0000","last_peered":"2024-04-17T15:40:58.868968+0000","last_clean":"2024-04-17T15:40:58.868968+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:40:58.868968+0000","last_undegraded":"2024-04-17T15:40:58.868968+0000","last_fullsized":"2024-04-17T15:40:58.868968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869978+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:40:58.869978+0000","last_peered":"2024-04-17T15:40:58.869978+0000","last_clean":"2024-04-17T15:40:58.869978+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:40:58.869978+0000","last_undegraded":"2024-04-17T15:40:58.869978+0000","last_fullsized":"2024-04-17T15:40:58.869978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870694+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:40:58.870694+0000","last_peered":"2024-04-17T15:40:58.870694+0000","last_clean":"2024-04-17T15:40:58.870694+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:40:58.870694+0000","last_undegraded":"2024-04-17T15:40:58.870694+0000","last_fullsized":"2024-04-17T15:40:58.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207153+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:40:58.207153+0000","last_peered":"2024-04-17T15:40:58.207153+0000","last_clean":"2024-04-17T15:40:58.207153+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:40:58.207153+0000","last_undegraded":"2024-04-17T15:40:58.207153+0000","last_fullsized":"2024-04-17T15:40:58.207153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830470+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:40:58.830470+0000","last_peered":"2024-04-17T15:40:58.830470+0000","last_clean":"2024-04-17T15:40:58.830470+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:40:58.830470+0000","last_undegraded":"2024-04-17T15:40:58.830470+0000","last_fullsized":"2024-04-17T15:40:58.830470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"112'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869252+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:40:58.869252+0000","last_peered":"2024-04-17T15:40:58.869252+0000","last_clean":"2024-04-17T15:40:58.869252+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:40:58.869252+0000","last_undegraded":"2024-04-17T15:40:58.869252+0000","last_fullsized":"2024-04-17T15:40:58.869252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830535+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:40:58.830535+0000","last_peered":"2024-04-17T15:40:58.830535+0000","last_clean":"2024-04-17T15:40:58.830535+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:40:58.830535+0000","last_undegraded":"2024-04-17T15:40:58.830535+0000","last_fullsized":"2024-04-17T15:40:58.830535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207046+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:40:58.207046+0000","last_peered":"2024-04-17T15:40:58.207046+0000","last_clean":"2024-04-17T15:40:58.207046+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:40:58.207046+0000","last_undegraded":"2024-04-17T15:40:58.207046+0000","last_fullsized":"2024-04-17T15:40:58.207046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208754+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:40:58.208754+0000","last_peered":"2024-04-17T15:40:58.208754+0000","last_clean":"2024-04-17T15:40:58.208754+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:40:58.208754+0000","last_undegraded":"2024-04-17T15:40:58.208754+0000","last_fullsized":"2024-04-17T15:40:58.208754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545192+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:40:58.545192+0000","last_peered":"2024-04-17T15:40:58.545192+0000","last_clean":"2024-04-17T15:40:58.545192+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:40:58.545192+0000","last_undegraded":"2024-04-17T15:40:58.545192+0000","last_fullsized":"2024-04-17T15:40:58.545192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"112'19","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209917+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:40:58.209917+0000","last_peered":"2024-04-17T15:40:58.209917+0000","last_clean":"2024-04-17T15:40:58.209917+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:40:58.209917+0000","last_undegraded":"2024-04-17T15:40:58.209917+0000","last_fullsized":"2024-04-17T15:40:58.209917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870126+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:40:58.870126+0000","last_peered":"2024-04-17T15:40:58.870126+0000","last_clean":"2024-04-17T15:40:58.870126+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:40:58.870126+0000","last_undegraded":"2024-04-17T15:40:58.870126+0000","last_fullsized":"2024-04-17T15:40:58.870126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544375+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:40:58.544375+0000","last_peered":"2024-04-17T15:40:58.544375+0000","last_clean":"2024-04-17T15:40:58.544375+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:40:58.544375+0000","last_undegraded":"2024-04-17T15:40:58.544375+0000","last_fullsized":"2024-04-17T15:40:58.544375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209073+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:40:58.209073+0000","last_peered":"2024-04-17T15:40:58.209073+0000","last_clean":"2024-04-17T15:40:58.209073+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:40:58.209073+0000","last_undegraded":"2024-04-17T15:40:58.209073+0000","last_fullsized":"2024-04-17T15:40:58.209073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551850+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:40:58.551850+0000","last_peered":"2024-04-17T15:40:58.551850+0000","last_clean":"2024-04-17T15:40:58.551850+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:40:58.551850+0000","last_undegraded":"2024-04-17T15:40:58.551850+0000","last_fullsized":"2024-04-17T15:40:58.551850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206959+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:40:58.206959+0000","last_peered":"2024-04-17T15:40:58.206959+0000","last_clean":"2024-04-17T15:40:58.206959+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:40:58.206959+0000","last_undegraded":"2024-04-17T15:40:58.206959+0000","last_fullsized":"2024-04-17T15:40:58.206959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"112'23","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832235+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:40:58.832235+0000","last_peered":"2024-04-17T15:40:58.832235+0000","last_clean":"2024-04-17T15:40:58.832235+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:40:58.832235+0000","last_undegraded":"2024-04-17T15:40:58.832235+0000","last_fullsized":"2024-04-17T15:40:58.832235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"112'134","reported_seq":442,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831725+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:40:58.831725+0000","last_peered":"2024-04-17T15:40:58.831725+0000","last_clean":"2024-04-17T15:40:58.831725+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:40:58.831725+0000","last_undegraded":"2024-04-17T15:40:58.831725+0000","last_fullsized":"2024-04-17T15:40:58.831725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205716+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:40:58.205716+0000","last_peered":"2024-04-17T15:40:58.205716+0000","last_clean":"2024-04-17T15:40:58.205716+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:40:58.205716+0000","last_undegraded":"2024-04-17T15:40:58.205716+0000","last_fullsized":"2024-04-17T15:40:58.205716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212582+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:40:58.212582+0000","last_peered":"2024-04-17T15:40:58.212582+0000","last_clean":"2024-04-17T15:40:58.212582+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:40:58.212582+0000","last_undegraded":"2024-04-17T15:40:58.212582+0000","last_fullsized":"2024-04-17T15:40:58.212582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208751+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:40:58.208751+0000","last_peered":"2024-04-17T15:40:58.208751+0000","last_clean":"2024-04-17T15:40:58.208751+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:40:58.208751+0000","last_undegraded":"2024-04-17T15:40:58.208751+0000","last_fullsized":"2024-04-17T15:40:58.208751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210704+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:40:58.210704+0000","last_peered":"2024-04-17T15:40:58.210704+0000","last_clean":"2024-04-17T15:40:58.210704+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:40:58.210704+0000","last_undegraded":"2024-04-17T15:40:58.210704+0000","last_fullsized":"2024-04-17T15:40:58.210704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545986+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:40:58.545986+0000","last_peered":"2024-04-17T15:40:58.545986+0000","last_clean":"2024-04-17T15:40:58.545986+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:40:58.545986+0000","last_undegraded":"2024-04-17T15:40:58.545986+0000","last_fullsized":"2024-04-17T15:40:58.545986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"112'134","reported_seq":449,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551979+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:40:58.551979+0000","last_peered":"2024-04-17T15:40:58.551979+0000","last_clean":"2024-04-17T15:40:58.551979+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:40:58.551979+0000","last_undegraded":"2024-04-17T15:40:58.551979+0000","last_fullsized":"2024-04-17T15:40:58.551979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208093+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:40:58.208093+0000","last_peered":"2024-04-17T15:40:58.208093+0000","last_clean":"2024-04-17T15:40:58.208093+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:40:58.208093+0000","last_undegraded":"2024-04-17T15:40:58.208093+0000","last_fullsized":"2024-04-17T15:40:58.208093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208922+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:40:58.208922+0000","last_peered":"2024-04-17T15:40:58.208922+0000","last_clean":"2024-04-17T15:40:58.208922+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:40:58.208922+0000","last_undegraded":"2024-04-17T15:40:58.208922+0000","last_fullsized":"2024-04-17T15:40:58.208922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545320+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:40:58.545320+0000","last_peered":"2024-04-17T15:40:58.545320+0000","last_clean":"2024-04-17T15:40:58.545320+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:40:58.545320+0000","last_undegraded":"2024-04-17T15:40:58.545320+0000","last_fullsized":"2024-04-17T15:40:58.545320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212265+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:40:58.212265+0000","last_peered":"2024-04-17T15:40:58.212265+0000","last_clean":"2024-04-17T15:40:58.212265+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:40:58.212265+0000","last_undegraded":"2024-04-17T15:40:58.212265+0000","last_fullsized":"2024-04-17T15:40:58.212265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"112'25","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209728+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:40:58.209728+0000","last_peered":"2024-04-17T15:40:58.209728+0000","last_clean":"2024-04-17T15:40:58.209728+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:40:58.209728+0000","last_undegraded":"2024-04-17T15:40:58.209728+0000","last_fullsized":"2024-04-17T15:40:58.209728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551513+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:40:58.551513+0000","last_peered":"2024-04-17T15:40:58.551513+0000","last_clean":"2024-04-17T15:40:58.551513+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:40:58.551513+0000","last_undegraded":"2024-04-17T15:40:58.551513+0000","last_fullsized":"2024-04-17T15:40:58.551513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206128+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:40:58.206128+0000","last_peered":"2024-04-17T15:40:58.206128+0000","last_clean":"2024-04-17T15:40:58.206128+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:40:58.206128+0000","last_undegraded":"2024-04-17T15:40:58.206128+0000","last_fullsized":"2024-04-17T15:40:58.206128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552553+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:40:58.552553+0000","last_peered":"2024-04-17T15:40:58.552553+0000","last_clean":"2024-04-17T15:40:58.552553+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:40:58.552553+0000","last_undegraded":"2024-04-17T15:40:58.552553+0000","last_fullsized":"2024-04-17T15:40:58.552553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":387,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512174+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:58.512174+0000","last_peered":"2024-04-17T15:40:58.512174+0000","last_clean":"2024-04-17T15:40:58.512174+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:58.512174+0000","last_undegraded":"2024-04-17T15:40:58.512174+0000","last_fullsized":"2024-04-17T15:40:58.512174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206221+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:40:58.206221+0000","last_peered":"2024-04-17T15:40:58.206221+0000","last_clean":"2024-04-17T15:40:58.206221+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:40:58.206221+0000","last_undegraded":"2024-04-17T15:40:58.206221+0000","last_fullsized":"2024-04-17T15:40:58.206221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"112'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545240+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:40:58.545240+0000","last_peered":"2024-04-17T15:40:58.545240+0000","last_clean":"2024-04-17T15:40:58.545240+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:40:58.545240+0000","last_undegraded":"2024-04-17T15:40:58.545240+0000","last_fullsized":"2024-04-17T15:40:58.545240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512461+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:40:58.512461+0000","last_peered":"2024-04-17T15:40:58.512461+0000","last_clean":"2024-04-17T15:40:58.512461+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:40:58.512461+0000","last_undegraded":"2024-04-17T15:40:58.512461+0000","last_fullsized":"2024-04-17T15:40:58.512461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"112'37","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210978+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:40:58.210978+0000","last_peered":"2024-04-17T15:40:58.210978+0000","last_clean":"2024-04-17T15:40:58.210978+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:40:58.210978+0000","last_undegraded":"2024-04-17T15:40:58.210978+0000","last_fullsized":"2024-04-17T15:40:58.210978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870042+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:40:58.870042+0000","last_peered":"2024-04-17T15:40:58.870042+0000","last_clean":"2024-04-17T15:40:58.870042+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:40:58.870042+0000","last_undegraded":"2024-04-17T15:40:58.870042+0000","last_fullsized":"2024-04-17T15:40:58.870042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550525+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:40:58.550525+0000","last_peered":"2024-04-17T15:40:58.550525+0000","last_clean":"2024-04-17T15:40:58.550525+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:40:58.550525+0000","last_undegraded":"2024-04-17T15:40:58.550525+0000","last_fullsized":"2024-04-17T15:40:58.550525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870224+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:40:58.870224+0000","last_peered":"2024-04-17T15:40:58.870224+0000","last_clean":"2024-04-17T15:40:58.870224+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:40:58.870224+0000","last_undegraded":"2024-04-17T15:40:58.870224+0000","last_fullsized":"2024-04-17T15:40:58.870224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511901+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:58.511901+0000","last_peered":"2024-04-17T15:40:58.511901+0000","last_clean":"2024-04-17T15:40:58.511901+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:58.511901+0000","last_undegraded":"2024-04-17T15:40:58.511901+0000","last_fullsized":"2024-04-17T15:40:58.511901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869298+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:40:58.869298+0000","last_peered":"2024-04-17T15:40:58.869298+0000","last_clean":"2024-04-17T15:40:58.869298+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:40:58.869298+0000","last_undegraded":"2024-04-17T15:40:58.869298+0000","last_fullsized":"2024-04-17T15:40:58.869298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211844+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:40:58.211844+0000","last_peered":"2024-04-17T15:40:58.211844+0000","last_clean":"2024-04-17T15:40:58.211844+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:40:58.211844+0000","last_undegraded":"2024-04-17T15:40:58.211844+0000","last_fullsized":"2024-04-17T15:40:58.211844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"112'137","reported_seq":468,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206768+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:40:58.206768+0000","last_peered":"2024-04-17T15:40:58.206768+0000","last_clean":"2024-04-17T15:40:58.206768+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:40:58.206768+0000","last_undegraded":"2024-04-17T15:40:58.206768+0000","last_fullsized":"2024-04-17T15:40:58.206768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513073+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:40:58.513073+0000","last_peered":"2024-04-17T15:40:58.513073+0000","last_clean":"2024-04-17T15:40:58.513073+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:40:58.513073+0000","last_undegraded":"2024-04-17T15:40:58.513073+0000","last_fullsized":"2024-04-17T15:40:58.513073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205369+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:40:58.205369+0000","last_peered":"2024-04-17T15:40:58.205369+0000","last_clean":"2024-04-17T15:40:58.205369+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:40:58.205369+0000","last_undegraded":"2024-04-17T15:40:58.205369+0000","last_fullsized":"2024-04-17T15:40:58.205369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208927+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:40:58.208927+0000","last_peered":"2024-04-17T15:40:58.208927+0000","last_clean":"2024-04-17T15:40:58.208927+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:40:58.208927+0000","last_undegraded":"2024-04-17T15:40:58.208927+0000","last_fullsized":"2024-04-17T15:40:58.208927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831329+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:40:58.831329+0000","last_peered":"2024-04-17T15:40:58.831329+0000","last_clean":"2024-04-17T15:40:58.831329+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:40:58.831329+0000","last_undegraded":"2024-04-17T15:40:58.831329+0000","last_fullsized":"2024-04-17T15:40:58.831329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205552+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:40:58.205552+0000","last_peered":"2024-04-17T15:40:58.205552+0000","last_clean":"2024-04-17T15:40:58.205552+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:40:58.205552+0000","last_undegraded":"2024-04-17T15:40:58.205552+0000","last_fullsized":"2024-04-17T15:40:58.205552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830548+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:40:58.830548+0000","last_peered":"2024-04-17T15:40:58.830548+0000","last_clean":"2024-04-17T15:40:58.830548+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:40:58.830548+0000","last_undegraded":"2024-04-17T15:40:58.830548+0000","last_fullsized":"2024-04-17T15:40:58.830548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"71'16","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513547+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:40:58.513547+0000","last_peered":"2024-04-17T15:40:58.513547+0000","last_clean":"2024-04-17T15:40:58.513547+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:40:58.513547+0000","last_undegraded":"2024-04-17T15:40:58.513547+0000","last_fullsized":"2024-04-17T15:40:58.513547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869471+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:40:58.869471+0000","last_peered":"2024-04-17T15:40:58.869471+0000","last_clean":"2024-04-17T15:40:58.869471+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:40:58.869471+0000","last_undegraded":"2024-04-17T15:40:58.869471+0000","last_fullsized":"2024-04-17T15:40:58.869471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545821+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:40:58.545821+0000","last_peered":"2024-04-17T15:40:58.545821+0000","last_clean":"2024-04-17T15:40:58.545821+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:40:58.545821+0000","last_undegraded":"2024-04-17T15:40:58.545821+0000","last_fullsized":"2024-04-17T15:40:58.545821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207410+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:40:58.207410+0000","last_peered":"2024-04-17T15:40:58.207410+0000","last_clean":"2024-04-17T15:40:58.207410+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:40:58.207410+0000","last_undegraded":"2024-04-17T15:40:58.207410+0000","last_fullsized":"2024-04-17T15:40:58.207410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207531+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:58.207531+0000","last_peered":"2024-04-17T15:40:58.207531+0000","last_clean":"2024-04-17T15:40:58.207531+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:58.207531+0000","last_undegraded":"2024-04-17T15:40:58.207531+0000","last_fullsized":"2024-04-17T15:40:58.207531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208780+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:40:58.208780+0000","last_peered":"2024-04-17T15:40:58.208780+0000","last_clean":"2024-04-17T15:40:58.208780+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:40:58.208780+0000","last_undegraded":"2024-04-17T15:40:58.208780+0000","last_fullsized":"2024-04-17T15:40:58.208780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868736+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:40:58.868736+0000","last_peered":"2024-04-17T15:40:58.868736+0000","last_clean":"2024-04-17T15:40:58.868736+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:40:58.868736+0000","last_undegraded":"2024-04-17T15:40:58.868736+0000","last_fullsized":"2024-04-17T15:40:58.868736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547104+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:40:58.547104+0000","last_peered":"2024-04-17T15:40:58.547104+0000","last_clean":"2024-04-17T15:40:58.547104+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:40:58.547104+0000","last_undegraded":"2024-04-17T15:40:58.547104+0000","last_fullsized":"2024-04-17T15:40:58.547104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553452+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:40:58.553452+0000","last_peered":"2024-04-17T15:40:58.553452+0000","last_clean":"2024-04-17T15:40:58.553452+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:40:58.553452+0000","last_undegraded":"2024-04-17T15:40:58.553452+0000","last_fullsized":"2024-04-17T15:40:58.553452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.204708+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:40:58.204708+0000","last_peered":"2024-04-17T15:40:58.204708+0000","last_clean":"2024-04-17T15:40:58.204708+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:40:58.204708+0000","last_undegraded":"2024-04-17T15:40:58.204708+0000","last_fullsized":"2024-04-17T15:40:58.204708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205907+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:40:58.205907+0000","last_peered":"2024-04-17T15:40:58.205907+0000","last_clean":"2024-04-17T15:40:58.205907+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:40:58.205907+0000","last_undegraded":"2024-04-17T15:40:58.205907+0000","last_fullsized":"2024-04-17T15:40:58.205907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211627+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:40:58.211627+0000","last_peered":"2024-04-17T15:40:58.211627+0000","last_clean":"2024-04-17T15:40:58.211627+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:40:58.211627+0000","last_undegraded":"2024-04-17T15:40:58.211627+0000","last_fullsized":"2024-04-17T15:40:58.211627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208313+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:40:58.208313+0000","last_peered":"2024-04-17T15:40:58.208313+0000","last_clean":"2024-04-17T15:40:58.208313+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:40:58.208313+0000","last_undegraded":"2024-04-17T15:40:58.208313+0000","last_fullsized":"2024-04-17T15:40:58.208313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870049+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:40:58.870049+0000","last_peered":"2024-04-17T15:40:58.870049+0000","last_clean":"2024-04-17T15:40:58.870049+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:40:58.870049+0000","last_undegraded":"2024-04-17T15:40:58.870049+0000","last_fullsized":"2024-04-17T15:40:58.870049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"112'34","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869261+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:40:58.869261+0000","last_peered":"2024-04-17T15:40:58.869261+0000","last_clean":"2024-04-17T15:40:58.869261+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:40:58.869261+0000","last_undegraded":"2024-04-17T15:40:58.869261+0000","last_fullsized":"2024-04-17T15:40:58.869261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207208+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:40:58.207208+0000","last_peered":"2024-04-17T15:40:58.207208+0000","last_clean":"2024-04-17T15:40:58.207208+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:40:58.207208+0000","last_undegraded":"2024-04-17T15:40:58.207208+0000","last_fullsized":"2024-04-17T15:40:58.207208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869786+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:40:58.869786+0000","last_peered":"2024-04-17T15:40:58.869786+0000","last_clean":"2024-04-17T15:40:58.869786+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:40:58.869786+0000","last_undegraded":"2024-04-17T15:40:58.869786+0000","last_fullsized":"2024-04-17T15:40:58.869786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870620+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:40:58.870620+0000","last_peered":"2024-04-17T15:40:58.870620+0000","last_clean":"2024-04-17T15:40:58.870620+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:40:58.870620+0000","last_undegraded":"2024-04-17T15:40:58.870620+0000","last_fullsized":"2024-04-17T15:40:58.870620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207704+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:40:58.207704+0000","last_peered":"2024-04-17T15:40:58.207704+0000","last_clean":"2024-04-17T15:40:58.207704+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:40:58.207704+0000","last_undegraded":"2024-04-17T15:40:58.207704+0000","last_fullsized":"2024-04-17T15:40:58.207704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514348+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:40:58.514348+0000","last_peered":"2024-04-17T15:40:58.514348+0000","last_clean":"2024-04-17T15:40:58.514348+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:40:58.514348+0000","last_undegraded":"2024-04-17T15:40:58.514348+0000","last_fullsized":"2024-04-17T15:40:58.514348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551315+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:40:58.551315+0000","last_peered":"2024-04-17T15:40:58.551315+0000","last_clean":"2024-04-17T15:40:58.551315+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:40:58.551315+0000","last_undegraded":"2024-04-17T15:40:58.551315+0000","last_fullsized":"2024-04-17T15:40:58.551315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205169+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:40:58.205169+0000","last_peered":"2024-04-17T15:40:58.205169+0000","last_clean":"2024-04-17T15:40:58.205169+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:40:58.205169+0000","last_undegraded":"2024-04-17T15:40:58.205169+0000","last_fullsized":"2024-04-17T15:40:58.205169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"112'134","reported_seq":399,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.516289+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:40:58.516289+0000","last_peered":"2024-04-17T15:40:58.516289+0000","last_clean":"2024-04-17T15:40:58.516289+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:40:58.516289+0000","last_undegraded":"2024-04-17T15:40:58.516289+0000","last_fullsized":"2024-04-17T15:40:58.516289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546955+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:40:58.546955+0000","last_peered":"2024-04-17T15:40:58.546955+0000","last_clean":"2024-04-17T15:40:58.546955+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:40:58.546955+0000","last_undegraded":"2024-04-17T15:40:58.546955+0000","last_fullsized":"2024-04-17T15:40:58.546955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544700+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:40:58.544700+0000","last_peered":"2024-04-17T15:40:58.544700+0000","last_clean":"2024-04-17T15:40:58.544700+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:40:58.544700+0000","last_undegraded":"2024-04-17T15:40:58.544700+0000","last_fullsized":"2024-04-17T15:40:58.544700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'20","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546637+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:40:58.546637+0000","last_peered":"2024-04-17T15:40:58.546637+0000","last_clean":"2024-04-17T15:40:58.546637+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:40:58.546637+0000","last_undegraded":"2024-04-17T15:40:58.546637+0000","last_fullsized":"2024-04-17T15:40:58.546637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207967+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:40:58.207967+0000","last_peered":"2024-04-17T15:40:58.207967+0000","last_clean":"2024-04-17T15:40:58.207967+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:40:58.207967+0000","last_undegraded":"2024-04-17T15:40:58.207967+0000","last_fullsized":"2024-04-17T15:40:58.207967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207721+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:40:58.207721+0000","last_peered":"2024-04-17T15:40:58.207721+0000","last_clean":"2024-04-17T15:40:58.207721+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:40:58.207721+0000","last_undegraded":"2024-04-17T15:40:58.207721+0000","last_fullsized":"2024-04-17T15:40:58.207721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208760+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:40:58.208760+0000","last_peered":"2024-04-17T15:40:58.208760+0000","last_clean":"2024-04-17T15:40:58.208760+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:40:58.208760+0000","last_undegraded":"2024-04-17T15:40:58.208760+0000","last_fullsized":"2024-04-17T15:40:58.208760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"112'134","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546363+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:40:58.546363+0000","last_peered":"2024-04-17T15:40:58.546363+0000","last_clean":"2024-04-17T15:40:58.546363+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:40:58.546363+0000","last_undegraded":"2024-04-17T15:40:58.546363+0000","last_fullsized":"2024-04-17T15:40:58.546363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869584+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:40:58.869584+0000","last_peered":"2024-04-17T15:40:58.869584+0000","last_clean":"2024-04-17T15:40:58.869584+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:40:58.869584+0000","last_undegraded":"2024-04-17T15:40:58.869584+0000","last_fullsized":"2024-04-17T15:40:58.869584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208025+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:40:58.208025+0000","last_peered":"2024-04-17T15:40:58.208025+0000","last_clean":"2024-04-17T15:40:58.208025+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:40:58.208025+0000","last_undegraded":"2024-04-17T15:40:58.208025+0000","last_fullsized":"2024-04-17T15:40:58.208025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870384+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:40:58.870384+0000","last_peered":"2024-04-17T15:40:58.870384+0000","last_clean":"2024-04-17T15:40:58.870384+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:40:58.870384+0000","last_undegraded":"2024-04-17T15:40:58.870384+0000","last_fullsized":"2024-04-17T15:40:58.870384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553838+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:40:58.553838+0000","last_peered":"2024-04-17T15:40:58.553838+0000","last_clean":"2024-04-17T15:40:58.553838+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:40:58.553838+0000","last_undegraded":"2024-04-17T15:40:58.553838+0000","last_fullsized":"2024-04-17T15:40:58.553838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544172+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:40:58.544172+0000","last_peered":"2024-04-17T15:40:58.544172+0000","last_clean":"2024-04-17T15:40:58.544172+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:40:58.544172+0000","last_undegraded":"2024-04-17T15:40:58.544172+0000","last_fullsized":"2024-04-17T15:40:58.544172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"112'46","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511814+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:40:58.511814+0000","last_peered":"2024-04-17T15:40:58.511814+0000","last_clean":"2024-04-17T15:40:58.511814+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:40:58.511814+0000","last_undegraded":"2024-04-17T15:40:58.511814+0000","last_fullsized":"2024-04-17T15:40:58.511814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":28,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545031+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:40:58.545031+0000","last_peered":"2024-04-17T15:40:58.545031+0000","last_clean":"2024-04-17T15:40:58.545031+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:40:58.545031+0000","last_undegraded":"2024-04-17T15:40:58.545031+0000","last_fullsized":"2024-04-17T15:40:58.545031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205831+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:40:58.205831+0000","last_peered":"2024-04-17T15:40:58.205831+0000","last_clean":"2024-04-17T15:40:58.205831+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:40:58.205831+0000","last_undegraded":"2024-04-17T15:40:58.205831+0000","last_fullsized":"2024-04-17T15:40:58.205831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869887+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:40:58.869887+0000","last_peered":"2024-04-17T15:40:58.869887+0000","last_clean":"2024-04-17T15:40:58.869887+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:40:58.869887+0000","last_undegraded":"2024-04-17T15:40:58.869887+0000","last_fullsized":"2024-04-17T15:40:58.869887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207678+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:40:58.207678+0000","last_peered":"2024-04-17T15:40:58.207678+0000","last_clean":"2024-04-17T15:40:58.207678+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:40:58.207678+0000","last_undegraded":"2024-04-17T15:40:58.207678+0000","last_fullsized":"2024-04-17T15:40:58.207678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'27","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207428+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:40:58.207428+0000","last_peered":"2024-04-17T15:40:58.207428+0000","last_clean":"2024-04-17T15:40:58.207428+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:40:58.207428+0000","last_undegraded":"2024-04-17T15:40:58.207428+0000","last_fullsized":"2024-04-17T15:40:58.207428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205988+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:40:58.205988+0000","last_peered":"2024-04-17T15:40:58.205988+0000","last_clean":"2024-04-17T15:40:58.205988+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:40:58.205988+0000","last_undegraded":"2024-04-17T15:40:58.205988+0000","last_fullsized":"2024-04-17T15:40:58.205988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"112'19","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544621+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:40:58.544621+0000","last_peered":"2024-04-17T15:40:58.544621+0000","last_clean":"2024-04-17T15:40:58.544621+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:40:58.544621+0000","last_undegraded":"2024-04-17T15:40:58.544621+0000","last_fullsized":"2024-04-17T15:40:58.544621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544482+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:40:58.544482+0000","last_peered":"2024-04-17T15:40:58.544482+0000","last_clean":"2024-04-17T15:40:58.544482+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:40:58.544482+0000","last_undegraded":"2024-04-17T15:40:58.544482+0000","last_fullsized":"2024-04-17T15:40:58.544482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546509+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:40:58.546509+0000","last_peered":"2024-04-17T15:40:58.546509+0000","last_clean":"2024-04-17T15:40:58.546509+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:40:58.546509+0000","last_undegraded":"2024-04-17T15:40:58.546509+0000","last_fullsized":"2024-04-17T15:40:58.546509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":195,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205059+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:58.205059+0000","last_peered":"2024-04-17T15:40:58.205059+0000","last_clean":"2024-04-17T15:40:58.205059+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:58.205059+0000","last_undegraded":"2024-04-17T15:40:58.205059+0000","last_fullsized":"2024-04-17T15:40:58.205059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513793+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:40:58.513793+0000","last_peered":"2024-04-17T15:40:58.513793+0000","last_clean":"2024-04-17T15:40:58.513793+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:40:58.513793+0000","last_undegraded":"2024-04-17T15:40:58.513793+0000","last_fullsized":"2024-04-17T15:40:58.513793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545728+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:40:58.545728+0000","last_peered":"2024-04-17T15:40:58.545728+0000","last_clean":"2024-04-17T15:40:58.545728+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:40:58.545728+0000","last_undegraded":"2024-04-17T15:40:58.545728+0000","last_fullsized":"2024-04-17T15:40:58.545728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'9","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869028+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:58.869028+0000","last_peered":"2024-04-17T15:40:58.869028+0000","last_clean":"2024-04-17T15:40:58.869028+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:58.869028+0000","last_undegraded":"2024-04-17T15:40:58.869028+0000","last_fullsized":"2024-04-17T15:40:58.869028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511688+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:58.511688+0000","last_peered":"2024-04-17T15:40:58.511688+0000","last_clean":"2024-04-17T15:40:58.511688+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:58.511688+0000","last_undegraded":"2024-04-17T15:40:58.511688+0000","last_fullsized":"2024-04-17T15:40:58.511688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870459+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:58.870459+0000","last_peered":"2024-04-17T15:40:58.870459+0000","last_clean":"2024-04-17T15:40:58.870459+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:58.870459+0000","last_undegraded":"2024-04-17T15:40:58.870459+0000","last_fullsized":"2024-04-17T15:40:58.870459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544795+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:40:58.544795+0000","last_peered":"2024-04-17T15:40:58.544795+0000","last_clean":"2024-04-17T15:40:58.544795+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:40:58.544795+0000","last_undegraded":"2024-04-17T15:40:58.544795+0000","last_fullsized":"2024-04-17T15:40:58.544795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'31","reported_seq":209,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831790+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:40:58.831790+0000","last_peered":"2024-04-17T15:40:58.831790+0000","last_clean":"2024-04-17T15:40:58.831790+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:40:58.831790+0000","last_undegraded":"2024-04-17T15:40:58.831790+0000","last_fullsized":"2024-04-17T15:40:58.831790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510907+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:40:58.510907+0000","last_peered":"2024-04-17T15:40:58.510907+0000","last_clean":"2024-04-17T15:40:58.510907+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:40:58.510907+0000","last_undegraded":"2024-04-17T15:40:58.510907+0000","last_fullsized":"2024-04-17T15:40:58.510907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"112'19","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545552+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:40:58.545552+0000","last_peered":"2024-04-17T15:40:58.545552+0000","last_clean":"2024-04-17T15:40:58.545552+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:40:58.545552+0000","last_undegraded":"2024-04-17T15:40:58.545552+0000","last_fullsized":"2024-04-17T15:40:58.545552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551183+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:40:58.551183+0000","last_peered":"2024-04-17T15:40:58.551183+0000","last_clean":"2024-04-17T15:40:58.551183+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:40:58.551183+0000","last_undegraded":"2024-04-17T15:40:58.551183+0000","last_fullsized":"2024-04-17T15:40:58.551183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205899+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:58.205899+0000","last_peered":"2024-04-17T15:40:58.205899+0000","last_clean":"2024-04-17T15:40:58.205899+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:58.205899+0000","last_undegraded":"2024-04-17T15:40:58.205899+0000","last_fullsized":"2024-04-17T15:40:58.205899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544812+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:40:58.544812+0000","last_peered":"2024-04-17T15:40:58.544812+0000","last_clean":"2024-04-17T15:40:58.544812+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:40:58.544812+0000","last_undegraded":"2024-04-17T15:40:58.544812+0000","last_fullsized":"2024-04-17T15:40:58.544812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870440+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:40:58.870440+0000","last_peered":"2024-04-17T15:40:58.870440+0000","last_clean":"2024-04-17T15:40:58.870440+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:40:58.870440+0000","last_undegraded":"2024-04-17T15:40:58.870440+0000","last_fullsized":"2024-04-17T15:40:58.870440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550102+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:40:58.550102+0000","last_peered":"2024-04-17T15:40:58.550102+0000","last_clean":"2024-04-17T15:40:58.550102+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:40:58.550102+0000","last_undegraded":"2024-04-17T15:40:58.550102+0000","last_fullsized":"2024-04-17T15:40:58.550102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"112'18","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511513+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:40:58.511513+0000","last_peered":"2024-04-17T15:40:58.511513+0000","last_clean":"2024-04-17T15:40:58.511513+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:40:58.511513+0000","last_undegraded":"2024-04-17T15:40:58.511513+0000","last_fullsized":"2024-04-17T15:40:58.511513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870490+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:40:58.870490+0000","last_peered":"2024-04-17T15:40:58.870490+0000","last_clean":"2024-04-17T15:40:58.870490+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:40:58.870490+0000","last_undegraded":"2024-04-17T15:40:58.870490+0000","last_fullsized":"2024-04-17T15:40:58.870490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553654+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:40:58.553654+0000","last_peered":"2024-04-17T15:40:58.553654+0000","last_clean":"2024-04-17T15:40:58.553654+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:40:58.553654+0000","last_undegraded":"2024-04-17T15:40:58.553654+0000","last_fullsized":"2024-04-17T15:40:58.553654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545267+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:40:58.545267+0000","last_peered":"2024-04-17T15:40:58.545267+0000","last_clean":"2024-04-17T15:40:58.545267+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:40:58.545267+0000","last_undegraded":"2024-04-17T15:40:58.545267+0000","last_fullsized":"2024-04-17T15:40:58.545267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870131+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:40:58.870131+0000","last_peered":"2024-04-17T15:40:58.870131+0000","last_clean":"2024-04-17T15:40:58.870131+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:40:58.870131+0000","last_undegraded":"2024-04-17T15:40:58.870131+0000","last_fullsized":"2024-04-17T15:40:58.870131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"112'28","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206882+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:40:58.206882+0000","last_peered":"2024-04-17T15:40:58.206882+0000","last_clean":"2024-04-17T15:40:58.206882+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:40:58.206882+0000","last_undegraded":"2024-04-17T15:40:58.206882+0000","last_fullsized":"2024-04-17T15:40:58.206882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206391+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:40:58.206391+0000","last_peered":"2024-04-17T15:40:58.206391+0000","last_clean":"2024-04-17T15:40:58.206391+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:40:58.206391+0000","last_undegraded":"2024-04-17T15:40:58.206391+0000","last_fullsized":"2024-04-17T15:40:58.206391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545154+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:58.545154+0000","last_peered":"2024-04-17T15:40:58.545154+0000","last_clean":"2024-04-17T15:40:58.545154+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:58.545154+0000","last_undegraded":"2024-04-17T15:40:58.545154+0000","last_fullsized":"2024-04-17T15:40:58.545154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870197+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:40:58.870197+0000","last_peered":"2024-04-17T15:40:58.870197+0000","last_clean":"2024-04-17T15:40:58.870197+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:40:58.870197+0000","last_undegraded":"2024-04-17T15:40:58.870197+0000","last_fullsized":"2024-04-17T15:40:58.870197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206746+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:40:58.206746+0000","last_peered":"2024-04-17T15:40:58.206746+0000","last_clean":"2024-04-17T15:40:58.206746+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:40:58.206746+0000","last_undegraded":"2024-04-17T15:40:58.206746+0000","last_fullsized":"2024-04-17T15:40:58.206746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550274+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:40:58.550274+0000","last_peered":"2024-04-17T15:40:58.550274+0000","last_clean":"2024-04-17T15:40:58.550274+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:40:58.550274+0000","last_undegraded":"2024-04-17T15:40:58.550274+0000","last_fullsized":"2024-04-17T15:40:58.550274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"112'23","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512168+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:40:58.512168+0000","last_peered":"2024-04-17T15:40:58.512168+0000","last_clean":"2024-04-17T15:40:58.512168+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:40:58.512168+0000","last_undegraded":"2024-04-17T15:40:58.512168+0000","last_fullsized":"2024-04-17T15:40:58.512168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207231+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:58.207231+0000","last_peered":"2024-04-17T15:40:58.207231+0000","last_clean":"2024-04-17T15:40:58.207231+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:58.207231+0000","last_undegraded":"2024-04-17T15:40:58.207231+0000","last_fullsized":"2024-04-17T15:40:58.207231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550842+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:58.550842+0000","last_peered":"2024-04-17T15:40:58.550842+0000","last_clean":"2024-04-17T15:40:58.550842+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:58.550842+0000","last_undegraded":"2024-04-17T15:40:58.550842+0000","last_fullsized":"2024-04-17T15:40:58.550842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546595+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:40:58.546595+0000","last_peered":"2024-04-17T15:40:58.546595+0000","last_clean":"2024-04-17T15:40:58.546595+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:40:58.546595+0000","last_undegraded":"2024-04-17T15:40:58.546595+0000","last_fullsized":"2024-04-17T15:40:58.546595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'28","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209461+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:40:58.209461+0000","last_peered":"2024-04-17T15:40:58.209461+0000","last_clean":"2024-04-17T15:40:58.209461+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:40:58.209461+0000","last_undegraded":"2024-04-17T15:40:58.209461+0000","last_fullsized":"2024-04-17T15:40:58.209461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209537+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:58.209537+0000","last_peered":"2024-04-17T15:40:58.209537+0000","last_clean":"2024-04-17T15:40:58.209537+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:58.209537+0000","last_undegraded":"2024-04-17T15:40:58.209537+0000","last_fullsized":"2024-04-17T15:40:58.209537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"112'21","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547094+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:40:58.547094+0000","last_peered":"2024-04-17T15:40:58.547094+0000","last_clean":"2024-04-17T15:40:58.547094+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:40:58.547094+0000","last_undegraded":"2024-04-17T15:40:58.547094+0000","last_fullsized":"2024-04-17T15:40:58.547094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206857+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:40:58.206857+0000","last_peered":"2024-04-17T15:40:58.206857+0000","last_clean":"2024-04-17T15:40:58.206857+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:40:58.206857+0000","last_undegraded":"2024-04-17T15:40:58.206857+0000","last_fullsized":"2024-04-17T15:40:58.206857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205399+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:58.205399+0000","last_peered":"2024-04-17T15:40:58.205399+0000","last_clean":"2024-04-17T15:40:58.205399+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:58.205399+0000","last_undegraded":"2024-04-17T15:40:58.205399+0000","last_fullsized":"2024-04-17T15:40:58.205399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832037+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:40:58.832037+0000","last_peered":"2024-04-17T15:40:58.832037+0000","last_clean":"2024-04-17T15:40:58.832037+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:40:58.832037+0000","last_undegraded":"2024-04-17T15:40:58.832037+0000","last_fullsized":"2024-04-17T15:40:58.832037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'27","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869598+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:40:58.869598+0000","last_peered":"2024-04-17T15:40:58.869598+0000","last_clean":"2024-04-17T15:40:58.869598+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:40:58.869598+0000","last_undegraded":"2024-04-17T15:40:58.869598+0000","last_fullsized":"2024-04-17T15:40:58.869598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207897+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:40:58.207897+0000","last_peered":"2024-04-17T15:40:58.207897+0000","last_clean":"2024-04-17T15:40:58.207897+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:40:58.207897+0000","last_undegraded":"2024-04-17T15:40:58.207897+0000","last_fullsized":"2024-04-17T15:40:58.207897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"98'12","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210312+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:40:58.210312+0000","last_peered":"2024-04-17T15:40:58.210312+0000","last_clean":"2024-04-17T15:40:58.210312+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:40:58.210312+0000","last_undegraded":"2024-04-17T15:40:58.210312+0000","last_fullsized":"2024-04-17T15:40:58.210312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"112'134","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553367+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:40:58.553367+0000","last_peered":"2024-04-17T15:40:58.553367+0000","last_clean":"2024-04-17T15:40:58.553367+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:40:58.553367+0000","last_undegraded":"2024-04-17T15:40:58.553367+0000","last_fullsized":"2024-04-17T15:40:58.553367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511119+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:58.511119+0000","last_peered":"2024-04-17T15:40:58.511119+0000","last_clean":"2024-04-17T15:40:58.511119+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:58.511119+0000","last_undegraded":"2024-04-17T15:40:58.511119+0000","last_fullsized":"2024-04-17T15:40:58.511119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207401+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:58.207401+0000","last_peered":"2024-04-17T15:40:58.207401+0000","last_clean":"2024-04-17T15:40:58.207401+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:58.207401+0000","last_undegraded":"2024-04-17T15:40:58.207401+0000","last_fullsized":"2024-04-17T15:40:58.207401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206878+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:40:58.206878+0000","last_peered":"2024-04-17T15:40:58.206878+0000","last_clean":"2024-04-17T15:40:58.206878+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:40:58.206878+0000","last_undegraded":"2024-04-17T15:40:58.206878+0000","last_fullsized":"2024-04-17T15:40:58.206878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510932+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:40:58.510932+0000","last_peered":"2024-04-17T15:40:58.510932+0000","last_clean":"2024-04-17T15:40:58.510932+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:40:58.510932+0000","last_undegraded":"2024-04-17T15:40:58.510932+0000","last_fullsized":"2024-04-17T15:40:58.510932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"112'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206404+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:40:58.206404+0000","last_peered":"2024-04-17T15:40:58.206404+0000","last_clean":"2024-04-17T15:40:58.206404+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:40:58.206404+0000","last_undegraded":"2024-04-17T15:40:58.206404+0000","last_fullsized":"2024-04-17T15:40:58.206404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868782+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:40:58.868782+0000","last_peered":"2024-04-17T15:40:58.868782+0000","last_clean":"2024-04-17T15:40:58.868782+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:40:58.868782+0000","last_undegraded":"2024-04-17T15:40:58.868782+0000","last_fullsized":"2024-04-17T15:40:58.868782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514028+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:58.514028+0000","last_peered":"2024-04-17T15:40:58.514028+0000","last_clean":"2024-04-17T15:40:58.514028+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:58.514028+0000","last_undegraded":"2024-04-17T15:40:58.514028+0000","last_fullsized":"2024-04-17T15:40:58.514028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208859+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:58.208859+0000","last_peered":"2024-04-17T15:40:58.208859+0000","last_clean":"2024-04-17T15:40:58.208859+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:58.208859+0000","last_undegraded":"2024-04-17T15:40:58.208859+0000","last_fullsized":"2024-04-17T15:40:58.208859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211358+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:40:58.211358+0000","last_peered":"2024-04-17T15:40:58.211358+0000","last_clean":"2024-04-17T15:40:58.211358+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:40:58.211358+0000","last_undegraded":"2024-04-17T15:40:58.211358+0000","last_fullsized":"2024-04-17T15:40:58.211358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205705+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:58.205705+0000","last_peered":"2024-04-17T15:40:58.205705+0000","last_clean":"2024-04-17T15:40:58.205705+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:58.205705+0000","last_undegraded":"2024-04-17T15:40:58.205705+0000","last_fullsized":"2024-04-17T15:40:58.205705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"112'18","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868852+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:40:58.868852+0000","last_peered":"2024-04-17T15:40:58.868852+0000","last_clean":"2024-04-17T15:40:58.868852+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:40:58.868852+0000","last_undegraded":"2024-04-17T15:40:58.868852+0000","last_fullsized":"2024-04-17T15:40:58.868852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550780+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:40:58.550780+0000","last_peered":"2024-04-17T15:40:58.550780+0000","last_clean":"2024-04-17T15:40:58.550780+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:40:58.550780+0000","last_undegraded":"2024-04-17T15:40:58.550780+0000","last_fullsized":"2024-04-17T15:40:58.550780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546804+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:58.546804+0000","last_peered":"2024-04-17T15:40:58.546804+0000","last_clean":"2024-04-17T15:40:58.546804+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:58.546804+0000","last_undegraded":"2024-04-17T15:40:58.546804+0000","last_fullsized":"2024-04-17T15:40:58.546804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544901+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:40:58.544901+0000","last_peered":"2024-04-17T15:40:58.544901+0000","last_clean":"2024-04-17T15:40:58.544901+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:40:58.544901+0000","last_undegraded":"2024-04-17T15:40:58.544901+0000","last_fullsized":"2024-04-17T15:40:58.544901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547319+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:40:58.547319+0000","last_peered":"2024-04-17T15:40:58.547319+0000","last_clean":"2024-04-17T15:40:58.547319+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:40:58.547319+0000","last_undegraded":"2024-04-17T15:40:58.547319+0000","last_fullsized":"2024-04-17T15:40:58.547319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205607+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:40:58.205607+0000","last_peered":"2024-04-17T15:40:58.205607+0000","last_clean":"2024-04-17T15:40:58.205607+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:40:58.205607+0000","last_undegraded":"2024-04-17T15:40:58.205607+0000","last_fullsized":"2024-04-17T15:40:58.205607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"112'13","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546215+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:40:58.546215+0000","last_peered":"2024-04-17T15:40:58.546215+0000","last_clean":"2024-04-17T15:40:58.546215+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:40:58.546215+0000","last_undegraded":"2024-04-17T15:40:58.546215+0000","last_fullsized":"2024-04-17T15:40:58.546215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207130+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:58.207130+0000","last_peered":"2024-04-17T15:40:58.207130+0000","last_clean":"2024-04-17T15:40:58.207130+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:58.207130+0000","last_undegraded":"2024-04-17T15:40:58.207130+0000","last_fullsized":"2024-04-17T15:40:58.207130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513344+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:58.513344+0000","last_peered":"2024-04-17T15:40:58.513344+0000","last_clean":"2024-04-17T15:40:58.513344+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:58.513344+0000","last_undegraded":"2024-04-17T15:40:58.513344+0000","last_fullsized":"2024-04-17T15:40:58.513344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206775+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:40:58.206775+0000","last_peered":"2024-04-17T15:40:58.206775+0000","last_clean":"2024-04-17T15:40:58.206775+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:40:58.206775+0000","last_undegraded":"2024-04-17T15:40:58.206775+0000","last_fullsized":"2024-04-17T15:40:58.206775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870374+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:40:58.870374+0000","last_peered":"2024-04-17T15:40:58.870374+0000","last_clean":"2024-04-17T15:40:58.870374+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:40:58.870374+0000","last_undegraded":"2024-04-17T15:40:58.870374+0000","last_fullsized":"2024-04-17T15:40:58.870374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205395+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:40:58.205395+0000","last_peered":"2024-04-17T15:40:58.205395+0000","last_clean":"2024-04-17T15:40:58.205395+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:40:58.205395+0000","last_undegraded":"2024-04-17T15:40:58.205395+0000","last_fullsized":"2024-04-17T15:40:58.205395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"112'18","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207629+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:40:58.207629+0000","last_peered":"2024-04-17T15:40:58.207629+0000","last_clean":"2024-04-17T15:40:58.207629+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:40:58.207629+0000","last_undegraded":"2024-04-17T15:40:58.207629+0000","last_fullsized":"2024-04-17T15:40:58.207629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869445+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:40:58.869445+0000","last_peered":"2024-04-17T15:40:58.869445+0000","last_clean":"2024-04-17T15:40:58.869445+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:40:58.869445+0000","last_undegraded":"2024-04-17T15:40:58.869445+0000","last_fullsized":"2024-04-17T15:40:58.869445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209600+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:58.209600+0000","last_peered":"2024-04-17T15:40:58.209600+0000","last_clean":"2024-04-17T15:40:58.209600+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:58.209600+0000","last_undegraded":"2024-04-17T15:40:58.209600+0000","last_fullsized":"2024-04-17T15:40:58.209600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208657+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:40:58.208657+0000","last_peered":"2024-04-17T15:40:58.208657+0000","last_clean":"2024-04-17T15:40:58.208657+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:40:58.208657+0000","last_undegraded":"2024-04-17T15:40:58.208657+0000","last_fullsized":"2024-04-17T15:40:58.208657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'28","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550688+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:40:58.550688+0000","last_peered":"2024-04-17T15:40:58.550688+0000","last_clean":"2024-04-17T15:40:58.550688+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:40:58.550688+0000","last_undegraded":"2024-04-17T15:40:58.550688+0000","last_fullsized":"2024-04-17T15:40:58.550688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207501+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:40:58.207501+0000","last_peered":"2024-04-17T15:40:58.207501+0000","last_clean":"2024-04-17T15:40:58.207501+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:40:58.207501+0000","last_undegraded":"2024-04-17T15:40:58.207501+0000","last_fullsized":"2024-04-17T15:40:58.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831064+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:40:58.831064+0000","last_peered":"2024-04-17T15:40:58.831064+0000","last_clean":"2024-04-17T15:40:58.831064+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:40:58.831064+0000","last_undegraded":"2024-04-17T15:40:58.831064+0000","last_fullsized":"2024-04-17T15:40:58.831064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210291+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:40:58.210291+0000","last_peered":"2024-04-17T15:40:58.210291+0000","last_clean":"2024-04-17T15:40:58.210291+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:40:58.210291+0000","last_undegraded":"2024-04-17T15:40:58.210291+0000","last_fullsized":"2024-04-17T15:40:58.210291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207176+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:40:58.207176+0000","last_peered":"2024-04-17T15:40:58.207176+0000","last_clean":"2024-04-17T15:40:58.207176+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:40:58.207176+0000","last_undegraded":"2024-04-17T15:40:58.207176+0000","last_fullsized":"2024-04-17T15:40:58.207176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207964+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:40:58.207964+0000","last_peered":"2024-04-17T15:40:58.207964+0000","last_clean":"2024-04-17T15:40:58.207964+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:40:58.207964+0000","last_undegraded":"2024-04-17T15:40:58.207964+0000","last_fullsized":"2024-04-17T15:40:58.207964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869898+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:40:58.869898+0000","last_peered":"2024-04-17T15:40:58.869898+0000","last_clean":"2024-04-17T15:40:58.869898+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:40:58.869898+0000","last_undegraded":"2024-04-17T15:40:58.869898+0000","last_fullsized":"2024-04-17T15:40:58.869898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545971+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:40:58.545971+0000","last_peered":"2024-04-17T15:40:58.545971+0000","last_clean":"2024-04-17T15:40:58.545971+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:40:58.545971+0000","last_undegraded":"2024-04-17T15:40:58.545971+0000","last_fullsized":"2024-04-17T15:40:58.545971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"111'25","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831752+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:40:58.831752+0000","last_peered":"2024-04-17T15:40:58.831752+0000","last_clean":"2024-04-17T15:40:58.831752+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:40:58.831752+0000","last_undegraded":"2024-04-17T15:40:58.831752+0000","last_fullsized":"2024-04-17T15:40:58.831752+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209353+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:40:58.209353+0000","last_peered":"2024-04-17T15:40:58.209353+0000","last_clean":"2024-04-17T15:40:58.209353+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:40:58.209353+0000","last_undegraded":"2024-04-17T15:40:58.209353+0000","last_fullsized":"2024-04-17T15:40:58.209353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'32","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208331+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:40:58.208331+0000","last_peered":"2024-04-17T15:40:58.208331+0000","last_clean":"2024-04-17T15:40:58.208331+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:40:58.208331+0000","last_undegraded":"2024-04-17T15:40:58.208331+0000","last_fullsized":"2024-04-17T15:40:58.208331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544712+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:40:58.544712+0000","last_peered":"2024-04-17T15:40:58.544712+0000","last_clean":"2024-04-17T15:40:58.544712+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:40:58.544712+0000","last_undegraded":"2024-04-17T15:40:58.544712+0000","last_fullsized":"2024-04-17T15:40:58.544712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553487+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:40:58.553487+0000","last_peered":"2024-04-17T15:40:58.553487+0000","last_clean":"2024-04-17T15:40:58.553487+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:40:58.553487+0000","last_undegraded":"2024-04-17T15:40:58.553487+0000","last_fullsized":"2024-04-17T15:40:58.553487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550512+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:40:58.550512+0000","last_peered":"2024-04-17T15:40:58.550512+0000","last_clean":"2024-04-17T15:40:58.550512+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:40:58.550512+0000","last_undegraded":"2024-04-17T15:40:58.550512+0000","last_fullsized":"2024-04-17T15:40:58.550512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546883+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:40:58.546883+0000","last_peered":"2024-04-17T15:40:58.546883+0000","last_clean":"2024-04-17T15:40:58.546883+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:40:58.546883+0000","last_undegraded":"2024-04-17T15:40:58.546883+0000","last_fullsized":"2024-04-17T15:40:58.546883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870300+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:40:58.870300+0000","last_peered":"2024-04-17T15:40:58.870300+0000","last_clean":"2024-04-17T15:40:58.870300+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:40:58.870300+0000","last_undegraded":"2024-04-17T15:40:58.870300+0000","last_fullsized":"2024-04-17T15:40:58.870300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205823+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:40:58.205823+0000","last_peered":"2024-04-17T15:40:58.205823+0000","last_clean":"2024-04-17T15:40:58.205823+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:40:58.205823+0000","last_undegraded":"2024-04-17T15:40:58.205823+0000","last_fullsized":"2024-04-17T15:40:58.205823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212281+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:40:58.212281+0000","last_peered":"2024-04-17T15:40:58.212281+0000","last_clean":"2024-04-17T15:40:58.212281+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:40:58.212281+0000","last_undegraded":"2024-04-17T15:40:58.212281+0000","last_fullsized":"2024-04-17T15:40:58.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544966+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:40:58.544966+0000","last_peered":"2024-04-17T15:40:58.544966+0000","last_clean":"2024-04-17T15:40:58.544966+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:40:58.544966+0000","last_undegraded":"2024-04-17T15:40:58.544966+0000","last_fullsized":"2024-04-17T15:40:58.544966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832094+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:40:58.832094+0000","last_peered":"2024-04-17T15:40:58.832094+0000","last_clean":"2024-04-17T15:40:58.832094+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:40:58.832094+0000","last_undegraded":"2024-04-17T15:40:58.832094+0000","last_fullsized":"2024-04-17T15:40:58.832094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'24","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206917+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:40:58.206917+0000","last_peered":"2024-04-17T15:40:58.206917+0000","last_clean":"2024-04-17T15:40:58.206917+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:40:58.206917+0000","last_undegraded":"2024-04-17T15:40:58.206917+0000","last_fullsized":"2024-04-17T15:40:58.206917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209083+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:40:58.209083+0000","last_peered":"2024-04-17T15:40:58.209083+0000","last_clean":"2024-04-17T15:40:58.209083+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:40:58.209083+0000","last_undegraded":"2024-04-17T15:40:58.209083+0000","last_fullsized":"2024-04-17T15:40:58.209083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870191+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:40:58.870191+0000","last_peered":"2024-04-17T15:40:58.870191+0000","last_clean":"2024-04-17T15:40:58.870191+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:40:58.870191+0000","last_undegraded":"2024-04-17T15:40:58.870191+0000","last_fullsized":"2024-04-17T15:40:58.870191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512328+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:40:58.512328+0000","last_peered":"2024-04-17T15:40:58.512328+0000","last_clean":"2024-04-17T15:40:58.512328+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:40:58.512328+0000","last_undegraded":"2024-04-17T15:40:58.512328+0000","last_fullsized":"2024-04-17T15:40:58.512328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552057+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:40:58.552057+0000","last_peered":"2024-04-17T15:40:58.552057+0000","last_clean":"2024-04-17T15:40:58.552057+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:40:58.552057+0000","last_undegraded":"2024-04-17T15:40:58.552057+0000","last_fullsized":"2024-04-17T15:40:58.552057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869267+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:40:58.869267+0000","last_peered":"2024-04-17T15:40:58.869267+0000","last_clean":"2024-04-17T15:40:58.869267+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:40:58.869267+0000","last_undegraded":"2024-04-17T15:40:58.869267+0000","last_fullsized":"2024-04-17T15:40:58.869267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'20","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514166+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:40:58.514166+0000","last_peered":"2024-04-17T15:40:58.514166+0000","last_clean":"2024-04-17T15:40:58.514166+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:40:58.514166+0000","last_undegraded":"2024-04-17T15:40:58.514166+0000","last_fullsized":"2024-04-17T15:40:58.514166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830799+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:40:58.830799+0000","last_peered":"2024-04-17T15:40:58.830799+0000","last_clean":"2024-04-17T15:40:58.830799+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:40:58.830799+0000","last_undegraded":"2024-04-17T15:40:58.830799+0000","last_fullsized":"2024-04-17T15:40:58.830799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"111'16","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832080+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:40:58.832080+0000","last_peered":"2024-04-17T15:40:58.832080+0000","last_clean":"2024-04-17T15:40:58.832080+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:40:58.832080+0000","last_undegraded":"2024-04-17T15:40:58.832080+0000","last_fullsized":"2024-04-17T15:40:58.832080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511460+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:40:58.511460+0000","last_peered":"2024-04-17T15:40:58.511460+0000","last_clean":"2024-04-17T15:40:58.511460+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:40:58.511460+0000","last_undegraded":"2024-04-17T15:40:58.511460+0000","last_fullsized":"2024-04-17T15:40:58.511460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'24","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"111'33","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205512+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:40:58.205512+0000","last_peered":"2024-04-17T15:40:58.205512+0000","last_clean":"2024-04-17T15:40:58.205512+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:40:58.205512+0000","last_undegraded":"2024-04-17T15:40:58.205512+0000","last_fullsized":"2024-04-17T15:40:58.205512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870275+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:40:58.870275+0000","last_peered":"2024-04-17T15:40:58.870275+0000","last_clean":"2024-04-17T15:40:58.870275+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:40:58.870275+0000","last_undegraded":"2024-04-17T15:40:58.870275+0000","last_fullsized":"2024-04-17T15:40:58.870275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'14","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206299+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:40:58.206299+0000","last_peered":"2024-04-17T15:40:58.206299+0000","last_clean":"2024-04-17T15:40:58.206299+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:40:58.206299+0000","last_undegraded":"2024-04-17T15:40:58.206299+0000","last_fullsized":"2024-04-17T15:40:58.206299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210809+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:40:58.210809+0000","last_peered":"2024-04-17T15:40:58.210809+0000","last_clean":"2024-04-17T15:40:58.210809+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:40:58.210809+0000","last_undegraded":"2024-04-17T15:40:58.210809+0000","last_fullsized":"2024-04-17T15:40:58.210809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1072,"ondisk_log_size":1072,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":374963,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":619,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":710066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1817384,"kb_used_data":1786196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92554456,"statfs":{"total":96636764160,"available":94775762944,"internally_reserved":0,"allocated":1829064704,"data_stored":1828373077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1179784,"kb_used_data":1148600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93192056,"statfs":{"total":96636764160,"available":95428665344,"internally_reserved":0,"allocated":1176166400,"data_stored":1175509012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716416,"kb_used_data":1681072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92655424,"statfs":{"total":96636764160,"available":94879154176,"internally_reserved":0,"allocated":1721417728,"data_stored":1720711657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898444,"kb_used_data":1867260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473396,"statfs":{"total":96636764160,"available":94692757504,"internally_reserved":0,"allocated":1912074240,"data_stored":1911433504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542199,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812528,"kb_used_data":1777188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92559312,"statfs":{"total":96636764160,"available":94780735488,"internally_reserved":0,"allocated":1819840512,"data_stored":1819161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079304,"kb_used_data":1048120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93292536,"statfs":{"total":96636764160,"available":95531556864,"internally_reserved":0,"allocated":1073274880,"data_stored":1072630977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1103972,"kb_used_data":1072788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93267868,"statfs":{"total":96636764160,"available":95506296832,"internally_reserved":0,"allocated":1098534912,"data_stored":1097857316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1968684,"kb_used_data":1937496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92403156,"statfs":{"total":96636764160,"available":94620831744,"internally_reserved":0,"allocated":1983995904,"data_stored":1983329157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1981808640,"data_stored":1981808640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1096810496,"data_stored":1096810496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1071644672,"data_stored":1071644672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1719664640,"data_stored":1719664640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1174405120,"data_stored":1174405120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1826619392,"data_stored":1826619392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":58539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":118666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":176172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:41:03.304 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-17T15:41:03.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-17T15:41:03.676 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-17T15:41:03.685 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-17T15:41:03.685 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:41:03.686 INFO:tasks.rgw.client.0.smithi044.stdout:2024-04-17T15:41:03.684+0000 7f6917605640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 30959) UID: 0 2024-04-17T15:41:03.686 INFO:tasks.rgw.client.0.smithi044.stdout:2024-04-17T15:41:03.684+0000 7f691ae4da40 -1 shutting down 2024-04-17T15:41:08.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-17T15:41:09.787 INFO:tasks.rgw.client.0:Stopped 2024-04-17T15:41:09.788 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-17T15:41:09.794 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/vault-root-token 2024-04-17T15:41:09.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-17T15:41:09.908 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-17T15:41:09.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-17T15:41:09.908 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-17T15:41:11.234 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-17T15:41:11.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T15:41:11.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:41:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:11.593 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:41:11.608 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-17T15:41:10.328879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300811955,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3304,"num_read_kb":2996,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3899,"ondisk_log_size":3899,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12576468,"kb_used_data":12318720,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":742398252,"statfs":{"total":773094113280,"available":760215810048,"internally_reserved":0,"allocated":12614369280,"data_stored":12609005810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":263835186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007088"},"pg_stats":[{"pgid":"3.3f","version":"111'19","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513762+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:40:58.513762+0000","last_peered":"2024-04-17T15:40:58.513762+0000","last_clean":"2024-04-17T15:40:58.513762+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:40:58.513762+0000","last_undegraded":"2024-04-17T15:40:58.513762+0000","last_fullsized":"2024-04-17T15:40:58.513762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205015+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:40:58.205015+0000","last_peered":"2024-04-17T15:40:58.205015+0000","last_clean":"2024-04-17T15:40:58.205015+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:40:58.205015+0000","last_undegraded":"2024-04-17T15:40:58.205015+0000","last_fullsized":"2024-04-17T15:40:58.205015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"111'27","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207889+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:40:58.207889+0000","last_peered":"2024-04-17T15:40:58.207889+0000","last_clean":"2024-04-17T15:40:58.207889+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:40:58.207889+0000","last_undegraded":"2024-04-17T15:40:58.207889+0000","last_fullsized":"2024-04-17T15:40:58.207889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511785+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:40:58.511785+0000","last_peered":"2024-04-17T15:40:58.511785+0000","last_clean":"2024-04-17T15:40:58.511785+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:40:58.511785+0000","last_undegraded":"2024-04-17T15:40:58.511785+0000","last_fullsized":"2024-04-17T15:40:58.511785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'22","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870782+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:40:58.870782+0000","last_peered":"2024-04-17T15:40:58.870782+0000","last_clean":"2024-04-17T15:40:58.870782+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:40:58.870782+0000","last_undegraded":"2024-04-17T15:40:58.870782+0000","last_fullsized":"2024-04-17T15:40:58.870782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208399+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:40:58.208399+0000","last_peered":"2024-04-17T15:40:58.208399+0000","last_clean":"2024-04-17T15:40:58.208399+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:40:58.208399+0000","last_undegraded":"2024-04-17T15:40:58.208399+0000","last_fullsized":"2024-04-17T15:40:58.208399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'19","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206655+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:40:58.206655+0000","last_peered":"2024-04-17T15:40:58.206655+0000","last_clean":"2024-04-17T15:40:58.206655+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:40:58.206655+0000","last_undegraded":"2024-04-17T15:40:58.206655+0000","last_fullsized":"2024-04-17T15:40:58.206655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869758+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:40:58.869758+0000","last_peered":"2024-04-17T15:40:58.869758+0000","last_clean":"2024-04-17T15:40:58.869758+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:40:58.869758+0000","last_undegraded":"2024-04-17T15:40:58.869758+0000","last_fullsized":"2024-04-17T15:40:58.869758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'31","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512574+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:40:58.512574+0000","last_peered":"2024-04-17T15:40:58.512574+0000","last_clean":"2024-04-17T15:40:58.512574+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:40:58.512574+0000","last_undegraded":"2024-04-17T15:40:58.512574+0000","last_fullsized":"2024-04-17T15:40:58.512574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551803+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:40:58.551803+0000","last_peered":"2024-04-17T15:40:58.551803+0000","last_clean":"2024-04-17T15:40:58.551803+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:40:58.551803+0000","last_undegraded":"2024-04-17T15:40:58.551803+0000","last_fullsized":"2024-04-17T15:40:58.551803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'19","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206172+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:40:58.206172+0000","last_peered":"2024-04-17T15:40:58.206172+0000","last_clean":"2024-04-17T15:40:58.206172+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:40:58.206172+0000","last_undegraded":"2024-04-17T15:40:58.206172+0000","last_fullsized":"2024-04-17T15:40:58.206172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208574+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:40:58.208574+0000","last_peered":"2024-04-17T15:40:58.208574+0000","last_clean":"2024-04-17T15:40:58.208574+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:40:58.208574+0000","last_undegraded":"2024-04-17T15:40:58.208574+0000","last_fullsized":"2024-04-17T15:40:58.208574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512091+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:40:58.512091+0000","last_peered":"2024-04-17T15:40:58.512091+0000","last_clean":"2024-04-17T15:40:58.512091+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:40:58.512091+0000","last_undegraded":"2024-04-17T15:40:58.512091+0000","last_fullsized":"2024-04-17T15:40:58.512091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210663+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:40:58.210663+0000","last_peered":"2024-04-17T15:40:58.210663+0000","last_clean":"2024-04-17T15:40:58.210663+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:40:58.210663+0000","last_undegraded":"2024-04-17T15:40:58.210663+0000","last_fullsized":"2024-04-17T15:40:58.210663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544985+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:40:58.544985+0000","last_peered":"2024-04-17T15:40:58.544985+0000","last_clean":"2024-04-17T15:40:58.544985+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:40:58.544985+0000","last_undegraded":"2024-04-17T15:40:58.544985+0000","last_fullsized":"2024-04-17T15:40:58.544985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832766+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:40:58.832766+0000","last_peered":"2024-04-17T15:40:58.832766+0000","last_clean":"2024-04-17T15:40:58.832766+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:40:58.832766+0000","last_undegraded":"2024-04-17T15:40:58.832766+0000","last_fullsized":"2024-04-17T15:40:58.832766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206425+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:40:58.206425+0000","last_peered":"2024-04-17T15:40:58.206425+0000","last_clean":"2024-04-17T15:40:58.206425+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:40:58.206425+0000","last_undegraded":"2024-04-17T15:40:58.206425+0000","last_fullsized":"2024-04-17T15:40:58.206425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'15","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513874+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:40:58.513874+0000","last_peered":"2024-04-17T15:40:58.513874+0000","last_clean":"2024-04-17T15:40:58.513874+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:40:58.513874+0000","last_undegraded":"2024-04-17T15:40:58.513874+0000","last_fullsized":"2024-04-17T15:40:58.513874+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511961+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:40:58.511961+0000","last_peered":"2024-04-17T15:40:58.511961+0000","last_clean":"2024-04-17T15:40:58.511961+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:40:58.511961+0000","last_undegraded":"2024-04-17T15:40:58.511961+0000","last_fullsized":"2024-04-17T15:40:58.511961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'19","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553294+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:40:58.553294+0000","last_peered":"2024-04-17T15:40:58.553294+0000","last_clean":"2024-04-17T15:40:58.553294+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:40:58.553294+0000","last_undegraded":"2024-04-17T15:40:58.553294+0000","last_fullsized":"2024-04-17T15:40:58.553294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206650+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:40:58.206650+0000","last_peered":"2024-04-17T15:40:58.206650+0000","last_clean":"2024-04-17T15:40:58.206650+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:40:58.206650+0000","last_undegraded":"2024-04-17T15:40:58.206650+0000","last_fullsized":"2024-04-17T15:40:58.206650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553053+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:40:58.553053+0000","last_peered":"2024-04-17T15:40:58.553053+0000","last_clean":"2024-04-17T15:40:58.553053+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:40:58.553053+0000","last_undegraded":"2024-04-17T15:40:58.553053+0000","last_fullsized":"2024-04-17T15:40:58.553053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831158+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:40:58.831158+0000","last_peered":"2024-04-17T15:40:58.831158+0000","last_clean":"2024-04-17T15:40:58.831158+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:40:58.831158+0000","last_undegraded":"2024-04-17T15:40:58.831158+0000","last_fullsized":"2024-04-17T15:40:58.831158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207591+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:40:58.207591+0000","last_peered":"2024-04-17T15:40:58.207591+0000","last_clean":"2024-04-17T15:40:58.207591+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:40:58.207591+0000","last_undegraded":"2024-04-17T15:40:58.207591+0000","last_fullsized":"2024-04-17T15:40:58.207591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"111'20","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545679+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:40:58.545679+0000","last_peered":"2024-04-17T15:40:58.545679+0000","last_clean":"2024-04-17T15:40:58.545679+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:40:58.545679+0000","last_undegraded":"2024-04-17T15:40:58.545679+0000","last_fullsized":"2024-04-17T15:40:58.545679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208742+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:40:58.208742+0000","last_peered":"2024-04-17T15:40:58.208742+0000","last_clean":"2024-04-17T15:40:58.208742+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:40:58.208742+0000","last_undegraded":"2024-04-17T15:40:58.208742+0000","last_fullsized":"2024-04-17T15:40:58.208742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869682+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:40:58.869682+0000","last_peered":"2024-04-17T15:40:58.869682+0000","last_clean":"2024-04-17T15:40:58.869682+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:40:58.869682+0000","last_undegraded":"2024-04-17T15:40:58.869682+0000","last_fullsized":"2024-04-17T15:40:58.869682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206151+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:58.206151+0000","last_peered":"2024-04-17T15:40:58.206151+0000","last_clean":"2024-04-17T15:40:58.206151+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:58.206151+0000","last_undegraded":"2024-04-17T15:40:58.206151+0000","last_fullsized":"2024-04-17T15:40:58.206151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546278+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:40:58.546278+0000","last_peered":"2024-04-17T15:40:58.546278+0000","last_clean":"2024-04-17T15:40:58.546278+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:40:58.546278+0000","last_undegraded":"2024-04-17T15:40:58.546278+0000","last_fullsized":"2024-04-17T15:40:58.546278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'26","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512797+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:40:58.512797+0000","last_peered":"2024-04-17T15:40:58.512797+0000","last_clean":"2024-04-17T15:40:58.512797+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:40:58.512797+0000","last_undegraded":"2024-04-17T15:40:58.512797+0000","last_fullsized":"2024-04-17T15:40:58.512797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210023+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:40:58.210023+0000","last_peered":"2024-04-17T15:40:58.210023+0000","last_clean":"2024-04-17T15:40:58.210023+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:40:58.210023+0000","last_undegraded":"2024-04-17T15:40:58.210023+0000","last_fullsized":"2024-04-17T15:40:58.210023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"112'17","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869909+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:40:58.869909+0000","last_peered":"2024-04-17T15:40:58.869909+0000","last_clean":"2024-04-17T15:40:58.869909+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:40:58.869909+0000","last_undegraded":"2024-04-17T15:40:58.869909+0000","last_fullsized":"2024-04-17T15:40:58.869909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513403+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:58.513403+0000","last_peered":"2024-04-17T15:40:58.513403+0000","last_clean":"2024-04-17T15:40:58.513403+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:58.513403+0000","last_undegraded":"2024-04-17T15:40:58.513403+0000","last_fullsized":"2024-04-17T15:40:58.513403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"112'52","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205103+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:58.205103+0000","last_peered":"2024-04-17T15:40:58.205103+0000","last_clean":"2024-04-17T15:40:58.205103+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:58.205103+0000","last_undegraded":"2024-04-17T15:40:58.205103+0000","last_fullsized":"2024-04-17T15:40:58.205103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211084+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:40:58.211084+0000","last_peered":"2024-04-17T15:40:58.211084+0000","last_clean":"2024-04-17T15:40:58.211084+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:40:58.211084+0000","last_undegraded":"2024-04-17T15:40:58.211084+0000","last_fullsized":"2024-04-17T15:40:58.211084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'18","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869692+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:40:58.869692+0000","last_peered":"2024-04-17T15:40:58.869692+0000","last_clean":"2024-04-17T15:40:58.869692+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:40:58.869692+0000","last_undegraded":"2024-04-17T15:40:58.869692+0000","last_fullsized":"2024-04-17T15:40:58.869692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546176+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:58.546176+0000","last_peered":"2024-04-17T15:40:58.546176+0000","last_clean":"2024-04-17T15:40:58.546176+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:58.546176+0000","last_undegraded":"2024-04-17T15:40:58.546176+0000","last_fullsized":"2024-04-17T15:40:58.546176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212440+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:40:58.212440+0000","last_peered":"2024-04-17T15:40:58.212440+0000","last_clean":"2024-04-17T15:40:58.212440+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:40:58.212440+0000","last_undegraded":"2024-04-17T15:40:58.212440+0000","last_fullsized":"2024-04-17T15:40:58.212440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209905+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:58.209905+0000","last_peered":"2024-04-17T15:40:58.209905+0000","last_clean":"2024-04-17T15:40:58.209905+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:58.209905+0000","last_undegraded":"2024-04-17T15:40:58.209905+0000","last_fullsized":"2024-04-17T15:40:58.209905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869399+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:58.869399+0000","last_peered":"2024-04-17T15:40:58.869399+0000","last_clean":"2024-04-17T15:40:58.869399+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:58.869399+0000","last_undegraded":"2024-04-17T15:40:58.869399+0000","last_fullsized":"2024-04-17T15:40:58.869399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870379+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:40:58.870379+0000","last_peered":"2024-04-17T15:40:58.870379+0000","last_clean":"2024-04-17T15:40:58.870379+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:40:58.870379+0000","last_undegraded":"2024-04-17T15:40:58.870379+0000","last_fullsized":"2024-04-17T15:40:58.870379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'32","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512271+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:40:58.512271+0000","last_peered":"2024-04-17T15:40:58.512271+0000","last_clean":"2024-04-17T15:40:58.512271+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:40:58.512271+0000","last_undegraded":"2024-04-17T15:40:58.512271+0000","last_fullsized":"2024-04-17T15:40:58.512271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544211+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:40:58.544211+0000","last_peered":"2024-04-17T15:40:58.544211+0000","last_clean":"2024-04-17T15:40:58.544211+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:40:58.544211+0000","last_undegraded":"2024-04-17T15:40:58.544211+0000","last_fullsized":"2024-04-17T15:40:58.544211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"73'11","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'135","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519249+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:41:03.519249+0000","last_peered":"2024-04-17T15:41:03.519249+0000","last_clean":"2024-04-17T15:41:03.519249+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:41:03.519249+0000","last_undegraded":"2024-04-17T15:41:03.519249+0000","last_fullsized":"2024-04-17T15:41:03.519249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207086+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:58.207086+0000","last_peered":"2024-04-17T15:40:58.207086+0000","last_clean":"2024-04-17T15:40:58.207086+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:58.207086+0000","last_undegraded":"2024-04-17T15:40:58.207086+0000","last_fullsized":"2024-04-17T15:40:58.207086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546763+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:40:58.546763+0000","last_peered":"2024-04-17T15:40:58.546763+0000","last_clean":"2024-04-17T15:40:58.546763+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:40:58.546763+0000","last_undegraded":"2024-04-17T15:40:58.546763+0000","last_fullsized":"2024-04-17T15:40:58.546763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'33","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550912+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:40:58.550912+0000","last_peered":"2024-04-17T15:40:58.550912+0000","last_clean":"2024-04-17T15:40:58.550912+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:40:58.550912+0000","last_undegraded":"2024-04-17T15:40:58.550912+0000","last_fullsized":"2024-04-17T15:40:58.550912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210404+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:40:58.210404+0000","last_peered":"2024-04-17T15:40:58.210404+0000","last_clean":"2024-04-17T15:40:58.210404+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:40:58.210404+0000","last_undegraded":"2024-04-17T15:40:58.210404+0000","last_fullsized":"2024-04-17T15:40:58.210404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"112'17","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513209+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:40:58.513209+0000","last_peered":"2024-04-17T15:40:58.513209+0000","last_clean":"2024-04-17T15:40:58.513209+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:40:58.513209+0000","last_undegraded":"2024-04-17T15:40:58.513209+0000","last_fullsized":"2024-04-17T15:40:58.513209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'135","reported_seq":478,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519468+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:41:03.519468+0000","last_peered":"2024-04-17T15:41:03.519468+0000","last_clean":"2024-04-17T15:41:03.519468+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:41:03.519468+0000","last_undegraded":"2024-04-17T15:41:03.519468+0000","last_fullsized":"2024-04-17T15:41:03.519468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205567+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:40:58.205567+0000","last_peered":"2024-04-17T15:40:58.205567+0000","last_clean":"2024-04-17T15:40:58.205567+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:40:58.205567+0000","last_undegraded":"2024-04-17T15:40:58.205567+0000","last_fullsized":"2024-04-17T15:40:58.205567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513868+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:40:58.513868+0000","last_peered":"2024-04-17T15:40:58.513868+0000","last_clean":"2024-04-17T15:40:58.513868+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:40:58.513868+0000","last_undegraded":"2024-04-17T15:40:58.513868+0000","last_fullsized":"2024-04-17T15:40:58.513868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511485+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:40:58.511485+0000","last_peered":"2024-04-17T15:40:58.511485+0000","last_clean":"2024-04-17T15:40:58.511485+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:40:58.511485+0000","last_undegraded":"2024-04-17T15:40:58.511485+0000","last_fullsized":"2024-04-17T15:40:58.511485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"112'27","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205385+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:40:58.205385+0000","last_peered":"2024-04-17T15:40:58.205385+0000","last_clean":"2024-04-17T15:40:58.205385+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:40:58.205385+0000","last_undegraded":"2024-04-17T15:40:58.205385+0000","last_fullsized":"2024-04-17T15:40:58.205385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206195+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:40:58.206195+0000","last_peered":"2024-04-17T15:40:58.206195+0000","last_clean":"2024-04-17T15:40:58.206195+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:40:58.206195+0000","last_undegraded":"2024-04-17T15:40:58.206195+0000","last_fullsized":"2024-04-17T15:40:58.206195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206198+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:40:58.206198+0000","last_peered":"2024-04-17T15:40:58.206198+0000","last_clean":"2024-04-17T15:40:58.206198+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:40:58.206198+0000","last_undegraded":"2024-04-17T15:40:58.206198+0000","last_fullsized":"2024-04-17T15:40:58.206198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207810+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:40:58.207810+0000","last_peered":"2024-04-17T15:40:58.207810+0000","last_clean":"2024-04-17T15:40:58.207810+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:40:58.207810+0000","last_undegraded":"2024-04-17T15:40:58.207810+0000","last_fullsized":"2024-04-17T15:40:58.207810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'11","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513901+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:40:58.513901+0000","last_peered":"2024-04-17T15:40:58.513901+0000","last_clean":"2024-04-17T15:40:58.513901+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:40:58.513901+0000","last_undegraded":"2024-04-17T15:40:58.513901+0000","last_fullsized":"2024-04-17T15:40:58.513901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830647+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:40:58.830647+0000","last_peered":"2024-04-17T15:40:58.830647+0000","last_clean":"2024-04-17T15:40:58.830647+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:40:58.830647+0000","last_undegraded":"2024-04-17T15:40:58.830647+0000","last_fullsized":"2024-04-17T15:40:58.830647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"112'18","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546024+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:40:58.546024+0000","last_peered":"2024-04-17T15:40:58.546024+0000","last_clean":"2024-04-17T15:40:58.546024+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:40:58.546024+0000","last_undegraded":"2024-04-17T15:40:58.546024+0000","last_fullsized":"2024-04-17T15:40:58.546024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544949+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:40:58.544949+0000","last_peered":"2024-04-17T15:40:58.544949+0000","last_clean":"2024-04-17T15:40:58.544949+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:40:58.544949+0000","last_undegraded":"2024-04-17T15:40:58.544949+0000","last_fullsized":"2024-04-17T15:40:58.544949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553003+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:40:58.553003+0000","last_peered":"2024-04-17T15:40:58.553003+0000","last_clean":"2024-04-17T15:40:58.553003+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:40:58.553003+0000","last_undegraded":"2024-04-17T15:40:58.553003+0000","last_fullsized":"2024-04-17T15:40:58.553003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551609+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:40:58.551609+0000","last_peered":"2024-04-17T15:40:58.551609+0000","last_clean":"2024-04-17T15:40:58.551609+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:40:58.551609+0000","last_undegraded":"2024-04-17T15:40:58.551609+0000","last_fullsized":"2024-04-17T15:40:58.551609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'20","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513891+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:40:58.513891+0000","last_peered":"2024-04-17T15:40:58.513891+0000","last_clean":"2024-04-17T15:40:58.513891+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:40:58.513891+0000","last_undegraded":"2024-04-17T15:40:58.513891+0000","last_fullsized":"2024-04-17T15:40:58.513891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831481+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:40:58.831481+0000","last_peered":"2024-04-17T15:40:58.831481+0000","last_clean":"2024-04-17T15:40:58.831481+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:40:58.831481+0000","last_undegraded":"2024-04-17T15:40:58.831481+0000","last_fullsized":"2024-04-17T15:40:58.831481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"112'25","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512245+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:40:58.512245+0000","last_peered":"2024-04-17T15:40:58.512245+0000","last_clean":"2024-04-17T15:40:58.512245+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:40:58.512245+0000","last_undegraded":"2024-04-17T15:40:58.512245+0000","last_fullsized":"2024-04-17T15:40:58.512245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62305,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"130'135","reported_seq":401,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519440+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:41:03.519440+0000","last_peered":"2024-04-17T15:41:03.519440+0000","last_clean":"2024-04-17T15:41:03.519440+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:41:03.519440+0000","last_undegraded":"2024-04-17T15:41:03.519440+0000","last_fullsized":"2024-04-17T15:41:03.519440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869978+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:40:58.869978+0000","last_peered":"2024-04-17T15:40:58.869978+0000","last_clean":"2024-04-17T15:40:58.869978+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:40:58.869978+0000","last_undegraded":"2024-04-17T15:40:58.869978+0000","last_fullsized":"2024-04-17T15:40:58.869978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870694+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:40:58.870694+0000","last_peered":"2024-04-17T15:40:58.870694+0000","last_clean":"2024-04-17T15:40:58.870694+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:40:58.870694+0000","last_undegraded":"2024-04-17T15:40:58.870694+0000","last_fullsized":"2024-04-17T15:40:58.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207153+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:40:58.207153+0000","last_peered":"2024-04-17T15:40:58.207153+0000","last_clean":"2024-04-17T15:40:58.207153+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:40:58.207153+0000","last_undegraded":"2024-04-17T15:40:58.207153+0000","last_fullsized":"2024-04-17T15:40:58.207153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830470+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:40:58.830470+0000","last_peered":"2024-04-17T15:40:58.830470+0000","last_clean":"2024-04-17T15:40:58.830470+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:40:58.830470+0000","last_undegraded":"2024-04-17T15:40:58.830470+0000","last_fullsized":"2024-04-17T15:40:58.830470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"112'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869252+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:40:58.869252+0000","last_peered":"2024-04-17T15:40:58.869252+0000","last_clean":"2024-04-17T15:40:58.869252+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:40:58.869252+0000","last_undegraded":"2024-04-17T15:40:58.869252+0000","last_fullsized":"2024-04-17T15:40:58.869252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830535+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:40:58.830535+0000","last_peered":"2024-04-17T15:40:58.830535+0000","last_clean":"2024-04-17T15:40:58.830535+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:40:58.830535+0000","last_undegraded":"2024-04-17T15:40:58.830535+0000","last_fullsized":"2024-04-17T15:40:58.830535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207046+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:40:58.207046+0000","last_peered":"2024-04-17T15:40:58.207046+0000","last_clean":"2024-04-17T15:40:58.207046+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:40:58.207046+0000","last_undegraded":"2024-04-17T15:40:58.207046+0000","last_fullsized":"2024-04-17T15:40:58.207046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208754+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:40:58.208754+0000","last_peered":"2024-04-17T15:40:58.208754+0000","last_clean":"2024-04-17T15:40:58.208754+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:40:58.208754+0000","last_undegraded":"2024-04-17T15:40:58.208754+0000","last_fullsized":"2024-04-17T15:40:58.208754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545192+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:40:58.545192+0000","last_peered":"2024-04-17T15:40:58.545192+0000","last_clean":"2024-04-17T15:40:58.545192+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:40:58.545192+0000","last_undegraded":"2024-04-17T15:40:58.545192+0000","last_fullsized":"2024-04-17T15:40:58.545192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"112'19","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209917+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:40:58.209917+0000","last_peered":"2024-04-17T15:40:58.209917+0000","last_clean":"2024-04-17T15:40:58.209917+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:40:58.209917+0000","last_undegraded":"2024-04-17T15:40:58.209917+0000","last_fullsized":"2024-04-17T15:40:58.209917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870126+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:40:58.870126+0000","last_peered":"2024-04-17T15:40:58.870126+0000","last_clean":"2024-04-17T15:40:58.870126+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:40:58.870126+0000","last_undegraded":"2024-04-17T15:40:58.870126+0000","last_fullsized":"2024-04-17T15:40:58.870126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544417+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:40:58.544417+0000","last_peered":"2024-04-17T15:40:58.544417+0000","last_clean":"2024-04-17T15:40:58.544417+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:40:58.544417+0000","last_undegraded":"2024-04-17T15:40:58.544417+0000","last_fullsized":"2024-04-17T15:40:58.544417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209073+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:40:58.209073+0000","last_peered":"2024-04-17T15:40:58.209073+0000","last_clean":"2024-04-17T15:40:58.209073+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:40:58.209073+0000","last_undegraded":"2024-04-17T15:40:58.209073+0000","last_fullsized":"2024-04-17T15:40:58.209073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551850+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:40:58.551850+0000","last_peered":"2024-04-17T15:40:58.551850+0000","last_clean":"2024-04-17T15:40:58.551850+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:40:58.551850+0000","last_undegraded":"2024-04-17T15:40:58.551850+0000","last_fullsized":"2024-04-17T15:40:58.551850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206959+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:40:58.206959+0000","last_peered":"2024-04-17T15:40:58.206959+0000","last_clean":"2024-04-17T15:40:58.206959+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:40:58.206959+0000","last_undegraded":"2024-04-17T15:40:58.206959+0000","last_fullsized":"2024-04-17T15:40:58.206959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"112'23","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832235+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:40:58.832235+0000","last_peered":"2024-04-17T15:40:58.832235+0000","last_clean":"2024-04-17T15:40:58.832235+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:40:58.832235+0000","last_undegraded":"2024-04-17T15:40:58.832235+0000","last_fullsized":"2024-04-17T15:40:58.832235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"130'135","reported_seq":444,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519440+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:41:03.519440+0000","last_peered":"2024-04-17T15:41:03.519440+0000","last_clean":"2024-04-17T15:41:03.519440+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:41:03.519440+0000","last_undegraded":"2024-04-17T15:41:03.519440+0000","last_fullsized":"2024-04-17T15:41:03.519440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205716+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:40:58.205716+0000","last_peered":"2024-04-17T15:40:58.205716+0000","last_clean":"2024-04-17T15:40:58.205716+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:40:58.205716+0000","last_undegraded":"2024-04-17T15:40:58.205716+0000","last_fullsized":"2024-04-17T15:40:58.205716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212582+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:40:58.212582+0000","last_peered":"2024-04-17T15:40:58.212582+0000","last_clean":"2024-04-17T15:40:58.212582+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:40:58.212582+0000","last_undegraded":"2024-04-17T15:40:58.212582+0000","last_fullsized":"2024-04-17T15:40:58.212582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208751+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:40:58.208751+0000","last_peered":"2024-04-17T15:40:58.208751+0000","last_clean":"2024-04-17T15:40:58.208751+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:40:58.208751+0000","last_undegraded":"2024-04-17T15:40:58.208751+0000","last_fullsized":"2024-04-17T15:40:58.208751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210704+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:40:58.210704+0000","last_peered":"2024-04-17T15:40:58.210704+0000","last_clean":"2024-04-17T15:40:58.210704+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:40:58.210704+0000","last_undegraded":"2024-04-17T15:40:58.210704+0000","last_fullsized":"2024-04-17T15:40:58.210704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545986+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:40:58.545986+0000","last_peered":"2024-04-17T15:40:58.545986+0000","last_clean":"2024-04-17T15:40:58.545986+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:40:58.545986+0000","last_undegraded":"2024-04-17T15:40:58.545986+0000","last_fullsized":"2024-04-17T15:40:58.545986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"130'135","reported_seq":451,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519326+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:41:03.519326+0000","last_peered":"2024-04-17T15:41:03.519326+0000","last_clean":"2024-04-17T15:41:03.519326+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:41:03.519326+0000","last_undegraded":"2024-04-17T15:41:03.519326+0000","last_fullsized":"2024-04-17T15:41:03.519326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208093+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:40:58.208093+0000","last_peered":"2024-04-17T15:40:58.208093+0000","last_clean":"2024-04-17T15:40:58.208093+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:40:58.208093+0000","last_undegraded":"2024-04-17T15:40:58.208093+0000","last_fullsized":"2024-04-17T15:40:58.208093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208922+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:40:58.208922+0000","last_peered":"2024-04-17T15:40:58.208922+0000","last_clean":"2024-04-17T15:40:58.208922+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:40:58.208922+0000","last_undegraded":"2024-04-17T15:40:58.208922+0000","last_fullsized":"2024-04-17T15:40:58.208922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545320+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:40:58.545320+0000","last_peered":"2024-04-17T15:40:58.545320+0000","last_clean":"2024-04-17T15:40:58.545320+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:40:58.545320+0000","last_undegraded":"2024-04-17T15:40:58.545320+0000","last_fullsized":"2024-04-17T15:40:58.545320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212265+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:40:58.212265+0000","last_peered":"2024-04-17T15:40:58.212265+0000","last_clean":"2024-04-17T15:40:58.212265+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:40:58.212265+0000","last_undegraded":"2024-04-17T15:40:58.212265+0000","last_fullsized":"2024-04-17T15:40:58.212265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"112'25","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209728+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:40:58.209728+0000","last_peered":"2024-04-17T15:40:58.209728+0000","last_clean":"2024-04-17T15:40:58.209728+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:40:58.209728+0000","last_undegraded":"2024-04-17T15:40:58.209728+0000","last_fullsized":"2024-04-17T15:40:58.209728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551513+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:40:58.551513+0000","last_peered":"2024-04-17T15:40:58.551513+0000","last_clean":"2024-04-17T15:40:58.551513+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:40:58.551513+0000","last_undegraded":"2024-04-17T15:40:58.551513+0000","last_fullsized":"2024-04-17T15:40:58.551513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206128+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:40:58.206128+0000","last_peered":"2024-04-17T15:40:58.206128+0000","last_clean":"2024-04-17T15:40:58.206128+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:40:58.206128+0000","last_undegraded":"2024-04-17T15:40:58.206128+0000","last_fullsized":"2024-04-17T15:40:58.206128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552674+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:40:58.552674+0000","last_peered":"2024-04-17T15:40:58.552674+0000","last_clean":"2024-04-17T15:40:58.552674+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:40:58.552674+0000","last_undegraded":"2024-04-17T15:40:58.552674+0000","last_fullsized":"2024-04-17T15:40:58.552674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":387,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512174+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:58.512174+0000","last_peered":"2024-04-17T15:40:58.512174+0000","last_clean":"2024-04-17T15:40:58.512174+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:58.512174+0000","last_undegraded":"2024-04-17T15:40:58.512174+0000","last_fullsized":"2024-04-17T15:40:58.512174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206221+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:40:58.206221+0000","last_peered":"2024-04-17T15:40:58.206221+0000","last_clean":"2024-04-17T15:40:58.206221+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:40:58.206221+0000","last_undegraded":"2024-04-17T15:40:58.206221+0000","last_fullsized":"2024-04-17T15:40:58.206221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"112'21","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545289+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:40:58.545289+0000","last_peered":"2024-04-17T15:40:58.545289+0000","last_clean":"2024-04-17T15:40:58.545289+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:40:58.545289+0000","last_undegraded":"2024-04-17T15:40:58.545289+0000","last_fullsized":"2024-04-17T15:40:58.545289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512461+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:40:58.512461+0000","last_peered":"2024-04-17T15:40:58.512461+0000","last_clean":"2024-04-17T15:40:58.512461+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:40:58.512461+0000","last_undegraded":"2024-04-17T15:40:58.512461+0000","last_fullsized":"2024-04-17T15:40:58.512461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"112'37","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210978+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:40:58.210978+0000","last_peered":"2024-04-17T15:40:58.210978+0000","last_clean":"2024-04-17T15:40:58.210978+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:40:58.210978+0000","last_undegraded":"2024-04-17T15:40:58.210978+0000","last_fullsized":"2024-04-17T15:40:58.210978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870042+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:40:58.870042+0000","last_peered":"2024-04-17T15:40:58.870042+0000","last_clean":"2024-04-17T15:40:58.870042+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:40:58.870042+0000","last_undegraded":"2024-04-17T15:40:58.870042+0000","last_fullsized":"2024-04-17T15:40:58.870042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550525+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:40:58.550525+0000","last_peered":"2024-04-17T15:40:58.550525+0000","last_clean":"2024-04-17T15:40:58.550525+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:40:58.550525+0000","last_undegraded":"2024-04-17T15:40:58.550525+0000","last_fullsized":"2024-04-17T15:40:58.550525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870224+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:40:58.870224+0000","last_peered":"2024-04-17T15:40:58.870224+0000","last_clean":"2024-04-17T15:40:58.870224+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:40:58.870224+0000","last_undegraded":"2024-04-17T15:40:58.870224+0000","last_fullsized":"2024-04-17T15:40:58.870224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511901+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:58.511901+0000","last_peered":"2024-04-17T15:40:58.511901+0000","last_clean":"2024-04-17T15:40:58.511901+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:58.511901+0000","last_undegraded":"2024-04-17T15:40:58.511901+0000","last_fullsized":"2024-04-17T15:40:58.511901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'28","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869363+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:40:58.869363+0000","last_peered":"2024-04-17T15:40:58.869363+0000","last_clean":"2024-04-17T15:40:58.869363+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:40:58.869363+0000","last_undegraded":"2024-04-17T15:40:58.869363+0000","last_fullsized":"2024-04-17T15:40:58.869363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211844+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:40:58.211844+0000","last_peered":"2024-04-17T15:40:58.211844+0000","last_clean":"2024-04-17T15:40:58.211844+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:40:58.211844+0000","last_undegraded":"2024-04-17T15:40:58.211844+0000","last_fullsized":"2024-04-17T15:40:58.211844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"130'138","reported_seq":470,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519462+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:41:03.519462+0000","last_peered":"2024-04-17T15:41:03.519462+0000","last_clean":"2024-04-17T15:41:03.519462+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:41:03.519462+0000","last_undegraded":"2024-04-17T15:41:03.519462+0000","last_fullsized":"2024-04-17T15:41:03.519462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513073+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:40:58.513073+0000","last_peered":"2024-04-17T15:40:58.513073+0000","last_clean":"2024-04-17T15:40:58.513073+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:40:58.513073+0000","last_undegraded":"2024-04-17T15:40:58.513073+0000","last_fullsized":"2024-04-17T15:40:58.513073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205369+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:40:58.205369+0000","last_peered":"2024-04-17T15:40:58.205369+0000","last_clean":"2024-04-17T15:40:58.205369+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:40:58.205369+0000","last_undegraded":"2024-04-17T15:40:58.205369+0000","last_fullsized":"2024-04-17T15:40:58.205369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208927+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:40:58.208927+0000","last_peered":"2024-04-17T15:40:58.208927+0000","last_clean":"2024-04-17T15:40:58.208927+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:40:58.208927+0000","last_undegraded":"2024-04-17T15:40:58.208927+0000","last_fullsized":"2024-04-17T15:40:58.208927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831329+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:40:58.831329+0000","last_peered":"2024-04-17T15:40:58.831329+0000","last_clean":"2024-04-17T15:40:58.831329+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:40:58.831329+0000","last_undegraded":"2024-04-17T15:40:58.831329+0000","last_fullsized":"2024-04-17T15:40:58.831329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205552+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:40:58.205552+0000","last_peered":"2024-04-17T15:40:58.205552+0000","last_clean":"2024-04-17T15:40:58.205552+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:40:58.205552+0000","last_undegraded":"2024-04-17T15:40:58.205552+0000","last_fullsized":"2024-04-17T15:40:58.205552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830548+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:40:58.830548+0000","last_peered":"2024-04-17T15:40:58.830548+0000","last_clean":"2024-04-17T15:40:58.830548+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:40:58.830548+0000","last_undegraded":"2024-04-17T15:40:58.830548+0000","last_fullsized":"2024-04-17T15:40:58.830548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'17","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519403+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:41:03.519403+0000","last_peered":"2024-04-17T15:41:03.519403+0000","last_clean":"2024-04-17T15:41:03.519403+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:41:03.519403+0000","last_undegraded":"2024-04-17T15:41:03.519403+0000","last_fullsized":"2024-04-17T15:41:03.519403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869471+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:40:58.869471+0000","last_peered":"2024-04-17T15:40:58.869471+0000","last_clean":"2024-04-17T15:40:58.869471+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:40:58.869471+0000","last_undegraded":"2024-04-17T15:40:58.869471+0000","last_fullsized":"2024-04-17T15:40:58.869471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545821+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:40:58.545821+0000","last_peered":"2024-04-17T15:40:58.545821+0000","last_clean":"2024-04-17T15:40:58.545821+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:40:58.545821+0000","last_undegraded":"2024-04-17T15:40:58.545821+0000","last_fullsized":"2024-04-17T15:40:58.545821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207544+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:40:58.207544+0000","last_peered":"2024-04-17T15:40:58.207544+0000","last_clean":"2024-04-17T15:40:58.207544+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:40:58.207544+0000","last_undegraded":"2024-04-17T15:40:58.207544+0000","last_fullsized":"2024-04-17T15:40:58.207544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207531+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:58.207531+0000","last_peered":"2024-04-17T15:40:58.207531+0000","last_clean":"2024-04-17T15:40:58.207531+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:58.207531+0000","last_undegraded":"2024-04-17T15:40:58.207531+0000","last_fullsized":"2024-04-17T15:40:58.207531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'24","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208931+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:40:58.208931+0000","last_peered":"2024-04-17T15:40:58.208931+0000","last_clean":"2024-04-17T15:40:58.208931+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:40:58.208931+0000","last_undegraded":"2024-04-17T15:40:58.208931+0000","last_fullsized":"2024-04-17T15:40:58.208931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868736+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:40:58.868736+0000","last_peered":"2024-04-17T15:40:58.868736+0000","last_clean":"2024-04-17T15:40:58.868736+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:40:58.868736+0000","last_undegraded":"2024-04-17T15:40:58.868736+0000","last_fullsized":"2024-04-17T15:40:58.868736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547104+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:40:58.547104+0000","last_peered":"2024-04-17T15:40:58.547104+0000","last_clean":"2024-04-17T15:40:58.547104+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:40:58.547104+0000","last_undegraded":"2024-04-17T15:40:58.547104+0000","last_fullsized":"2024-04-17T15:40:58.547104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553452+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:40:58.553452+0000","last_peered":"2024-04-17T15:40:58.553452+0000","last_clean":"2024-04-17T15:40:58.553452+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:40:58.553452+0000","last_undegraded":"2024-04-17T15:40:58.553452+0000","last_fullsized":"2024-04-17T15:40:58.553452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.204708+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:40:58.204708+0000","last_peered":"2024-04-17T15:40:58.204708+0000","last_clean":"2024-04-17T15:40:58.204708+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:40:58.204708+0000","last_undegraded":"2024-04-17T15:40:58.204708+0000","last_fullsized":"2024-04-17T15:40:58.204708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205991+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:40:58.205991+0000","last_peered":"2024-04-17T15:40:58.205991+0000","last_clean":"2024-04-17T15:40:58.205991+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:40:58.205991+0000","last_undegraded":"2024-04-17T15:40:58.205991+0000","last_fullsized":"2024-04-17T15:40:58.205991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211753+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:40:58.211753+0000","last_peered":"2024-04-17T15:40:58.211753+0000","last_clean":"2024-04-17T15:40:58.211753+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:40:58.211753+0000","last_undegraded":"2024-04-17T15:40:58.211753+0000","last_fullsized":"2024-04-17T15:40:58.211753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208313+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:40:58.208313+0000","last_peered":"2024-04-17T15:40:58.208313+0000","last_clean":"2024-04-17T15:40:58.208313+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:40:58.208313+0000","last_undegraded":"2024-04-17T15:40:58.208313+0000","last_fullsized":"2024-04-17T15:40:58.208313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870049+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:40:58.870049+0000","last_peered":"2024-04-17T15:40:58.870049+0000","last_clean":"2024-04-17T15:40:58.870049+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:40:58.870049+0000","last_undegraded":"2024-04-17T15:40:58.870049+0000","last_fullsized":"2024-04-17T15:40:58.870049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"112'34","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869261+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:40:58.869261+0000","last_peered":"2024-04-17T15:40:58.869261+0000","last_clean":"2024-04-17T15:40:58.869261+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:40:58.869261+0000","last_undegraded":"2024-04-17T15:40:58.869261+0000","last_fullsized":"2024-04-17T15:40:58.869261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207208+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:40:58.207208+0000","last_peered":"2024-04-17T15:40:58.207208+0000","last_clean":"2024-04-17T15:40:58.207208+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:40:58.207208+0000","last_undegraded":"2024-04-17T15:40:58.207208+0000","last_fullsized":"2024-04-17T15:40:58.207208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869786+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:40:58.869786+0000","last_peered":"2024-04-17T15:40:58.869786+0000","last_clean":"2024-04-17T15:40:58.869786+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:40:58.869786+0000","last_undegraded":"2024-04-17T15:40:58.869786+0000","last_fullsized":"2024-04-17T15:40:58.869786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870655+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:40:58.870655+0000","last_peered":"2024-04-17T15:40:58.870655+0000","last_clean":"2024-04-17T15:40:58.870655+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:40:58.870655+0000","last_undegraded":"2024-04-17T15:40:58.870655+0000","last_fullsized":"2024-04-17T15:40:58.870655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'21","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207826+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:40:58.207826+0000","last_peered":"2024-04-17T15:40:58.207826+0000","last_clean":"2024-04-17T15:40:58.207826+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:40:58.207826+0000","last_undegraded":"2024-04-17T15:40:58.207826+0000","last_fullsized":"2024-04-17T15:40:58.207826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514348+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:40:58.514348+0000","last_peered":"2024-04-17T15:40:58.514348+0000","last_clean":"2024-04-17T15:40:58.514348+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:40:58.514348+0000","last_undegraded":"2024-04-17T15:40:58.514348+0000","last_fullsized":"2024-04-17T15:40:58.514348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551315+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:40:58.551315+0000","last_peered":"2024-04-17T15:40:58.551315+0000","last_clean":"2024-04-17T15:40:58.551315+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:40:58.551315+0000","last_undegraded":"2024-04-17T15:40:58.551315+0000","last_fullsized":"2024-04-17T15:40:58.551315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205169+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:40:58.205169+0000","last_peered":"2024-04-17T15:40:58.205169+0000","last_clean":"2024-04-17T15:40:58.205169+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:40:58.205169+0000","last_undegraded":"2024-04-17T15:40:58.205169+0000","last_fullsized":"2024-04-17T15:40:58.205169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"130'135","reported_seq":401,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519253+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:41:03.519253+0000","last_peered":"2024-04-17T15:41:03.519253+0000","last_clean":"2024-04-17T15:41:03.519253+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:41:03.519253+0000","last_undegraded":"2024-04-17T15:41:03.519253+0000","last_fullsized":"2024-04-17T15:41:03.519253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546955+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:40:58.546955+0000","last_peered":"2024-04-17T15:40:58.546955+0000","last_clean":"2024-04-17T15:40:58.546955+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:40:58.546955+0000","last_undegraded":"2024-04-17T15:40:58.546955+0000","last_fullsized":"2024-04-17T15:40:58.546955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544700+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:40:58.544700+0000","last_peered":"2024-04-17T15:40:58.544700+0000","last_clean":"2024-04-17T15:40:58.544700+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:40:58.544700+0000","last_undegraded":"2024-04-17T15:40:58.544700+0000","last_fullsized":"2024-04-17T15:40:58.544700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'20","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546637+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:40:58.546637+0000","last_peered":"2024-04-17T15:40:58.546637+0000","last_clean":"2024-04-17T15:40:58.546637+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:40:58.546637+0000","last_undegraded":"2024-04-17T15:40:58.546637+0000","last_fullsized":"2024-04-17T15:40:58.546637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208024+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:40:58.208024+0000","last_peered":"2024-04-17T15:40:58.208024+0000","last_clean":"2024-04-17T15:40:58.208024+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:40:58.208024+0000","last_undegraded":"2024-04-17T15:40:58.208024+0000","last_fullsized":"2024-04-17T15:40:58.208024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207721+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:40:58.207721+0000","last_peered":"2024-04-17T15:40:58.207721+0000","last_clean":"2024-04-17T15:40:58.207721+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:40:58.207721+0000","last_undegraded":"2024-04-17T15:40:58.207721+0000","last_fullsized":"2024-04-17T15:40:58.207721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208760+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:40:58.208760+0000","last_peered":"2024-04-17T15:40:58.208760+0000","last_clean":"2024-04-17T15:40:58.208760+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:40:58.208760+0000","last_undegraded":"2024-04-17T15:40:58.208760+0000","last_fullsized":"2024-04-17T15:40:58.208760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'135","reported_seq":400,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519487+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:41:03.519487+0000","last_peered":"2024-04-17T15:41:03.519487+0000","last_clean":"2024-04-17T15:41:03.519487+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:41:03.519487+0000","last_undegraded":"2024-04-17T15:41:03.519487+0000","last_fullsized":"2024-04-17T15:41:03.519487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869584+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:40:58.869584+0000","last_peered":"2024-04-17T15:40:58.869584+0000","last_clean":"2024-04-17T15:40:58.869584+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:40:58.869584+0000","last_undegraded":"2024-04-17T15:40:58.869584+0000","last_fullsized":"2024-04-17T15:40:58.869584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208160+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:40:58.208160+0000","last_peered":"2024-04-17T15:40:58.208160+0000","last_clean":"2024-04-17T15:40:58.208160+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:40:58.208160+0000","last_undegraded":"2024-04-17T15:40:58.208160+0000","last_fullsized":"2024-04-17T15:40:58.208160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870384+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:40:58.870384+0000","last_peered":"2024-04-17T15:40:58.870384+0000","last_clean":"2024-04-17T15:40:58.870384+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:40:58.870384+0000","last_undegraded":"2024-04-17T15:40:58.870384+0000","last_fullsized":"2024-04-17T15:40:58.870384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553838+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:40:58.553838+0000","last_peered":"2024-04-17T15:40:58.553838+0000","last_clean":"2024-04-17T15:40:58.553838+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:40:58.553838+0000","last_undegraded":"2024-04-17T15:40:58.553838+0000","last_fullsized":"2024-04-17T15:40:58.553838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544172+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:40:58.544172+0000","last_peered":"2024-04-17T15:40:58.544172+0000","last_clean":"2024-04-17T15:40:58.544172+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:40:58.544172+0000","last_undegraded":"2024-04-17T15:40:58.544172+0000","last_fullsized":"2024-04-17T15:40:58.544172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"112'46","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511814+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:40:58.511814+0000","last_peered":"2024-04-17T15:40:58.511814+0000","last_clean":"2024-04-17T15:40:58.511814+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:40:58.511814+0000","last_undegraded":"2024-04-17T15:40:58.511814+0000","last_fullsized":"2024-04-17T15:40:58.511814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":28,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545031+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:40:58.545031+0000","last_peered":"2024-04-17T15:40:58.545031+0000","last_clean":"2024-04-17T15:40:58.545031+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:40:58.545031+0000","last_undegraded":"2024-04-17T15:40:58.545031+0000","last_fullsized":"2024-04-17T15:40:58.545031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205831+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:40:58.205831+0000","last_peered":"2024-04-17T15:40:58.205831+0000","last_clean":"2024-04-17T15:40:58.205831+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:40:58.205831+0000","last_undegraded":"2024-04-17T15:40:58.205831+0000","last_fullsized":"2024-04-17T15:40:58.205831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869887+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:40:58.869887+0000","last_peered":"2024-04-17T15:40:58.869887+0000","last_clean":"2024-04-17T15:40:58.869887+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:40:58.869887+0000","last_undegraded":"2024-04-17T15:40:58.869887+0000","last_fullsized":"2024-04-17T15:40:58.869887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207678+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:40:58.207678+0000","last_peered":"2024-04-17T15:40:58.207678+0000","last_clean":"2024-04-17T15:40:58.207678+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:40:58.207678+0000","last_undegraded":"2024-04-17T15:40:58.207678+0000","last_fullsized":"2024-04-17T15:40:58.207678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'27","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207428+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:40:58.207428+0000","last_peered":"2024-04-17T15:40:58.207428+0000","last_clean":"2024-04-17T15:40:58.207428+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:40:58.207428+0000","last_undegraded":"2024-04-17T15:40:58.207428+0000","last_fullsized":"2024-04-17T15:40:58.207428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205988+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:40:58.205988+0000","last_peered":"2024-04-17T15:40:58.205988+0000","last_clean":"2024-04-17T15:40:58.205988+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:40:58.205988+0000","last_undegraded":"2024-04-17T15:40:58.205988+0000","last_fullsized":"2024-04-17T15:40:58.205988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"112'19","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544621+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:40:58.544621+0000","last_peered":"2024-04-17T15:40:58.544621+0000","last_clean":"2024-04-17T15:40:58.544621+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:40:58.544621+0000","last_undegraded":"2024-04-17T15:40:58.544621+0000","last_fullsized":"2024-04-17T15:40:58.544621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544482+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:40:58.544482+0000","last_peered":"2024-04-17T15:40:58.544482+0000","last_clean":"2024-04-17T15:40:58.544482+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:40:58.544482+0000","last_undegraded":"2024-04-17T15:40:58.544482+0000","last_fullsized":"2024-04-17T15:40:58.544482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546660+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:40:58.546660+0000","last_peered":"2024-04-17T15:40:58.546660+0000","last_clean":"2024-04-17T15:40:58.546660+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:40:58.546660+0000","last_undegraded":"2024-04-17T15:40:58.546660+0000","last_fullsized":"2024-04-17T15:40:58.546660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":195,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205059+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:58.205059+0000","last_peered":"2024-04-17T15:40:58.205059+0000","last_clean":"2024-04-17T15:40:58.205059+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:58.205059+0000","last_undegraded":"2024-04-17T15:40:58.205059+0000","last_fullsized":"2024-04-17T15:40:58.205059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513793+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:40:58.513793+0000","last_peered":"2024-04-17T15:40:58.513793+0000","last_clean":"2024-04-17T15:40:58.513793+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:40:58.513793+0000","last_undegraded":"2024-04-17T15:40:58.513793+0000","last_fullsized":"2024-04-17T15:40:58.513793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545728+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:40:58.545728+0000","last_peered":"2024-04-17T15:40:58.545728+0000","last_clean":"2024-04-17T15:40:58.545728+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:40:58.545728+0000","last_undegraded":"2024-04-17T15:40:58.545728+0000","last_fullsized":"2024-04-17T15:40:58.545728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'9","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869028+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:58.869028+0000","last_peered":"2024-04-17T15:40:58.869028+0000","last_clean":"2024-04-17T15:40:58.869028+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:58.869028+0000","last_undegraded":"2024-04-17T15:40:58.869028+0000","last_fullsized":"2024-04-17T15:40:58.869028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511688+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:58.511688+0000","last_peered":"2024-04-17T15:40:58.511688+0000","last_clean":"2024-04-17T15:40:58.511688+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:58.511688+0000","last_undegraded":"2024-04-17T15:40:58.511688+0000","last_fullsized":"2024-04-17T15:40:58.511688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870459+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:58.870459+0000","last_peered":"2024-04-17T15:40:58.870459+0000","last_clean":"2024-04-17T15:40:58.870459+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:58.870459+0000","last_undegraded":"2024-04-17T15:40:58.870459+0000","last_fullsized":"2024-04-17T15:40:58.870459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544795+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:40:58.544795+0000","last_peered":"2024-04-17T15:40:58.544795+0000","last_clean":"2024-04-17T15:40:58.544795+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:40:58.544795+0000","last_undegraded":"2024-04-17T15:40:58.544795+0000","last_fullsized":"2024-04-17T15:40:58.544795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'31","reported_seq":209,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831790+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:40:58.831790+0000","last_peered":"2024-04-17T15:40:58.831790+0000","last_clean":"2024-04-17T15:40:58.831790+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:40:58.831790+0000","last_undegraded":"2024-04-17T15:40:58.831790+0000","last_fullsized":"2024-04-17T15:40:58.831790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510907+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:40:58.510907+0000","last_peered":"2024-04-17T15:40:58.510907+0000","last_clean":"2024-04-17T15:40:58.510907+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:40:58.510907+0000","last_undegraded":"2024-04-17T15:40:58.510907+0000","last_fullsized":"2024-04-17T15:40:58.510907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"112'19","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545552+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:40:58.545552+0000","last_peered":"2024-04-17T15:40:58.545552+0000","last_clean":"2024-04-17T15:40:58.545552+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:40:58.545552+0000","last_undegraded":"2024-04-17T15:40:58.545552+0000","last_fullsized":"2024-04-17T15:40:58.545552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551183+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:40:58.551183+0000","last_peered":"2024-04-17T15:40:58.551183+0000","last_clean":"2024-04-17T15:40:58.551183+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:40:58.551183+0000","last_undegraded":"2024-04-17T15:40:58.551183+0000","last_fullsized":"2024-04-17T15:40:58.551183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205899+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:58.205899+0000","last_peered":"2024-04-17T15:40:58.205899+0000","last_clean":"2024-04-17T15:40:58.205899+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:58.205899+0000","last_undegraded":"2024-04-17T15:40:58.205899+0000","last_fullsized":"2024-04-17T15:40:58.205899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544812+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:40:58.544812+0000","last_peered":"2024-04-17T15:40:58.544812+0000","last_clean":"2024-04-17T15:40:58.544812+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:40:58.544812+0000","last_undegraded":"2024-04-17T15:40:58.544812+0000","last_fullsized":"2024-04-17T15:40:58.544812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870440+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:40:58.870440+0000","last_peered":"2024-04-17T15:40:58.870440+0000","last_clean":"2024-04-17T15:40:58.870440+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:40:58.870440+0000","last_undegraded":"2024-04-17T15:40:58.870440+0000","last_fullsized":"2024-04-17T15:40:58.870440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550102+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:40:58.550102+0000","last_peered":"2024-04-17T15:40:58.550102+0000","last_clean":"2024-04-17T15:40:58.550102+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:40:58.550102+0000","last_undegraded":"2024-04-17T15:40:58.550102+0000","last_fullsized":"2024-04-17T15:40:58.550102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"112'18","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511513+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:40:58.511513+0000","last_peered":"2024-04-17T15:40:58.511513+0000","last_clean":"2024-04-17T15:40:58.511513+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:40:58.511513+0000","last_undegraded":"2024-04-17T15:40:58.511513+0000","last_fullsized":"2024-04-17T15:40:58.511513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870490+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:40:58.870490+0000","last_peered":"2024-04-17T15:40:58.870490+0000","last_clean":"2024-04-17T15:40:58.870490+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:40:58.870490+0000","last_undegraded":"2024-04-17T15:40:58.870490+0000","last_fullsized":"2024-04-17T15:40:58.870490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553733+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:40:58.553733+0000","last_peered":"2024-04-17T15:40:58.553733+0000","last_clean":"2024-04-17T15:40:58.553733+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:40:58.553733+0000","last_undegraded":"2024-04-17T15:40:58.553733+0000","last_fullsized":"2024-04-17T15:40:58.553733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545267+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:40:58.545267+0000","last_peered":"2024-04-17T15:40:58.545267+0000","last_clean":"2024-04-17T15:40:58.545267+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:40:58.545267+0000","last_undegraded":"2024-04-17T15:40:58.545267+0000","last_fullsized":"2024-04-17T15:40:58.545267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870131+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:40:58.870131+0000","last_peered":"2024-04-17T15:40:58.870131+0000","last_clean":"2024-04-17T15:40:58.870131+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:40:58.870131+0000","last_undegraded":"2024-04-17T15:40:58.870131+0000","last_fullsized":"2024-04-17T15:40:58.870131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"112'28","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206882+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:40:58.206882+0000","last_peered":"2024-04-17T15:40:58.206882+0000","last_clean":"2024-04-17T15:40:58.206882+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:40:58.206882+0000","last_undegraded":"2024-04-17T15:40:58.206882+0000","last_fullsized":"2024-04-17T15:40:58.206882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206391+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:40:58.206391+0000","last_peered":"2024-04-17T15:40:58.206391+0000","last_clean":"2024-04-17T15:40:58.206391+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:40:58.206391+0000","last_undegraded":"2024-04-17T15:40:58.206391+0000","last_fullsized":"2024-04-17T15:40:58.206391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545154+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:58.545154+0000","last_peered":"2024-04-17T15:40:58.545154+0000","last_clean":"2024-04-17T15:40:58.545154+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:58.545154+0000","last_undegraded":"2024-04-17T15:40:58.545154+0000","last_fullsized":"2024-04-17T15:40:58.545154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870197+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:40:58.870197+0000","last_peered":"2024-04-17T15:40:58.870197+0000","last_clean":"2024-04-17T15:40:58.870197+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:40:58.870197+0000","last_undegraded":"2024-04-17T15:40:58.870197+0000","last_fullsized":"2024-04-17T15:40:58.870197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206746+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:40:58.206746+0000","last_peered":"2024-04-17T15:40:58.206746+0000","last_clean":"2024-04-17T15:40:58.206746+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:40:58.206746+0000","last_undegraded":"2024-04-17T15:40:58.206746+0000","last_fullsized":"2024-04-17T15:40:58.206746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550274+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:40:58.550274+0000","last_peered":"2024-04-17T15:40:58.550274+0000","last_clean":"2024-04-17T15:40:58.550274+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:40:58.550274+0000","last_undegraded":"2024-04-17T15:40:58.550274+0000","last_fullsized":"2024-04-17T15:40:58.550274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"112'23","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512168+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:40:58.512168+0000","last_peered":"2024-04-17T15:40:58.512168+0000","last_clean":"2024-04-17T15:40:58.512168+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:40:58.512168+0000","last_undegraded":"2024-04-17T15:40:58.512168+0000","last_fullsized":"2024-04-17T15:40:58.512168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207231+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:58.207231+0000","last_peered":"2024-04-17T15:40:58.207231+0000","last_clean":"2024-04-17T15:40:58.207231+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:58.207231+0000","last_undegraded":"2024-04-17T15:40:58.207231+0000","last_fullsized":"2024-04-17T15:40:58.207231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550842+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:58.550842+0000","last_peered":"2024-04-17T15:40:58.550842+0000","last_clean":"2024-04-17T15:40:58.550842+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:58.550842+0000","last_undegraded":"2024-04-17T15:40:58.550842+0000","last_fullsized":"2024-04-17T15:40:58.550842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546595+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:40:58.546595+0000","last_peered":"2024-04-17T15:40:58.546595+0000","last_clean":"2024-04-17T15:40:58.546595+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:40:58.546595+0000","last_undegraded":"2024-04-17T15:40:58.546595+0000","last_fullsized":"2024-04-17T15:40:58.546595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'28","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209461+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:40:58.209461+0000","last_peered":"2024-04-17T15:40:58.209461+0000","last_clean":"2024-04-17T15:40:58.209461+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:40:58.209461+0000","last_undegraded":"2024-04-17T15:40:58.209461+0000","last_fullsized":"2024-04-17T15:40:58.209461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209537+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:58.209537+0000","last_peered":"2024-04-17T15:40:58.209537+0000","last_clean":"2024-04-17T15:40:58.209537+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:58.209537+0000","last_undegraded":"2024-04-17T15:40:58.209537+0000","last_fullsized":"2024-04-17T15:40:58.209537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"112'21","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547094+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:40:58.547094+0000","last_peered":"2024-04-17T15:40:58.547094+0000","last_clean":"2024-04-17T15:40:58.547094+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:40:58.547094+0000","last_undegraded":"2024-04-17T15:40:58.547094+0000","last_fullsized":"2024-04-17T15:40:58.547094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206857+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:40:58.206857+0000","last_peered":"2024-04-17T15:40:58.206857+0000","last_clean":"2024-04-17T15:40:58.206857+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:40:58.206857+0000","last_undegraded":"2024-04-17T15:40:58.206857+0000","last_fullsized":"2024-04-17T15:40:58.206857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205399+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:58.205399+0000","last_peered":"2024-04-17T15:40:58.205399+0000","last_clean":"2024-04-17T15:40:58.205399+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:58.205399+0000","last_undegraded":"2024-04-17T15:40:58.205399+0000","last_fullsized":"2024-04-17T15:40:58.205399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832037+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:40:58.832037+0000","last_peered":"2024-04-17T15:40:58.832037+0000","last_clean":"2024-04-17T15:40:58.832037+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:40:58.832037+0000","last_undegraded":"2024-04-17T15:40:58.832037+0000","last_fullsized":"2024-04-17T15:40:58.832037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'27","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869598+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:40:58.869598+0000","last_peered":"2024-04-17T15:40:58.869598+0000","last_clean":"2024-04-17T15:40:58.869598+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:40:58.869598+0000","last_undegraded":"2024-04-17T15:40:58.869598+0000","last_fullsized":"2024-04-17T15:40:58.869598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207897+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:40:58.207897+0000","last_peered":"2024-04-17T15:40:58.207897+0000","last_clean":"2024-04-17T15:40:58.207897+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:40:58.207897+0000","last_undegraded":"2024-04-17T15:40:58.207897+0000","last_fullsized":"2024-04-17T15:40:58.207897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"98'12","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210312+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:40:58.210312+0000","last_peered":"2024-04-17T15:40:58.210312+0000","last_clean":"2024-04-17T15:40:58.210312+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:40:58.210312+0000","last_undegraded":"2024-04-17T15:40:58.210312+0000","last_fullsized":"2024-04-17T15:40:58.210312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"130'135","reported_seq":400,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519394+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:41:03.519394+0000","last_peered":"2024-04-17T15:41:03.519394+0000","last_clean":"2024-04-17T15:41:03.519394+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:41:03.519394+0000","last_undegraded":"2024-04-17T15:41:03.519394+0000","last_fullsized":"2024-04-17T15:41:03.519394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511119+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:58.511119+0000","last_peered":"2024-04-17T15:40:58.511119+0000","last_clean":"2024-04-17T15:40:58.511119+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:58.511119+0000","last_undegraded":"2024-04-17T15:40:58.511119+0000","last_fullsized":"2024-04-17T15:40:58.511119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207401+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:58.207401+0000","last_peered":"2024-04-17T15:40:58.207401+0000","last_clean":"2024-04-17T15:40:58.207401+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:58.207401+0000","last_undegraded":"2024-04-17T15:40:58.207401+0000","last_fullsized":"2024-04-17T15:40:58.207401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206878+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:40:58.206878+0000","last_peered":"2024-04-17T15:40:58.206878+0000","last_clean":"2024-04-17T15:40:58.206878+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:40:58.206878+0000","last_undegraded":"2024-04-17T15:40:58.206878+0000","last_fullsized":"2024-04-17T15:40:58.206878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510932+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:40:58.510932+0000","last_peered":"2024-04-17T15:40:58.510932+0000","last_clean":"2024-04-17T15:40:58.510932+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:40:58.510932+0000","last_undegraded":"2024-04-17T15:40:58.510932+0000","last_fullsized":"2024-04-17T15:40:58.510932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"112'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206404+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:40:58.206404+0000","last_peered":"2024-04-17T15:40:58.206404+0000","last_clean":"2024-04-17T15:40:58.206404+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:40:58.206404+0000","last_undegraded":"2024-04-17T15:40:58.206404+0000","last_fullsized":"2024-04-17T15:40:58.206404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868782+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:40:58.868782+0000","last_peered":"2024-04-17T15:40:58.868782+0000","last_clean":"2024-04-17T15:40:58.868782+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:40:58.868782+0000","last_undegraded":"2024-04-17T15:40:58.868782+0000","last_fullsized":"2024-04-17T15:40:58.868782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514028+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:58.514028+0000","last_peered":"2024-04-17T15:40:58.514028+0000","last_clean":"2024-04-17T15:40:58.514028+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:58.514028+0000","last_undegraded":"2024-04-17T15:40:58.514028+0000","last_fullsized":"2024-04-17T15:40:58.514028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208859+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:58.208859+0000","last_peered":"2024-04-17T15:40:58.208859+0000","last_clean":"2024-04-17T15:40:58.208859+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:58.208859+0000","last_undegraded":"2024-04-17T15:40:58.208859+0000","last_fullsized":"2024-04-17T15:40:58.208859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211358+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:40:58.211358+0000","last_peered":"2024-04-17T15:40:58.211358+0000","last_clean":"2024-04-17T15:40:58.211358+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:40:58.211358+0000","last_undegraded":"2024-04-17T15:40:58.211358+0000","last_fullsized":"2024-04-17T15:40:58.211358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205705+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:58.205705+0000","last_peered":"2024-04-17T15:40:58.205705+0000","last_clean":"2024-04-17T15:40:58.205705+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:58.205705+0000","last_undegraded":"2024-04-17T15:40:58.205705+0000","last_fullsized":"2024-04-17T15:40:58.205705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"112'18","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868852+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:40:58.868852+0000","last_peered":"2024-04-17T15:40:58.868852+0000","last_clean":"2024-04-17T15:40:58.868852+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:40:58.868852+0000","last_undegraded":"2024-04-17T15:40:58.868852+0000","last_fullsized":"2024-04-17T15:40:58.868852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550780+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:40:58.550780+0000","last_peered":"2024-04-17T15:40:58.550780+0000","last_clean":"2024-04-17T15:40:58.550780+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:40:58.550780+0000","last_undegraded":"2024-04-17T15:40:58.550780+0000","last_fullsized":"2024-04-17T15:40:58.550780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546804+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:58.546804+0000","last_peered":"2024-04-17T15:40:58.546804+0000","last_clean":"2024-04-17T15:40:58.546804+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:58.546804+0000","last_undegraded":"2024-04-17T15:40:58.546804+0000","last_fullsized":"2024-04-17T15:40:58.546804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544901+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:40:58.544901+0000","last_peered":"2024-04-17T15:40:58.544901+0000","last_clean":"2024-04-17T15:40:58.544901+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:40:58.544901+0000","last_undegraded":"2024-04-17T15:40:58.544901+0000","last_fullsized":"2024-04-17T15:40:58.544901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547319+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:40:58.547319+0000","last_peered":"2024-04-17T15:40:58.547319+0000","last_clean":"2024-04-17T15:40:58.547319+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:40:58.547319+0000","last_undegraded":"2024-04-17T15:40:58.547319+0000","last_fullsized":"2024-04-17T15:40:58.547319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205607+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:40:58.205607+0000","last_peered":"2024-04-17T15:40:58.205607+0000","last_clean":"2024-04-17T15:40:58.205607+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:40:58.205607+0000","last_undegraded":"2024-04-17T15:40:58.205607+0000","last_fullsized":"2024-04-17T15:40:58.205607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"112'13","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546215+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:40:58.546215+0000","last_peered":"2024-04-17T15:40:58.546215+0000","last_clean":"2024-04-17T15:40:58.546215+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:40:58.546215+0000","last_undegraded":"2024-04-17T15:40:58.546215+0000","last_fullsized":"2024-04-17T15:40:58.546215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207130+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:58.207130+0000","last_peered":"2024-04-17T15:40:58.207130+0000","last_clean":"2024-04-17T15:40:58.207130+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:58.207130+0000","last_undegraded":"2024-04-17T15:40:58.207130+0000","last_fullsized":"2024-04-17T15:40:58.207130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513344+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:58.513344+0000","last_peered":"2024-04-17T15:40:58.513344+0000","last_clean":"2024-04-17T15:40:58.513344+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:58.513344+0000","last_undegraded":"2024-04-17T15:40:58.513344+0000","last_fullsized":"2024-04-17T15:40:58.513344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206775+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:40:58.206775+0000","last_peered":"2024-04-17T15:40:58.206775+0000","last_clean":"2024-04-17T15:40:58.206775+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:40:58.206775+0000","last_undegraded":"2024-04-17T15:40:58.206775+0000","last_fullsized":"2024-04-17T15:40:58.206775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'22","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870410+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:40:58.870410+0000","last_peered":"2024-04-17T15:40:58.870410+0000","last_clean":"2024-04-17T15:40:58.870410+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:40:58.870410+0000","last_undegraded":"2024-04-17T15:40:58.870410+0000","last_fullsized":"2024-04-17T15:40:58.870410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205395+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:40:58.205395+0000","last_peered":"2024-04-17T15:40:58.205395+0000","last_clean":"2024-04-17T15:40:58.205395+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:40:58.205395+0000","last_undegraded":"2024-04-17T15:40:58.205395+0000","last_fullsized":"2024-04-17T15:40:58.205395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"112'18","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207629+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:40:58.207629+0000","last_peered":"2024-04-17T15:40:58.207629+0000","last_clean":"2024-04-17T15:40:58.207629+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:40:58.207629+0000","last_undegraded":"2024-04-17T15:40:58.207629+0000","last_fullsized":"2024-04-17T15:40:58.207629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869445+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:40:58.869445+0000","last_peered":"2024-04-17T15:40:58.869445+0000","last_clean":"2024-04-17T15:40:58.869445+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:40:58.869445+0000","last_undegraded":"2024-04-17T15:40:58.869445+0000","last_fullsized":"2024-04-17T15:40:58.869445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209600+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:58.209600+0000","last_peered":"2024-04-17T15:40:58.209600+0000","last_clean":"2024-04-17T15:40:58.209600+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:58.209600+0000","last_undegraded":"2024-04-17T15:40:58.209600+0000","last_fullsized":"2024-04-17T15:40:58.209600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208657+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:40:58.208657+0000","last_peered":"2024-04-17T15:40:58.208657+0000","last_clean":"2024-04-17T15:40:58.208657+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:40:58.208657+0000","last_undegraded":"2024-04-17T15:40:58.208657+0000","last_fullsized":"2024-04-17T15:40:58.208657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550802+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:40:58.550802+0000","last_peered":"2024-04-17T15:40:58.550802+0000","last_clean":"2024-04-17T15:40:58.550802+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:40:58.550802+0000","last_undegraded":"2024-04-17T15:40:58.550802+0000","last_fullsized":"2024-04-17T15:40:58.550802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207501+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:40:58.207501+0000","last_peered":"2024-04-17T15:40:58.207501+0000","last_clean":"2024-04-17T15:40:58.207501+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:40:58.207501+0000","last_undegraded":"2024-04-17T15:40:58.207501+0000","last_fullsized":"2024-04-17T15:40:58.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831195+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:40:58.831195+0000","last_peered":"2024-04-17T15:40:58.831195+0000","last_clean":"2024-04-17T15:40:58.831195+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:40:58.831195+0000","last_undegraded":"2024-04-17T15:40:58.831195+0000","last_fullsized":"2024-04-17T15:40:58.831195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210291+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:40:58.210291+0000","last_peered":"2024-04-17T15:40:58.210291+0000","last_clean":"2024-04-17T15:40:58.210291+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:40:58.210291+0000","last_undegraded":"2024-04-17T15:40:58.210291+0000","last_fullsized":"2024-04-17T15:40:58.210291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207297+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:40:58.207297+0000","last_peered":"2024-04-17T15:40:58.207297+0000","last_clean":"2024-04-17T15:40:58.207297+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:40:58.207297+0000","last_undegraded":"2024-04-17T15:40:58.207297+0000","last_fullsized":"2024-04-17T15:40:58.207297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207964+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:40:58.207964+0000","last_peered":"2024-04-17T15:40:58.207964+0000","last_clean":"2024-04-17T15:40:58.207964+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:40:58.207964+0000","last_undegraded":"2024-04-17T15:40:58.207964+0000","last_fullsized":"2024-04-17T15:40:58.207964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'21","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869962+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:40:58.869962+0000","last_peered":"2024-04-17T15:40:58.869962+0000","last_clean":"2024-04-17T15:40:58.869962+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:40:58.869962+0000","last_undegraded":"2024-04-17T15:40:58.869962+0000","last_fullsized":"2024-04-17T15:40:58.869962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546037+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:40:58.546037+0000","last_peered":"2024-04-17T15:40:58.546037+0000","last_clean":"2024-04-17T15:40:58.546037+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:40:58.546037+0000","last_undegraded":"2024-04-17T15:40:58.546037+0000","last_fullsized":"2024-04-17T15:40:58.546037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"111'25","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831752+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:40:58.831752+0000","last_peered":"2024-04-17T15:40:58.831752+0000","last_clean":"2024-04-17T15:40:58.831752+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:40:58.831752+0000","last_undegraded":"2024-04-17T15:40:58.831752+0000","last_fullsized":"2024-04-17T15:40:58.831752+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209479+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:40:58.209479+0000","last_peered":"2024-04-17T15:40:58.209479+0000","last_clean":"2024-04-17T15:40:58.209479+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:40:58.209479+0000","last_undegraded":"2024-04-17T15:40:58.209479+0000","last_fullsized":"2024-04-17T15:40:58.209479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'32","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208331+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:40:58.208331+0000","last_peered":"2024-04-17T15:40:58.208331+0000","last_clean":"2024-04-17T15:40:58.208331+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:40:58.208331+0000","last_undegraded":"2024-04-17T15:40:58.208331+0000","last_fullsized":"2024-04-17T15:40:58.208331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544752+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:40:58.544752+0000","last_peered":"2024-04-17T15:40:58.544752+0000","last_clean":"2024-04-17T15:40:58.544752+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:40:58.544752+0000","last_undegraded":"2024-04-17T15:40:58.544752+0000","last_fullsized":"2024-04-17T15:40:58.544752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553487+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:40:58.553487+0000","last_peered":"2024-04-17T15:40:58.553487+0000","last_clean":"2024-04-17T15:40:58.553487+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:40:58.553487+0000","last_undegraded":"2024-04-17T15:40:58.553487+0000","last_fullsized":"2024-04-17T15:40:58.553487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550656+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:40:58.550656+0000","last_peered":"2024-04-17T15:40:58.550656+0000","last_clean":"2024-04-17T15:40:58.550656+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:40:58.550656+0000","last_undegraded":"2024-04-17T15:40:58.550656+0000","last_fullsized":"2024-04-17T15:40:58.550656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546883+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:40:58.546883+0000","last_peered":"2024-04-17T15:40:58.546883+0000","last_clean":"2024-04-17T15:40:58.546883+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:40:58.546883+0000","last_undegraded":"2024-04-17T15:40:58.546883+0000","last_fullsized":"2024-04-17T15:40:58.546883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870300+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:40:58.870300+0000","last_peered":"2024-04-17T15:40:58.870300+0000","last_clean":"2024-04-17T15:40:58.870300+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:40:58.870300+0000","last_undegraded":"2024-04-17T15:40:58.870300+0000","last_fullsized":"2024-04-17T15:40:58.870300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205823+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:40:58.205823+0000","last_peered":"2024-04-17T15:40:58.205823+0000","last_clean":"2024-04-17T15:40:58.205823+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:40:58.205823+0000","last_undegraded":"2024-04-17T15:40:58.205823+0000","last_fullsized":"2024-04-17T15:40:58.205823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212281+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:40:58.212281+0000","last_peered":"2024-04-17T15:40:58.212281+0000","last_clean":"2024-04-17T15:40:58.212281+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:40:58.212281+0000","last_undegraded":"2024-04-17T15:40:58.212281+0000","last_fullsized":"2024-04-17T15:40:58.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544966+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:40:58.544966+0000","last_peered":"2024-04-17T15:40:58.544966+0000","last_clean":"2024-04-17T15:40:58.544966+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:40:58.544966+0000","last_undegraded":"2024-04-17T15:40:58.544966+0000","last_fullsized":"2024-04-17T15:40:58.544966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832094+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:40:58.832094+0000","last_peered":"2024-04-17T15:40:58.832094+0000","last_clean":"2024-04-17T15:40:58.832094+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:40:58.832094+0000","last_undegraded":"2024-04-17T15:40:58.832094+0000","last_fullsized":"2024-04-17T15:40:58.832094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'24","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206917+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:40:58.206917+0000","last_peered":"2024-04-17T15:40:58.206917+0000","last_clean":"2024-04-17T15:40:58.206917+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:40:58.206917+0000","last_undegraded":"2024-04-17T15:40:58.206917+0000","last_fullsized":"2024-04-17T15:40:58.206917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209083+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:40:58.209083+0000","last_peered":"2024-04-17T15:40:58.209083+0000","last_clean":"2024-04-17T15:40:58.209083+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:40:58.209083+0000","last_undegraded":"2024-04-17T15:40:58.209083+0000","last_fullsized":"2024-04-17T15:40:58.209083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870191+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:40:58.870191+0000","last_peered":"2024-04-17T15:40:58.870191+0000","last_clean":"2024-04-17T15:40:58.870191+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:40:58.870191+0000","last_undegraded":"2024-04-17T15:40:58.870191+0000","last_fullsized":"2024-04-17T15:40:58.870191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512328+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:40:58.512328+0000","last_peered":"2024-04-17T15:40:58.512328+0000","last_clean":"2024-04-17T15:40:58.512328+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:40:58.512328+0000","last_undegraded":"2024-04-17T15:40:58.512328+0000","last_fullsized":"2024-04-17T15:40:58.512328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552057+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:40:58.552057+0000","last_peered":"2024-04-17T15:40:58.552057+0000","last_clean":"2024-04-17T15:40:58.552057+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:40:58.552057+0000","last_undegraded":"2024-04-17T15:40:58.552057+0000","last_fullsized":"2024-04-17T15:40:58.552057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869267+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:40:58.869267+0000","last_peered":"2024-04-17T15:40:58.869267+0000","last_clean":"2024-04-17T15:40:58.869267+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:40:58.869267+0000","last_undegraded":"2024-04-17T15:40:58.869267+0000","last_fullsized":"2024-04-17T15:40:58.869267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'20","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514166+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:40:58.514166+0000","last_peered":"2024-04-17T15:40:58.514166+0000","last_clean":"2024-04-17T15:40:58.514166+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:40:58.514166+0000","last_undegraded":"2024-04-17T15:40:58.514166+0000","last_fullsized":"2024-04-17T15:40:58.514166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830799+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:40:58.830799+0000","last_peered":"2024-04-17T15:40:58.830799+0000","last_clean":"2024-04-17T15:40:58.830799+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:40:58.830799+0000","last_undegraded":"2024-04-17T15:40:58.830799+0000","last_fullsized":"2024-04-17T15:40:58.830799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"111'16","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832080+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:40:58.832080+0000","last_peered":"2024-04-17T15:40:58.832080+0000","last_clean":"2024-04-17T15:40:58.832080+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:40:58.832080+0000","last_undegraded":"2024-04-17T15:40:58.832080+0000","last_fullsized":"2024-04-17T15:40:58.832080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511460+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:40:58.511460+0000","last_peered":"2024-04-17T15:40:58.511460+0000","last_clean":"2024-04-17T15:40:58.511460+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:40:58.511460+0000","last_undegraded":"2024-04-17T15:40:58.511460+0000","last_fullsized":"2024-04-17T15:40:58.511460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'24","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"111'33","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205512+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:40:58.205512+0000","last_peered":"2024-04-17T15:40:58.205512+0000","last_clean":"2024-04-17T15:40:58.205512+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:40:58.205512+0000","last_undegraded":"2024-04-17T15:40:58.205512+0000","last_fullsized":"2024-04-17T15:40:58.205512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870275+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:40:58.870275+0000","last_peered":"2024-04-17T15:40:58.870275+0000","last_clean":"2024-04-17T15:40:58.870275+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:40:58.870275+0000","last_undegraded":"2024-04-17T15:40:58.870275+0000","last_fullsized":"2024-04-17T15:40:58.870275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'14","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206299+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:40:58.206299+0000","last_peered":"2024-04-17T15:40:58.206299+0000","last_clean":"2024-04-17T15:40:58.206299+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:40:58.206299+0000","last_undegraded":"2024-04-17T15:40:58.206299+0000","last_fullsized":"2024-04-17T15:40:58.206299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210809+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:40:58.210809+0000","last_peered":"2024-04-17T15:40:58.210809+0000","last_clean":"2024-04-17T15:40:58.210809+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:40:58.210809+0000","last_undegraded":"2024-04-17T15:40:58.210809+0000","last_fullsized":"2024-04-17T15:40:58.210809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1080,"ondisk_log_size":1080,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":374963,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":619,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":710066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1817372,"kb_used_data":1786196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92554468,"statfs":{"total":96636764160,"available":94775775232,"internally_reserved":0,"allocated":1829064704,"data_stored":1828373077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1179776,"kb_used_data":1148600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93192064,"statfs":{"total":96636764160,"available":95428673536,"internally_reserved":0,"allocated":1176166400,"data_stored":1175509012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716408,"kb_used_data":1681072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92655432,"statfs":{"total":96636764160,"available":94879162368,"internally_reserved":0,"allocated":1721417728,"data_stored":1720711657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542201,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898444,"kb_used_data":1867260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473396,"statfs":{"total":96636764160,"available":94692757504,"internally_reserved":0,"allocated":1912074240,"data_stored":1911433504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812524,"kb_used_data":1777188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92559316,"statfs":{"total":96636764160,"available":94780739584,"internally_reserved":0,"allocated":1819840512,"data_stored":1819161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079296,"kb_used_data":1048120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93292544,"statfs":{"total":96636764160,"available":95531565056,"internally_reserved":0,"allocated":1073274880,"data_stored":1072630977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1103964,"kb_used_data":1072788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93267876,"statfs":{"total":96636764160,"available":95506305024,"internally_reserved":0,"allocated":1098534912,"data_stored":1097857316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1968684,"kb_used_data":1937496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92403156,"statfs":{"total":96636764160,"available":94620831744,"internally_reserved":0,"allocated":1983995904,"data_stored":1983329157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1981808640,"data_stored":1981808640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1096810496,"data_stored":1096810496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1071644672,"data_stored":1071644672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1719664640,"data_stored":1719664640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1174405120,"data_stored":1174405120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1826619392,"data_stored":1826619392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":58539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":118666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":176172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:41:11.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:41:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:12.016 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:41:12.031 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-17T15:41:10.328879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300811955,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3304,"num_read_kb":2996,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3899,"ondisk_log_size":3899,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12576468,"kb_used_data":12318720,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":742398252,"statfs":{"total":773094113280,"available":760215810048,"internally_reserved":0,"allocated":12614369280,"data_stored":12609005810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":263835186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007088"},"pg_stats":[{"pgid":"3.3f","version":"111'19","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513762+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:40:58.513762+0000","last_peered":"2024-04-17T15:40:58.513762+0000","last_clean":"2024-04-17T15:40:58.513762+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:40:58.513762+0000","last_undegraded":"2024-04-17T15:40:58.513762+0000","last_fullsized":"2024-04-17T15:40:58.513762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205015+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:40:58.205015+0000","last_peered":"2024-04-17T15:40:58.205015+0000","last_clean":"2024-04-17T15:40:58.205015+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:40:58.205015+0000","last_undegraded":"2024-04-17T15:40:58.205015+0000","last_fullsized":"2024-04-17T15:40:58.205015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"111'27","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207889+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:40:58.207889+0000","last_peered":"2024-04-17T15:40:58.207889+0000","last_clean":"2024-04-17T15:40:58.207889+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:40:58.207889+0000","last_undegraded":"2024-04-17T15:40:58.207889+0000","last_fullsized":"2024-04-17T15:40:58.207889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511785+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:40:58.511785+0000","last_peered":"2024-04-17T15:40:58.511785+0000","last_clean":"2024-04-17T15:40:58.511785+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:40:58.511785+0000","last_undegraded":"2024-04-17T15:40:58.511785+0000","last_fullsized":"2024-04-17T15:40:58.511785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'22","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870782+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:40:58.870782+0000","last_peered":"2024-04-17T15:40:58.870782+0000","last_clean":"2024-04-17T15:40:58.870782+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:40:58.870782+0000","last_undegraded":"2024-04-17T15:40:58.870782+0000","last_fullsized":"2024-04-17T15:40:58.870782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208399+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:40:58.208399+0000","last_peered":"2024-04-17T15:40:58.208399+0000","last_clean":"2024-04-17T15:40:58.208399+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:40:58.208399+0000","last_undegraded":"2024-04-17T15:40:58.208399+0000","last_fullsized":"2024-04-17T15:40:58.208399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'19","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206655+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:40:58.206655+0000","last_peered":"2024-04-17T15:40:58.206655+0000","last_clean":"2024-04-17T15:40:58.206655+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:40:58.206655+0000","last_undegraded":"2024-04-17T15:40:58.206655+0000","last_fullsized":"2024-04-17T15:40:58.206655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869758+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:40:58.869758+0000","last_peered":"2024-04-17T15:40:58.869758+0000","last_clean":"2024-04-17T15:40:58.869758+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:40:58.869758+0000","last_undegraded":"2024-04-17T15:40:58.869758+0000","last_fullsized":"2024-04-17T15:40:58.869758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'31","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512574+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:40:58.512574+0000","last_peered":"2024-04-17T15:40:58.512574+0000","last_clean":"2024-04-17T15:40:58.512574+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:40:58.512574+0000","last_undegraded":"2024-04-17T15:40:58.512574+0000","last_fullsized":"2024-04-17T15:40:58.512574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551803+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:40:58.551803+0000","last_peered":"2024-04-17T15:40:58.551803+0000","last_clean":"2024-04-17T15:40:58.551803+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:40:58.551803+0000","last_undegraded":"2024-04-17T15:40:58.551803+0000","last_fullsized":"2024-04-17T15:40:58.551803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'19","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206172+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:40:58.206172+0000","last_peered":"2024-04-17T15:40:58.206172+0000","last_clean":"2024-04-17T15:40:58.206172+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:40:58.206172+0000","last_undegraded":"2024-04-17T15:40:58.206172+0000","last_fullsized":"2024-04-17T15:40:58.206172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208574+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:40:58.208574+0000","last_peered":"2024-04-17T15:40:58.208574+0000","last_clean":"2024-04-17T15:40:58.208574+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:40:58.208574+0000","last_undegraded":"2024-04-17T15:40:58.208574+0000","last_fullsized":"2024-04-17T15:40:58.208574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512091+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:40:58.512091+0000","last_peered":"2024-04-17T15:40:58.512091+0000","last_clean":"2024-04-17T15:40:58.512091+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:40:58.512091+0000","last_undegraded":"2024-04-17T15:40:58.512091+0000","last_fullsized":"2024-04-17T15:40:58.512091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210663+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:40:58.210663+0000","last_peered":"2024-04-17T15:40:58.210663+0000","last_clean":"2024-04-17T15:40:58.210663+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:40:58.210663+0000","last_undegraded":"2024-04-17T15:40:58.210663+0000","last_fullsized":"2024-04-17T15:40:58.210663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544985+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:40:58.544985+0000","last_peered":"2024-04-17T15:40:58.544985+0000","last_clean":"2024-04-17T15:40:58.544985+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:40:58.544985+0000","last_undegraded":"2024-04-17T15:40:58.544985+0000","last_fullsized":"2024-04-17T15:40:58.544985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832766+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:40:58.832766+0000","last_peered":"2024-04-17T15:40:58.832766+0000","last_clean":"2024-04-17T15:40:58.832766+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:40:58.832766+0000","last_undegraded":"2024-04-17T15:40:58.832766+0000","last_fullsized":"2024-04-17T15:40:58.832766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206425+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:40:58.206425+0000","last_peered":"2024-04-17T15:40:58.206425+0000","last_clean":"2024-04-17T15:40:58.206425+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:40:58.206425+0000","last_undegraded":"2024-04-17T15:40:58.206425+0000","last_fullsized":"2024-04-17T15:40:58.206425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'15","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513874+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:40:58.513874+0000","last_peered":"2024-04-17T15:40:58.513874+0000","last_clean":"2024-04-17T15:40:58.513874+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:40:58.513874+0000","last_undegraded":"2024-04-17T15:40:58.513874+0000","last_fullsized":"2024-04-17T15:40:58.513874+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511961+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:40:58.511961+0000","last_peered":"2024-04-17T15:40:58.511961+0000","last_clean":"2024-04-17T15:40:58.511961+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:40:58.511961+0000","last_undegraded":"2024-04-17T15:40:58.511961+0000","last_fullsized":"2024-04-17T15:40:58.511961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'19","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553294+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:40:58.553294+0000","last_peered":"2024-04-17T15:40:58.553294+0000","last_clean":"2024-04-17T15:40:58.553294+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:40:58.553294+0000","last_undegraded":"2024-04-17T15:40:58.553294+0000","last_fullsized":"2024-04-17T15:40:58.553294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206650+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:40:58.206650+0000","last_peered":"2024-04-17T15:40:58.206650+0000","last_clean":"2024-04-17T15:40:58.206650+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:40:58.206650+0000","last_undegraded":"2024-04-17T15:40:58.206650+0000","last_fullsized":"2024-04-17T15:40:58.206650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553053+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:40:58.553053+0000","last_peered":"2024-04-17T15:40:58.553053+0000","last_clean":"2024-04-17T15:40:58.553053+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:40:58.553053+0000","last_undegraded":"2024-04-17T15:40:58.553053+0000","last_fullsized":"2024-04-17T15:40:58.553053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831158+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:40:58.831158+0000","last_peered":"2024-04-17T15:40:58.831158+0000","last_clean":"2024-04-17T15:40:58.831158+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:40:58.831158+0000","last_undegraded":"2024-04-17T15:40:58.831158+0000","last_fullsized":"2024-04-17T15:40:58.831158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207591+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:40:58.207591+0000","last_peered":"2024-04-17T15:40:58.207591+0000","last_clean":"2024-04-17T15:40:58.207591+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:40:58.207591+0000","last_undegraded":"2024-04-17T15:40:58.207591+0000","last_fullsized":"2024-04-17T15:40:58.207591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"111'20","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545679+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:40:58.545679+0000","last_peered":"2024-04-17T15:40:58.545679+0000","last_clean":"2024-04-17T15:40:58.545679+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:40:58.545679+0000","last_undegraded":"2024-04-17T15:40:58.545679+0000","last_fullsized":"2024-04-17T15:40:58.545679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208742+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:40:58.208742+0000","last_peered":"2024-04-17T15:40:58.208742+0000","last_clean":"2024-04-17T15:40:58.208742+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:40:58.208742+0000","last_undegraded":"2024-04-17T15:40:58.208742+0000","last_fullsized":"2024-04-17T15:40:58.208742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869682+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:40:58.869682+0000","last_peered":"2024-04-17T15:40:58.869682+0000","last_clean":"2024-04-17T15:40:58.869682+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:40:58.869682+0000","last_undegraded":"2024-04-17T15:40:58.869682+0000","last_fullsized":"2024-04-17T15:40:58.869682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206151+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:58.206151+0000","last_peered":"2024-04-17T15:40:58.206151+0000","last_clean":"2024-04-17T15:40:58.206151+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:58.206151+0000","last_undegraded":"2024-04-17T15:40:58.206151+0000","last_fullsized":"2024-04-17T15:40:58.206151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546278+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:40:58.546278+0000","last_peered":"2024-04-17T15:40:58.546278+0000","last_clean":"2024-04-17T15:40:58.546278+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:40:58.546278+0000","last_undegraded":"2024-04-17T15:40:58.546278+0000","last_fullsized":"2024-04-17T15:40:58.546278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'26","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512797+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:40:58.512797+0000","last_peered":"2024-04-17T15:40:58.512797+0000","last_clean":"2024-04-17T15:40:58.512797+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:40:58.512797+0000","last_undegraded":"2024-04-17T15:40:58.512797+0000","last_fullsized":"2024-04-17T15:40:58.512797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210023+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:40:58.210023+0000","last_peered":"2024-04-17T15:40:58.210023+0000","last_clean":"2024-04-17T15:40:58.210023+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:40:58.210023+0000","last_undegraded":"2024-04-17T15:40:58.210023+0000","last_fullsized":"2024-04-17T15:40:58.210023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"112'17","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869909+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:40:58.869909+0000","last_peered":"2024-04-17T15:40:58.869909+0000","last_clean":"2024-04-17T15:40:58.869909+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:40:58.869909+0000","last_undegraded":"2024-04-17T15:40:58.869909+0000","last_fullsized":"2024-04-17T15:40:58.869909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513403+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:58.513403+0000","last_peered":"2024-04-17T15:40:58.513403+0000","last_clean":"2024-04-17T15:40:58.513403+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:58.513403+0000","last_undegraded":"2024-04-17T15:40:58.513403+0000","last_fullsized":"2024-04-17T15:40:58.513403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"112'52","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205103+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:58.205103+0000","last_peered":"2024-04-17T15:40:58.205103+0000","last_clean":"2024-04-17T15:40:58.205103+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:58.205103+0000","last_undegraded":"2024-04-17T15:40:58.205103+0000","last_fullsized":"2024-04-17T15:40:58.205103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211084+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:40:58.211084+0000","last_peered":"2024-04-17T15:40:58.211084+0000","last_clean":"2024-04-17T15:40:58.211084+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:40:58.211084+0000","last_undegraded":"2024-04-17T15:40:58.211084+0000","last_fullsized":"2024-04-17T15:40:58.211084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'18","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869692+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:40:58.869692+0000","last_peered":"2024-04-17T15:40:58.869692+0000","last_clean":"2024-04-17T15:40:58.869692+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:40:58.869692+0000","last_undegraded":"2024-04-17T15:40:58.869692+0000","last_fullsized":"2024-04-17T15:40:58.869692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546176+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:58.546176+0000","last_peered":"2024-04-17T15:40:58.546176+0000","last_clean":"2024-04-17T15:40:58.546176+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:58.546176+0000","last_undegraded":"2024-04-17T15:40:58.546176+0000","last_fullsized":"2024-04-17T15:40:58.546176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212440+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:40:58.212440+0000","last_peered":"2024-04-17T15:40:58.212440+0000","last_clean":"2024-04-17T15:40:58.212440+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:40:58.212440+0000","last_undegraded":"2024-04-17T15:40:58.212440+0000","last_fullsized":"2024-04-17T15:40:58.212440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209905+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:58.209905+0000","last_peered":"2024-04-17T15:40:58.209905+0000","last_clean":"2024-04-17T15:40:58.209905+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:58.209905+0000","last_undegraded":"2024-04-17T15:40:58.209905+0000","last_fullsized":"2024-04-17T15:40:58.209905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869399+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:58.869399+0000","last_peered":"2024-04-17T15:40:58.869399+0000","last_clean":"2024-04-17T15:40:58.869399+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:58.869399+0000","last_undegraded":"2024-04-17T15:40:58.869399+0000","last_fullsized":"2024-04-17T15:40:58.869399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870379+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:40:58.870379+0000","last_peered":"2024-04-17T15:40:58.870379+0000","last_clean":"2024-04-17T15:40:58.870379+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:40:58.870379+0000","last_undegraded":"2024-04-17T15:40:58.870379+0000","last_fullsized":"2024-04-17T15:40:58.870379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'32","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512271+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:40:58.512271+0000","last_peered":"2024-04-17T15:40:58.512271+0000","last_clean":"2024-04-17T15:40:58.512271+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:40:58.512271+0000","last_undegraded":"2024-04-17T15:40:58.512271+0000","last_fullsized":"2024-04-17T15:40:58.512271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544211+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:40:58.544211+0000","last_peered":"2024-04-17T15:40:58.544211+0000","last_clean":"2024-04-17T15:40:58.544211+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:40:58.544211+0000","last_undegraded":"2024-04-17T15:40:58.544211+0000","last_fullsized":"2024-04-17T15:40:58.544211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"73'11","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'135","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519249+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:41:03.519249+0000","last_peered":"2024-04-17T15:41:03.519249+0000","last_clean":"2024-04-17T15:41:03.519249+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:41:03.519249+0000","last_undegraded":"2024-04-17T15:41:03.519249+0000","last_fullsized":"2024-04-17T15:41:03.519249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207086+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:58.207086+0000","last_peered":"2024-04-17T15:40:58.207086+0000","last_clean":"2024-04-17T15:40:58.207086+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:58.207086+0000","last_undegraded":"2024-04-17T15:40:58.207086+0000","last_fullsized":"2024-04-17T15:40:58.207086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546763+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:40:58.546763+0000","last_peered":"2024-04-17T15:40:58.546763+0000","last_clean":"2024-04-17T15:40:58.546763+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:40:58.546763+0000","last_undegraded":"2024-04-17T15:40:58.546763+0000","last_fullsized":"2024-04-17T15:40:58.546763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'33","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550912+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:40:58.550912+0000","last_peered":"2024-04-17T15:40:58.550912+0000","last_clean":"2024-04-17T15:40:58.550912+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:40:58.550912+0000","last_undegraded":"2024-04-17T15:40:58.550912+0000","last_fullsized":"2024-04-17T15:40:58.550912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":43,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210404+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:40:58.210404+0000","last_peered":"2024-04-17T15:40:58.210404+0000","last_clean":"2024-04-17T15:40:58.210404+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:40:58.210404+0000","last_undegraded":"2024-04-17T15:40:58.210404+0000","last_fullsized":"2024-04-17T15:40:58.210404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"112'17","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513209+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:40:58.513209+0000","last_peered":"2024-04-17T15:40:58.513209+0000","last_clean":"2024-04-17T15:40:58.513209+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:40:58.513209+0000","last_undegraded":"2024-04-17T15:40:58.513209+0000","last_fullsized":"2024-04-17T15:40:58.513209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'135","reported_seq":478,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519468+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:41:03.519468+0000","last_peered":"2024-04-17T15:41:03.519468+0000","last_clean":"2024-04-17T15:41:03.519468+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:41:03.519468+0000","last_undegraded":"2024-04-17T15:41:03.519468+0000","last_fullsized":"2024-04-17T15:41:03.519468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205567+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:40:58.205567+0000","last_peered":"2024-04-17T15:40:58.205567+0000","last_clean":"2024-04-17T15:40:58.205567+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:40:58.205567+0000","last_undegraded":"2024-04-17T15:40:58.205567+0000","last_fullsized":"2024-04-17T15:40:58.205567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513868+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:40:58.513868+0000","last_peered":"2024-04-17T15:40:58.513868+0000","last_clean":"2024-04-17T15:40:58.513868+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:40:58.513868+0000","last_undegraded":"2024-04-17T15:40:58.513868+0000","last_fullsized":"2024-04-17T15:40:58.513868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511485+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:40:58.511485+0000","last_peered":"2024-04-17T15:40:58.511485+0000","last_clean":"2024-04-17T15:40:58.511485+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:40:58.511485+0000","last_undegraded":"2024-04-17T15:40:58.511485+0000","last_fullsized":"2024-04-17T15:40:58.511485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"112'27","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205385+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:40:58.205385+0000","last_peered":"2024-04-17T15:40:58.205385+0000","last_clean":"2024-04-17T15:40:58.205385+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:40:58.205385+0000","last_undegraded":"2024-04-17T15:40:58.205385+0000","last_fullsized":"2024-04-17T15:40:58.205385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206195+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:40:58.206195+0000","last_peered":"2024-04-17T15:40:58.206195+0000","last_clean":"2024-04-17T15:40:58.206195+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:40:58.206195+0000","last_undegraded":"2024-04-17T15:40:58.206195+0000","last_fullsized":"2024-04-17T15:40:58.206195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206198+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:40:58.206198+0000","last_peered":"2024-04-17T15:40:58.206198+0000","last_clean":"2024-04-17T15:40:58.206198+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:40:58.206198+0000","last_undegraded":"2024-04-17T15:40:58.206198+0000","last_fullsized":"2024-04-17T15:40:58.206198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207810+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:40:58.207810+0000","last_peered":"2024-04-17T15:40:58.207810+0000","last_clean":"2024-04-17T15:40:58.207810+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:40:58.207810+0000","last_undegraded":"2024-04-17T15:40:58.207810+0000","last_fullsized":"2024-04-17T15:40:58.207810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'11","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513901+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:40:58.513901+0000","last_peered":"2024-04-17T15:40:58.513901+0000","last_clean":"2024-04-17T15:40:58.513901+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:40:58.513901+0000","last_undegraded":"2024-04-17T15:40:58.513901+0000","last_fullsized":"2024-04-17T15:40:58.513901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830647+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:40:58.830647+0000","last_peered":"2024-04-17T15:40:58.830647+0000","last_clean":"2024-04-17T15:40:58.830647+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:40:58.830647+0000","last_undegraded":"2024-04-17T15:40:58.830647+0000","last_fullsized":"2024-04-17T15:40:58.830647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"112'18","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546024+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:40:58.546024+0000","last_peered":"2024-04-17T15:40:58.546024+0000","last_clean":"2024-04-17T15:40:58.546024+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:40:58.546024+0000","last_undegraded":"2024-04-17T15:40:58.546024+0000","last_fullsized":"2024-04-17T15:40:58.546024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544949+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:40:58.544949+0000","last_peered":"2024-04-17T15:40:58.544949+0000","last_clean":"2024-04-17T15:40:58.544949+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:40:58.544949+0000","last_undegraded":"2024-04-17T15:40:58.544949+0000","last_fullsized":"2024-04-17T15:40:58.544949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553003+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:40:58.553003+0000","last_peered":"2024-04-17T15:40:58.553003+0000","last_clean":"2024-04-17T15:40:58.553003+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:40:58.553003+0000","last_undegraded":"2024-04-17T15:40:58.553003+0000","last_fullsized":"2024-04-17T15:40:58.553003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551609+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:40:58.551609+0000","last_peered":"2024-04-17T15:40:58.551609+0000","last_clean":"2024-04-17T15:40:58.551609+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:40:58.551609+0000","last_undegraded":"2024-04-17T15:40:58.551609+0000","last_fullsized":"2024-04-17T15:40:58.551609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'20","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513891+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:40:58.513891+0000","last_peered":"2024-04-17T15:40:58.513891+0000","last_clean":"2024-04-17T15:40:58.513891+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:40:58.513891+0000","last_undegraded":"2024-04-17T15:40:58.513891+0000","last_fullsized":"2024-04-17T15:40:58.513891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831481+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:40:58.831481+0000","last_peered":"2024-04-17T15:40:58.831481+0000","last_clean":"2024-04-17T15:40:58.831481+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:40:58.831481+0000","last_undegraded":"2024-04-17T15:40:58.831481+0000","last_fullsized":"2024-04-17T15:40:58.831481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"112'25","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512245+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:40:58.512245+0000","last_peered":"2024-04-17T15:40:58.512245+0000","last_clean":"2024-04-17T15:40:58.512245+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:40:58.512245+0000","last_undegraded":"2024-04-17T15:40:58.512245+0000","last_fullsized":"2024-04-17T15:40:58.512245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62305,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"130'135","reported_seq":401,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519440+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:41:03.519440+0000","last_peered":"2024-04-17T15:41:03.519440+0000","last_clean":"2024-04-17T15:41:03.519440+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:41:03.519440+0000","last_undegraded":"2024-04-17T15:41:03.519440+0000","last_fullsized":"2024-04-17T15:41:03.519440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869978+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:40:58.869978+0000","last_peered":"2024-04-17T15:40:58.869978+0000","last_clean":"2024-04-17T15:40:58.869978+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:40:58.869978+0000","last_undegraded":"2024-04-17T15:40:58.869978+0000","last_fullsized":"2024-04-17T15:40:58.869978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870694+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:40:58.870694+0000","last_peered":"2024-04-17T15:40:58.870694+0000","last_clean":"2024-04-17T15:40:58.870694+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:40:58.870694+0000","last_undegraded":"2024-04-17T15:40:58.870694+0000","last_fullsized":"2024-04-17T15:40:58.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207153+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:40:58.207153+0000","last_peered":"2024-04-17T15:40:58.207153+0000","last_clean":"2024-04-17T15:40:58.207153+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:40:58.207153+0000","last_undegraded":"2024-04-17T15:40:58.207153+0000","last_fullsized":"2024-04-17T15:40:58.207153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830470+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:40:58.830470+0000","last_peered":"2024-04-17T15:40:58.830470+0000","last_clean":"2024-04-17T15:40:58.830470+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:40:58.830470+0000","last_undegraded":"2024-04-17T15:40:58.830470+0000","last_fullsized":"2024-04-17T15:40:58.830470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"112'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869252+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:40:58.869252+0000","last_peered":"2024-04-17T15:40:58.869252+0000","last_clean":"2024-04-17T15:40:58.869252+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:40:58.869252+0000","last_undegraded":"2024-04-17T15:40:58.869252+0000","last_fullsized":"2024-04-17T15:40:58.869252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830535+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:40:58.830535+0000","last_peered":"2024-04-17T15:40:58.830535+0000","last_clean":"2024-04-17T15:40:58.830535+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:40:58.830535+0000","last_undegraded":"2024-04-17T15:40:58.830535+0000","last_fullsized":"2024-04-17T15:40:58.830535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207046+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:40:58.207046+0000","last_peered":"2024-04-17T15:40:58.207046+0000","last_clean":"2024-04-17T15:40:58.207046+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:40:58.207046+0000","last_undegraded":"2024-04-17T15:40:58.207046+0000","last_fullsized":"2024-04-17T15:40:58.207046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208754+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:40:58.208754+0000","last_peered":"2024-04-17T15:40:58.208754+0000","last_clean":"2024-04-17T15:40:58.208754+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:40:58.208754+0000","last_undegraded":"2024-04-17T15:40:58.208754+0000","last_fullsized":"2024-04-17T15:40:58.208754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545192+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:40:58.545192+0000","last_peered":"2024-04-17T15:40:58.545192+0000","last_clean":"2024-04-17T15:40:58.545192+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:40:58.545192+0000","last_undegraded":"2024-04-17T15:40:58.545192+0000","last_fullsized":"2024-04-17T15:40:58.545192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"112'19","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209917+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:40:58.209917+0000","last_peered":"2024-04-17T15:40:58.209917+0000","last_clean":"2024-04-17T15:40:58.209917+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:40:58.209917+0000","last_undegraded":"2024-04-17T15:40:58.209917+0000","last_fullsized":"2024-04-17T15:40:58.209917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870126+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:40:58.870126+0000","last_peered":"2024-04-17T15:40:58.870126+0000","last_clean":"2024-04-17T15:40:58.870126+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:40:58.870126+0000","last_undegraded":"2024-04-17T15:40:58.870126+0000","last_fullsized":"2024-04-17T15:40:58.870126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544417+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:40:58.544417+0000","last_peered":"2024-04-17T15:40:58.544417+0000","last_clean":"2024-04-17T15:40:58.544417+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:40:58.544417+0000","last_undegraded":"2024-04-17T15:40:58.544417+0000","last_fullsized":"2024-04-17T15:40:58.544417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209073+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:40:58.209073+0000","last_peered":"2024-04-17T15:40:58.209073+0000","last_clean":"2024-04-17T15:40:58.209073+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:40:58.209073+0000","last_undegraded":"2024-04-17T15:40:58.209073+0000","last_fullsized":"2024-04-17T15:40:58.209073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551850+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:40:58.551850+0000","last_peered":"2024-04-17T15:40:58.551850+0000","last_clean":"2024-04-17T15:40:58.551850+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:40:58.551850+0000","last_undegraded":"2024-04-17T15:40:58.551850+0000","last_fullsized":"2024-04-17T15:40:58.551850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206959+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:40:58.206959+0000","last_peered":"2024-04-17T15:40:58.206959+0000","last_clean":"2024-04-17T15:40:58.206959+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:40:58.206959+0000","last_undegraded":"2024-04-17T15:40:58.206959+0000","last_fullsized":"2024-04-17T15:40:58.206959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"112'23","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832235+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:40:58.832235+0000","last_peered":"2024-04-17T15:40:58.832235+0000","last_clean":"2024-04-17T15:40:58.832235+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:40:58.832235+0000","last_undegraded":"2024-04-17T15:40:58.832235+0000","last_fullsized":"2024-04-17T15:40:58.832235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"130'135","reported_seq":444,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519440+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:41:03.519440+0000","last_peered":"2024-04-17T15:41:03.519440+0000","last_clean":"2024-04-17T15:41:03.519440+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:41:03.519440+0000","last_undegraded":"2024-04-17T15:41:03.519440+0000","last_fullsized":"2024-04-17T15:41:03.519440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205716+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:40:58.205716+0000","last_peered":"2024-04-17T15:40:58.205716+0000","last_clean":"2024-04-17T15:40:58.205716+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:40:58.205716+0000","last_undegraded":"2024-04-17T15:40:58.205716+0000","last_fullsized":"2024-04-17T15:40:58.205716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212582+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:40:58.212582+0000","last_peered":"2024-04-17T15:40:58.212582+0000","last_clean":"2024-04-17T15:40:58.212582+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:40:58.212582+0000","last_undegraded":"2024-04-17T15:40:58.212582+0000","last_fullsized":"2024-04-17T15:40:58.212582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208751+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:40:58.208751+0000","last_peered":"2024-04-17T15:40:58.208751+0000","last_clean":"2024-04-17T15:40:58.208751+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:40:58.208751+0000","last_undegraded":"2024-04-17T15:40:58.208751+0000","last_fullsized":"2024-04-17T15:40:58.208751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210704+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:40:58.210704+0000","last_peered":"2024-04-17T15:40:58.210704+0000","last_clean":"2024-04-17T15:40:58.210704+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:40:58.210704+0000","last_undegraded":"2024-04-17T15:40:58.210704+0000","last_fullsized":"2024-04-17T15:40:58.210704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545986+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:40:58.545986+0000","last_peered":"2024-04-17T15:40:58.545986+0000","last_clean":"2024-04-17T15:40:58.545986+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:40:58.545986+0000","last_undegraded":"2024-04-17T15:40:58.545986+0000","last_fullsized":"2024-04-17T15:40:58.545986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"130'135","reported_seq":451,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519326+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:41:03.519326+0000","last_peered":"2024-04-17T15:41:03.519326+0000","last_clean":"2024-04-17T15:41:03.519326+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:41:03.519326+0000","last_undegraded":"2024-04-17T15:41:03.519326+0000","last_fullsized":"2024-04-17T15:41:03.519326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208093+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:40:58.208093+0000","last_peered":"2024-04-17T15:40:58.208093+0000","last_clean":"2024-04-17T15:40:58.208093+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:40:58.208093+0000","last_undegraded":"2024-04-17T15:40:58.208093+0000","last_fullsized":"2024-04-17T15:40:58.208093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208922+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:40:58.208922+0000","last_peered":"2024-04-17T15:40:58.208922+0000","last_clean":"2024-04-17T15:40:58.208922+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:40:58.208922+0000","last_undegraded":"2024-04-17T15:40:58.208922+0000","last_fullsized":"2024-04-17T15:40:58.208922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545320+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:40:58.545320+0000","last_peered":"2024-04-17T15:40:58.545320+0000","last_clean":"2024-04-17T15:40:58.545320+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:40:58.545320+0000","last_undegraded":"2024-04-17T15:40:58.545320+0000","last_fullsized":"2024-04-17T15:40:58.545320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212265+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:40:58.212265+0000","last_peered":"2024-04-17T15:40:58.212265+0000","last_clean":"2024-04-17T15:40:58.212265+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:40:58.212265+0000","last_undegraded":"2024-04-17T15:40:58.212265+0000","last_fullsized":"2024-04-17T15:40:58.212265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"112'25","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209728+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:40:58.209728+0000","last_peered":"2024-04-17T15:40:58.209728+0000","last_clean":"2024-04-17T15:40:58.209728+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:40:58.209728+0000","last_undegraded":"2024-04-17T15:40:58.209728+0000","last_fullsized":"2024-04-17T15:40:58.209728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551513+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:40:58.551513+0000","last_peered":"2024-04-17T15:40:58.551513+0000","last_clean":"2024-04-17T15:40:58.551513+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:40:58.551513+0000","last_undegraded":"2024-04-17T15:40:58.551513+0000","last_fullsized":"2024-04-17T15:40:58.551513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206128+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:40:58.206128+0000","last_peered":"2024-04-17T15:40:58.206128+0000","last_clean":"2024-04-17T15:40:58.206128+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:40:58.206128+0000","last_undegraded":"2024-04-17T15:40:58.206128+0000","last_fullsized":"2024-04-17T15:40:58.206128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552674+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:40:58.552674+0000","last_peered":"2024-04-17T15:40:58.552674+0000","last_clean":"2024-04-17T15:40:58.552674+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:40:58.552674+0000","last_undegraded":"2024-04-17T15:40:58.552674+0000","last_fullsized":"2024-04-17T15:40:58.552674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":387,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512174+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:58.512174+0000","last_peered":"2024-04-17T15:40:58.512174+0000","last_clean":"2024-04-17T15:40:58.512174+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:58.512174+0000","last_undegraded":"2024-04-17T15:40:58.512174+0000","last_fullsized":"2024-04-17T15:40:58.512174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206221+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:40:58.206221+0000","last_peered":"2024-04-17T15:40:58.206221+0000","last_clean":"2024-04-17T15:40:58.206221+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:40:58.206221+0000","last_undegraded":"2024-04-17T15:40:58.206221+0000","last_fullsized":"2024-04-17T15:40:58.206221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"112'21","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545289+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:40:58.545289+0000","last_peered":"2024-04-17T15:40:58.545289+0000","last_clean":"2024-04-17T15:40:58.545289+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:40:58.545289+0000","last_undegraded":"2024-04-17T15:40:58.545289+0000","last_fullsized":"2024-04-17T15:40:58.545289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77594624,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512461+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:40:58.512461+0000","last_peered":"2024-04-17T15:40:58.512461+0000","last_clean":"2024-04-17T15:40:58.512461+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:40:58.512461+0000","last_undegraded":"2024-04-17T15:40:58.512461+0000","last_fullsized":"2024-04-17T15:40:58.512461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"112'37","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210978+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:40:58.210978+0000","last_peered":"2024-04-17T15:40:58.210978+0000","last_clean":"2024-04-17T15:40:58.210978+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:40:58.210978+0000","last_undegraded":"2024-04-17T15:40:58.210978+0000","last_fullsized":"2024-04-17T15:40:58.210978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870042+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:40:58.870042+0000","last_peered":"2024-04-17T15:40:58.870042+0000","last_clean":"2024-04-17T15:40:58.870042+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:40:58.870042+0000","last_undegraded":"2024-04-17T15:40:58.870042+0000","last_fullsized":"2024-04-17T15:40:58.870042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550525+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:40:58.550525+0000","last_peered":"2024-04-17T15:40:58.550525+0000","last_clean":"2024-04-17T15:40:58.550525+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:40:58.550525+0000","last_undegraded":"2024-04-17T15:40:58.550525+0000","last_fullsized":"2024-04-17T15:40:58.550525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870224+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:40:58.870224+0000","last_peered":"2024-04-17T15:40:58.870224+0000","last_clean":"2024-04-17T15:40:58.870224+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:40:58.870224+0000","last_undegraded":"2024-04-17T15:40:58.870224+0000","last_fullsized":"2024-04-17T15:40:58.870224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511901+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:58.511901+0000","last_peered":"2024-04-17T15:40:58.511901+0000","last_clean":"2024-04-17T15:40:58.511901+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:58.511901+0000","last_undegraded":"2024-04-17T15:40:58.511901+0000","last_fullsized":"2024-04-17T15:40:58.511901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'28","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869363+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:40:58.869363+0000","last_peered":"2024-04-17T15:40:58.869363+0000","last_clean":"2024-04-17T15:40:58.869363+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:40:58.869363+0000","last_undegraded":"2024-04-17T15:40:58.869363+0000","last_fullsized":"2024-04-17T15:40:58.869363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211844+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:40:58.211844+0000","last_peered":"2024-04-17T15:40:58.211844+0000","last_clean":"2024-04-17T15:40:58.211844+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:40:58.211844+0000","last_undegraded":"2024-04-17T15:40:58.211844+0000","last_fullsized":"2024-04-17T15:40:58.211844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"130'138","reported_seq":470,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519462+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:41:03.519462+0000","last_peered":"2024-04-17T15:41:03.519462+0000","last_clean":"2024-04-17T15:41:03.519462+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:41:03.519462+0000","last_undegraded":"2024-04-17T15:41:03.519462+0000","last_fullsized":"2024-04-17T15:41:03.519462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513073+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:40:58.513073+0000","last_peered":"2024-04-17T15:40:58.513073+0000","last_clean":"2024-04-17T15:40:58.513073+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:40:58.513073+0000","last_undegraded":"2024-04-17T15:40:58.513073+0000","last_fullsized":"2024-04-17T15:40:58.513073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205369+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:40:58.205369+0000","last_peered":"2024-04-17T15:40:58.205369+0000","last_clean":"2024-04-17T15:40:58.205369+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:40:58.205369+0000","last_undegraded":"2024-04-17T15:40:58.205369+0000","last_fullsized":"2024-04-17T15:40:58.205369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208927+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:40:58.208927+0000","last_peered":"2024-04-17T15:40:58.208927+0000","last_clean":"2024-04-17T15:40:58.208927+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:40:58.208927+0000","last_undegraded":"2024-04-17T15:40:58.208927+0000","last_fullsized":"2024-04-17T15:40:58.208927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831329+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:40:58.831329+0000","last_peered":"2024-04-17T15:40:58.831329+0000","last_clean":"2024-04-17T15:40:58.831329+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:40:58.831329+0000","last_undegraded":"2024-04-17T15:40:58.831329+0000","last_fullsized":"2024-04-17T15:40:58.831329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205552+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:40:58.205552+0000","last_peered":"2024-04-17T15:40:58.205552+0000","last_clean":"2024-04-17T15:40:58.205552+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:40:58.205552+0000","last_undegraded":"2024-04-17T15:40:58.205552+0000","last_fullsized":"2024-04-17T15:40:58.205552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830548+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:40:58.830548+0000","last_peered":"2024-04-17T15:40:58.830548+0000","last_clean":"2024-04-17T15:40:58.830548+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:40:58.830548+0000","last_undegraded":"2024-04-17T15:40:58.830548+0000","last_fullsized":"2024-04-17T15:40:58.830548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'17","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519403+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:41:03.519403+0000","last_peered":"2024-04-17T15:41:03.519403+0000","last_clean":"2024-04-17T15:41:03.519403+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:41:03.519403+0000","last_undegraded":"2024-04-17T15:41:03.519403+0000","last_fullsized":"2024-04-17T15:41:03.519403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869471+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:40:58.869471+0000","last_peered":"2024-04-17T15:40:58.869471+0000","last_clean":"2024-04-17T15:40:58.869471+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:40:58.869471+0000","last_undegraded":"2024-04-17T15:40:58.869471+0000","last_fullsized":"2024-04-17T15:40:58.869471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545821+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:40:58.545821+0000","last_peered":"2024-04-17T15:40:58.545821+0000","last_clean":"2024-04-17T15:40:58.545821+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:40:58.545821+0000","last_undegraded":"2024-04-17T15:40:58.545821+0000","last_fullsized":"2024-04-17T15:40:58.545821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207544+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:40:58.207544+0000","last_peered":"2024-04-17T15:40:58.207544+0000","last_clean":"2024-04-17T15:40:58.207544+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:40:58.207544+0000","last_undegraded":"2024-04-17T15:40:58.207544+0000","last_fullsized":"2024-04-17T15:40:58.207544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207531+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:58.207531+0000","last_peered":"2024-04-17T15:40:58.207531+0000","last_clean":"2024-04-17T15:40:58.207531+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:58.207531+0000","last_undegraded":"2024-04-17T15:40:58.207531+0000","last_fullsized":"2024-04-17T15:40:58.207531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'24","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208931+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:40:58.208931+0000","last_peered":"2024-04-17T15:40:58.208931+0000","last_clean":"2024-04-17T15:40:58.208931+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:40:58.208931+0000","last_undegraded":"2024-04-17T15:40:58.208931+0000","last_fullsized":"2024-04-17T15:40:58.208931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868736+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:40:58.868736+0000","last_peered":"2024-04-17T15:40:58.868736+0000","last_clean":"2024-04-17T15:40:58.868736+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:40:58.868736+0000","last_undegraded":"2024-04-17T15:40:58.868736+0000","last_fullsized":"2024-04-17T15:40:58.868736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547104+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:40:58.547104+0000","last_peered":"2024-04-17T15:40:58.547104+0000","last_clean":"2024-04-17T15:40:58.547104+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:40:58.547104+0000","last_undegraded":"2024-04-17T15:40:58.547104+0000","last_fullsized":"2024-04-17T15:40:58.547104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553452+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:40:58.553452+0000","last_peered":"2024-04-17T15:40:58.553452+0000","last_clean":"2024-04-17T15:40:58.553452+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:40:58.553452+0000","last_undegraded":"2024-04-17T15:40:58.553452+0000","last_fullsized":"2024-04-17T15:40:58.553452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.204708+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:40:58.204708+0000","last_peered":"2024-04-17T15:40:58.204708+0000","last_clean":"2024-04-17T15:40:58.204708+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:40:58.204708+0000","last_undegraded":"2024-04-17T15:40:58.204708+0000","last_fullsized":"2024-04-17T15:40:58.204708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205991+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:40:58.205991+0000","last_peered":"2024-04-17T15:40:58.205991+0000","last_clean":"2024-04-17T15:40:58.205991+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:40:58.205991+0000","last_undegraded":"2024-04-17T15:40:58.205991+0000","last_fullsized":"2024-04-17T15:40:58.205991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211753+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:40:58.211753+0000","last_peered":"2024-04-17T15:40:58.211753+0000","last_clean":"2024-04-17T15:40:58.211753+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:40:58.211753+0000","last_undegraded":"2024-04-17T15:40:58.211753+0000","last_fullsized":"2024-04-17T15:40:58.211753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208313+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:40:58.208313+0000","last_peered":"2024-04-17T15:40:58.208313+0000","last_clean":"2024-04-17T15:40:58.208313+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:40:58.208313+0000","last_undegraded":"2024-04-17T15:40:58.208313+0000","last_fullsized":"2024-04-17T15:40:58.208313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870049+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:40:58.870049+0000","last_peered":"2024-04-17T15:40:58.870049+0000","last_clean":"2024-04-17T15:40:58.870049+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:40:58.870049+0000","last_undegraded":"2024-04-17T15:40:58.870049+0000","last_fullsized":"2024-04-17T15:40:58.870049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"112'34","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869261+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:40:58.869261+0000","last_peered":"2024-04-17T15:40:58.869261+0000","last_clean":"2024-04-17T15:40:58.869261+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:40:58.869261+0000","last_undegraded":"2024-04-17T15:40:58.869261+0000","last_fullsized":"2024-04-17T15:40:58.869261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207208+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:40:58.207208+0000","last_peered":"2024-04-17T15:40:58.207208+0000","last_clean":"2024-04-17T15:40:58.207208+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:40:58.207208+0000","last_undegraded":"2024-04-17T15:40:58.207208+0000","last_fullsized":"2024-04-17T15:40:58.207208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869786+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:40:58.869786+0000","last_peered":"2024-04-17T15:40:58.869786+0000","last_clean":"2024-04-17T15:40:58.869786+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:40:58.869786+0000","last_undegraded":"2024-04-17T15:40:58.869786+0000","last_fullsized":"2024-04-17T15:40:58.869786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870655+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:40:58.870655+0000","last_peered":"2024-04-17T15:40:58.870655+0000","last_clean":"2024-04-17T15:40:58.870655+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:40:58.870655+0000","last_undegraded":"2024-04-17T15:40:58.870655+0000","last_fullsized":"2024-04-17T15:40:58.870655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'21","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207826+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:40:58.207826+0000","last_peered":"2024-04-17T15:40:58.207826+0000","last_clean":"2024-04-17T15:40:58.207826+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:40:58.207826+0000","last_undegraded":"2024-04-17T15:40:58.207826+0000","last_fullsized":"2024-04-17T15:40:58.207826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514348+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:40:58.514348+0000","last_peered":"2024-04-17T15:40:58.514348+0000","last_clean":"2024-04-17T15:40:58.514348+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:40:58.514348+0000","last_undegraded":"2024-04-17T15:40:58.514348+0000","last_fullsized":"2024-04-17T15:40:58.514348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551315+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:40:58.551315+0000","last_peered":"2024-04-17T15:40:58.551315+0000","last_clean":"2024-04-17T15:40:58.551315+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:40:58.551315+0000","last_undegraded":"2024-04-17T15:40:58.551315+0000","last_fullsized":"2024-04-17T15:40:58.551315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205169+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:40:58.205169+0000","last_peered":"2024-04-17T15:40:58.205169+0000","last_clean":"2024-04-17T15:40:58.205169+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:40:58.205169+0000","last_undegraded":"2024-04-17T15:40:58.205169+0000","last_fullsized":"2024-04-17T15:40:58.205169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"130'135","reported_seq":401,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519253+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:41:03.519253+0000","last_peered":"2024-04-17T15:41:03.519253+0000","last_clean":"2024-04-17T15:41:03.519253+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:41:03.519253+0000","last_undegraded":"2024-04-17T15:41:03.519253+0000","last_fullsized":"2024-04-17T15:41:03.519253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546955+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:40:58.546955+0000","last_peered":"2024-04-17T15:40:58.546955+0000","last_clean":"2024-04-17T15:40:58.546955+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:40:58.546955+0000","last_undegraded":"2024-04-17T15:40:58.546955+0000","last_fullsized":"2024-04-17T15:40:58.546955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544700+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:40:58.544700+0000","last_peered":"2024-04-17T15:40:58.544700+0000","last_clean":"2024-04-17T15:40:58.544700+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:40:58.544700+0000","last_undegraded":"2024-04-17T15:40:58.544700+0000","last_fullsized":"2024-04-17T15:40:58.544700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'20","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546637+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:40:58.546637+0000","last_peered":"2024-04-17T15:40:58.546637+0000","last_clean":"2024-04-17T15:40:58.546637+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:40:58.546637+0000","last_undegraded":"2024-04-17T15:40:58.546637+0000","last_fullsized":"2024-04-17T15:40:58.546637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208024+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:40:58.208024+0000","last_peered":"2024-04-17T15:40:58.208024+0000","last_clean":"2024-04-17T15:40:58.208024+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:40:58.208024+0000","last_undegraded":"2024-04-17T15:40:58.208024+0000","last_fullsized":"2024-04-17T15:40:58.208024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207721+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:40:58.207721+0000","last_peered":"2024-04-17T15:40:58.207721+0000","last_clean":"2024-04-17T15:40:58.207721+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:40:58.207721+0000","last_undegraded":"2024-04-17T15:40:58.207721+0000","last_fullsized":"2024-04-17T15:40:58.207721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208760+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:40:58.208760+0000","last_peered":"2024-04-17T15:40:58.208760+0000","last_clean":"2024-04-17T15:40:58.208760+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:40:58.208760+0000","last_undegraded":"2024-04-17T15:40:58.208760+0000","last_fullsized":"2024-04-17T15:40:58.208760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'135","reported_seq":400,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519487+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:41:03.519487+0000","last_peered":"2024-04-17T15:41:03.519487+0000","last_clean":"2024-04-17T15:41:03.519487+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:41:03.519487+0000","last_undegraded":"2024-04-17T15:41:03.519487+0000","last_fullsized":"2024-04-17T15:41:03.519487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869584+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:40:58.869584+0000","last_peered":"2024-04-17T15:40:58.869584+0000","last_clean":"2024-04-17T15:40:58.869584+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:40:58.869584+0000","last_undegraded":"2024-04-17T15:40:58.869584+0000","last_fullsized":"2024-04-17T15:40:58.869584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208160+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:40:58.208160+0000","last_peered":"2024-04-17T15:40:58.208160+0000","last_clean":"2024-04-17T15:40:58.208160+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:40:58.208160+0000","last_undegraded":"2024-04-17T15:40:58.208160+0000","last_fullsized":"2024-04-17T15:40:58.208160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870384+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:40:58.870384+0000","last_peered":"2024-04-17T15:40:58.870384+0000","last_clean":"2024-04-17T15:40:58.870384+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:40:58.870384+0000","last_undegraded":"2024-04-17T15:40:58.870384+0000","last_fullsized":"2024-04-17T15:40:58.870384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553838+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:40:58.553838+0000","last_peered":"2024-04-17T15:40:58.553838+0000","last_clean":"2024-04-17T15:40:58.553838+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:40:58.553838+0000","last_undegraded":"2024-04-17T15:40:58.553838+0000","last_fullsized":"2024-04-17T15:40:58.553838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544172+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:40:58.544172+0000","last_peered":"2024-04-17T15:40:58.544172+0000","last_clean":"2024-04-17T15:40:58.544172+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:40:58.544172+0000","last_undegraded":"2024-04-17T15:40:58.544172+0000","last_fullsized":"2024-04-17T15:40:58.544172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"112'46","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511814+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:40:58.511814+0000","last_peered":"2024-04-17T15:40:58.511814+0000","last_clean":"2024-04-17T15:40:58.511814+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:40:58.511814+0000","last_undegraded":"2024-04-17T15:40:58.511814+0000","last_fullsized":"2024-04-17T15:40:58.511814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":45,"num_read_kb":34,"num_write":28,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545031+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:40:58.545031+0000","last_peered":"2024-04-17T15:40:58.545031+0000","last_clean":"2024-04-17T15:40:58.545031+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:40:58.545031+0000","last_undegraded":"2024-04-17T15:40:58.545031+0000","last_fullsized":"2024-04-17T15:40:58.545031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205831+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:40:58.205831+0000","last_peered":"2024-04-17T15:40:58.205831+0000","last_clean":"2024-04-17T15:40:58.205831+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:40:58.205831+0000","last_undegraded":"2024-04-17T15:40:58.205831+0000","last_fullsized":"2024-04-17T15:40:58.205831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869887+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:40:58.869887+0000","last_peered":"2024-04-17T15:40:58.869887+0000","last_clean":"2024-04-17T15:40:58.869887+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:40:58.869887+0000","last_undegraded":"2024-04-17T15:40:58.869887+0000","last_fullsized":"2024-04-17T15:40:58.869887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207678+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:40:58.207678+0000","last_peered":"2024-04-17T15:40:58.207678+0000","last_clean":"2024-04-17T15:40:58.207678+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:40:58.207678+0000","last_undegraded":"2024-04-17T15:40:58.207678+0000","last_fullsized":"2024-04-17T15:40:58.207678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'27","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207428+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:40:58.207428+0000","last_peered":"2024-04-17T15:40:58.207428+0000","last_clean":"2024-04-17T15:40:58.207428+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:40:58.207428+0000","last_undegraded":"2024-04-17T15:40:58.207428+0000","last_fullsized":"2024-04-17T15:40:58.207428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205988+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:40:58.205988+0000","last_peered":"2024-04-17T15:40:58.205988+0000","last_clean":"2024-04-17T15:40:58.205988+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:40:58.205988+0000","last_undegraded":"2024-04-17T15:40:58.205988+0000","last_fullsized":"2024-04-17T15:40:58.205988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"112'19","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544621+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:40:58.544621+0000","last_peered":"2024-04-17T15:40:58.544621+0000","last_clean":"2024-04-17T15:40:58.544621+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:40:58.544621+0000","last_undegraded":"2024-04-17T15:40:58.544621+0000","last_fullsized":"2024-04-17T15:40:58.544621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544482+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:40:58.544482+0000","last_peered":"2024-04-17T15:40:58.544482+0000","last_clean":"2024-04-17T15:40:58.544482+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:40:58.544482+0000","last_undegraded":"2024-04-17T15:40:58.544482+0000","last_fullsized":"2024-04-17T15:40:58.544482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546660+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:40:58.546660+0000","last_peered":"2024-04-17T15:40:58.546660+0000","last_clean":"2024-04-17T15:40:58.546660+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:40:58.546660+0000","last_undegraded":"2024-04-17T15:40:58.546660+0000","last_fullsized":"2024-04-17T15:40:58.546660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":195,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205059+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:58.205059+0000","last_peered":"2024-04-17T15:40:58.205059+0000","last_clean":"2024-04-17T15:40:58.205059+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:58.205059+0000","last_undegraded":"2024-04-17T15:40:58.205059+0000","last_fullsized":"2024-04-17T15:40:58.205059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"111'24","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513793+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:40:58.513793+0000","last_peered":"2024-04-17T15:40:58.513793+0000","last_clean":"2024-04-17T15:40:58.513793+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:40:58.513793+0000","last_undegraded":"2024-04-17T15:40:58.513793+0000","last_fullsized":"2024-04-17T15:40:58.513793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":314,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545728+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:40:58.545728+0000","last_peered":"2024-04-17T15:40:58.545728+0000","last_clean":"2024-04-17T15:40:58.545728+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:40:58.545728+0000","last_undegraded":"2024-04-17T15:40:58.545728+0000","last_fullsized":"2024-04-17T15:40:58.545728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'9","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869028+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:58.869028+0000","last_peered":"2024-04-17T15:40:58.869028+0000","last_clean":"2024-04-17T15:40:58.869028+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:58.869028+0000","last_undegraded":"2024-04-17T15:40:58.869028+0000","last_fullsized":"2024-04-17T15:40:58.869028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511688+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:58.511688+0000","last_peered":"2024-04-17T15:40:58.511688+0000","last_clean":"2024-04-17T15:40:58.511688+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:58.511688+0000","last_undegraded":"2024-04-17T15:40:58.511688+0000","last_fullsized":"2024-04-17T15:40:58.511688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870459+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:58.870459+0000","last_peered":"2024-04-17T15:40:58.870459+0000","last_clean":"2024-04-17T15:40:58.870459+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:58.870459+0000","last_undegraded":"2024-04-17T15:40:58.870459+0000","last_fullsized":"2024-04-17T15:40:58.870459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544795+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:40:58.544795+0000","last_peered":"2024-04-17T15:40:58.544795+0000","last_clean":"2024-04-17T15:40:58.544795+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:40:58.544795+0000","last_undegraded":"2024-04-17T15:40:58.544795+0000","last_fullsized":"2024-04-17T15:40:58.544795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'31","reported_seq":209,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831790+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:40:58.831790+0000","last_peered":"2024-04-17T15:40:58.831790+0000","last_clean":"2024-04-17T15:40:58.831790+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:40:58.831790+0000","last_undegraded":"2024-04-17T15:40:58.831790+0000","last_fullsized":"2024-04-17T15:40:58.831790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510907+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:40:58.510907+0000","last_peered":"2024-04-17T15:40:58.510907+0000","last_clean":"2024-04-17T15:40:58.510907+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:40:58.510907+0000","last_undegraded":"2024-04-17T15:40:58.510907+0000","last_fullsized":"2024-04-17T15:40:58.510907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"112'19","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545552+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:40:58.545552+0000","last_peered":"2024-04-17T15:40:58.545552+0000","last_clean":"2024-04-17T15:40:58.545552+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:40:58.545552+0000","last_undegraded":"2024-04-17T15:40:58.545552+0000","last_fullsized":"2024-04-17T15:40:58.545552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551183+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:40:58.551183+0000","last_peered":"2024-04-17T15:40:58.551183+0000","last_clean":"2024-04-17T15:40:58.551183+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:40:58.551183+0000","last_undegraded":"2024-04-17T15:40:58.551183+0000","last_fullsized":"2024-04-17T15:40:58.551183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205899+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:58.205899+0000","last_peered":"2024-04-17T15:40:58.205899+0000","last_clean":"2024-04-17T15:40:58.205899+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:58.205899+0000","last_undegraded":"2024-04-17T15:40:58.205899+0000","last_fullsized":"2024-04-17T15:40:58.205899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544812+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:40:58.544812+0000","last_peered":"2024-04-17T15:40:58.544812+0000","last_clean":"2024-04-17T15:40:58.544812+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:40:58.544812+0000","last_undegraded":"2024-04-17T15:40:58.544812+0000","last_fullsized":"2024-04-17T15:40:58.544812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870440+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:40:58.870440+0000","last_peered":"2024-04-17T15:40:58.870440+0000","last_clean":"2024-04-17T15:40:58.870440+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:40:58.870440+0000","last_undegraded":"2024-04-17T15:40:58.870440+0000","last_fullsized":"2024-04-17T15:40:58.870440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550102+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:40:58.550102+0000","last_peered":"2024-04-17T15:40:58.550102+0000","last_clean":"2024-04-17T15:40:58.550102+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:40:58.550102+0000","last_undegraded":"2024-04-17T15:40:58.550102+0000","last_fullsized":"2024-04-17T15:40:58.550102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"112'18","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511513+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:40:58.511513+0000","last_peered":"2024-04-17T15:40:58.511513+0000","last_clean":"2024-04-17T15:40:58.511513+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:40:58.511513+0000","last_undegraded":"2024-04-17T15:40:58.511513+0000","last_fullsized":"2024-04-17T15:40:58.511513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870490+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:40:58.870490+0000","last_peered":"2024-04-17T15:40:58.870490+0000","last_clean":"2024-04-17T15:40:58.870490+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:40:58.870490+0000","last_undegraded":"2024-04-17T15:40:58.870490+0000","last_fullsized":"2024-04-17T15:40:58.870490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553733+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:40:58.553733+0000","last_peered":"2024-04-17T15:40:58.553733+0000","last_clean":"2024-04-17T15:40:58.553733+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:40:58.553733+0000","last_undegraded":"2024-04-17T15:40:58.553733+0000","last_fullsized":"2024-04-17T15:40:58.553733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545267+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:40:58.545267+0000","last_peered":"2024-04-17T15:40:58.545267+0000","last_clean":"2024-04-17T15:40:58.545267+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:40:58.545267+0000","last_undegraded":"2024-04-17T15:40:58.545267+0000","last_fullsized":"2024-04-17T15:40:58.545267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870131+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:40:58.870131+0000","last_peered":"2024-04-17T15:40:58.870131+0000","last_clean":"2024-04-17T15:40:58.870131+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:40:58.870131+0000","last_undegraded":"2024-04-17T15:40:58.870131+0000","last_fullsized":"2024-04-17T15:40:58.870131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"112'28","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206882+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:40:58.206882+0000","last_peered":"2024-04-17T15:40:58.206882+0000","last_clean":"2024-04-17T15:40:58.206882+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:40:58.206882+0000","last_undegraded":"2024-04-17T15:40:58.206882+0000","last_fullsized":"2024-04-17T15:40:58.206882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206391+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:40:58.206391+0000","last_peered":"2024-04-17T15:40:58.206391+0000","last_clean":"2024-04-17T15:40:58.206391+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:40:58.206391+0000","last_undegraded":"2024-04-17T15:40:58.206391+0000","last_fullsized":"2024-04-17T15:40:58.206391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545154+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:58.545154+0000","last_peered":"2024-04-17T15:40:58.545154+0000","last_clean":"2024-04-17T15:40:58.545154+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:58.545154+0000","last_undegraded":"2024-04-17T15:40:58.545154+0000","last_fullsized":"2024-04-17T15:40:58.545154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870197+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:40:58.870197+0000","last_peered":"2024-04-17T15:40:58.870197+0000","last_clean":"2024-04-17T15:40:58.870197+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:40:58.870197+0000","last_undegraded":"2024-04-17T15:40:58.870197+0000","last_fullsized":"2024-04-17T15:40:58.870197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206746+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:40:58.206746+0000","last_peered":"2024-04-17T15:40:58.206746+0000","last_clean":"2024-04-17T15:40:58.206746+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:40:58.206746+0000","last_undegraded":"2024-04-17T15:40:58.206746+0000","last_fullsized":"2024-04-17T15:40:58.206746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550274+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:40:58.550274+0000","last_peered":"2024-04-17T15:40:58.550274+0000","last_clean":"2024-04-17T15:40:58.550274+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:40:58.550274+0000","last_undegraded":"2024-04-17T15:40:58.550274+0000","last_fullsized":"2024-04-17T15:40:58.550274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"112'23","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512168+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:40:58.512168+0000","last_peered":"2024-04-17T15:40:58.512168+0000","last_clean":"2024-04-17T15:40:58.512168+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:40:58.512168+0000","last_undegraded":"2024-04-17T15:40:58.512168+0000","last_fullsized":"2024-04-17T15:40:58.512168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207231+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:58.207231+0000","last_peered":"2024-04-17T15:40:58.207231+0000","last_clean":"2024-04-17T15:40:58.207231+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:58.207231+0000","last_undegraded":"2024-04-17T15:40:58.207231+0000","last_fullsized":"2024-04-17T15:40:58.207231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550842+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:58.550842+0000","last_peered":"2024-04-17T15:40:58.550842+0000","last_clean":"2024-04-17T15:40:58.550842+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:58.550842+0000","last_undegraded":"2024-04-17T15:40:58.550842+0000","last_fullsized":"2024-04-17T15:40:58.550842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546595+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:40:58.546595+0000","last_peered":"2024-04-17T15:40:58.546595+0000","last_clean":"2024-04-17T15:40:58.546595+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:40:58.546595+0000","last_undegraded":"2024-04-17T15:40:58.546595+0000","last_fullsized":"2024-04-17T15:40:58.546595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'28","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209461+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:40:58.209461+0000","last_peered":"2024-04-17T15:40:58.209461+0000","last_clean":"2024-04-17T15:40:58.209461+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:40:58.209461+0000","last_undegraded":"2024-04-17T15:40:58.209461+0000","last_fullsized":"2024-04-17T15:40:58.209461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209537+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:58.209537+0000","last_peered":"2024-04-17T15:40:58.209537+0000","last_clean":"2024-04-17T15:40:58.209537+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:58.209537+0000","last_undegraded":"2024-04-17T15:40:58.209537+0000","last_fullsized":"2024-04-17T15:40:58.209537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"112'21","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547094+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:40:58.547094+0000","last_peered":"2024-04-17T15:40:58.547094+0000","last_clean":"2024-04-17T15:40:58.547094+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:40:58.547094+0000","last_undegraded":"2024-04-17T15:40:58.547094+0000","last_fullsized":"2024-04-17T15:40:58.547094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206857+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:40:58.206857+0000","last_peered":"2024-04-17T15:40:58.206857+0000","last_clean":"2024-04-17T15:40:58.206857+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:40:58.206857+0000","last_undegraded":"2024-04-17T15:40:58.206857+0000","last_fullsized":"2024-04-17T15:40:58.206857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205399+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:58.205399+0000","last_peered":"2024-04-17T15:40:58.205399+0000","last_clean":"2024-04-17T15:40:58.205399+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:58.205399+0000","last_undegraded":"2024-04-17T15:40:58.205399+0000","last_fullsized":"2024-04-17T15:40:58.205399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832037+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:40:58.832037+0000","last_peered":"2024-04-17T15:40:58.832037+0000","last_clean":"2024-04-17T15:40:58.832037+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:40:58.832037+0000","last_undegraded":"2024-04-17T15:40:58.832037+0000","last_fullsized":"2024-04-17T15:40:58.832037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'27","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869598+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:40:58.869598+0000","last_peered":"2024-04-17T15:40:58.869598+0000","last_clean":"2024-04-17T15:40:58.869598+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:40:58.869598+0000","last_undegraded":"2024-04-17T15:40:58.869598+0000","last_fullsized":"2024-04-17T15:40:58.869598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207897+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:40:58.207897+0000","last_peered":"2024-04-17T15:40:58.207897+0000","last_clean":"2024-04-17T15:40:58.207897+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:40:58.207897+0000","last_undegraded":"2024-04-17T15:40:58.207897+0000","last_fullsized":"2024-04-17T15:40:58.207897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"98'12","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210312+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:40:58.210312+0000","last_peered":"2024-04-17T15:40:58.210312+0000","last_clean":"2024-04-17T15:40:58.210312+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:40:58.210312+0000","last_undegraded":"2024-04-17T15:40:58.210312+0000","last_fullsized":"2024-04-17T15:40:58.210312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"130'135","reported_seq":400,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.519394+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:41:03.519394+0000","last_peered":"2024-04-17T15:41:03.519394+0000","last_clean":"2024-04-17T15:41:03.519394+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:41:03.519394+0000","last_undegraded":"2024-04-17T15:41:03.519394+0000","last_fullsized":"2024-04-17T15:41:03.519394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511119+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:58.511119+0000","last_peered":"2024-04-17T15:40:58.511119+0000","last_clean":"2024-04-17T15:40:58.511119+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:58.511119+0000","last_undegraded":"2024-04-17T15:40:58.511119+0000","last_fullsized":"2024-04-17T15:40:58.511119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207401+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:58.207401+0000","last_peered":"2024-04-17T15:40:58.207401+0000","last_clean":"2024-04-17T15:40:58.207401+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:58.207401+0000","last_undegraded":"2024-04-17T15:40:58.207401+0000","last_fullsized":"2024-04-17T15:40:58.207401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206878+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:40:58.206878+0000","last_peered":"2024-04-17T15:40:58.206878+0000","last_clean":"2024-04-17T15:40:58.206878+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:40:58.206878+0000","last_undegraded":"2024-04-17T15:40:58.206878+0000","last_fullsized":"2024-04-17T15:40:58.206878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510932+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:40:58.510932+0000","last_peered":"2024-04-17T15:40:58.510932+0000","last_clean":"2024-04-17T15:40:58.510932+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:40:58.510932+0000","last_undegraded":"2024-04-17T15:40:58.510932+0000","last_fullsized":"2024-04-17T15:40:58.510932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"112'23","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206404+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:40:58.206404+0000","last_peered":"2024-04-17T15:40:58.206404+0000","last_clean":"2024-04-17T15:40:58.206404+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:40:58.206404+0000","last_undegraded":"2024-04-17T15:40:58.206404+0000","last_fullsized":"2024-04-17T15:40:58.206404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868782+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:40:58.868782+0000","last_peered":"2024-04-17T15:40:58.868782+0000","last_clean":"2024-04-17T15:40:58.868782+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:40:58.868782+0000","last_undegraded":"2024-04-17T15:40:58.868782+0000","last_fullsized":"2024-04-17T15:40:58.868782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514028+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:58.514028+0000","last_peered":"2024-04-17T15:40:58.514028+0000","last_clean":"2024-04-17T15:40:58.514028+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:58.514028+0000","last_undegraded":"2024-04-17T15:40:58.514028+0000","last_fullsized":"2024-04-17T15:40:58.514028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208859+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:58.208859+0000","last_peered":"2024-04-17T15:40:58.208859+0000","last_clean":"2024-04-17T15:40:58.208859+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:58.208859+0000","last_undegraded":"2024-04-17T15:40:58.208859+0000","last_fullsized":"2024-04-17T15:40:58.208859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211358+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:40:58.211358+0000","last_peered":"2024-04-17T15:40:58.211358+0000","last_clean":"2024-04-17T15:40:58.211358+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:40:58.211358+0000","last_undegraded":"2024-04-17T15:40:58.211358+0000","last_fullsized":"2024-04-17T15:40:58.211358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205705+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:58.205705+0000","last_peered":"2024-04-17T15:40:58.205705+0000","last_clean":"2024-04-17T15:40:58.205705+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:58.205705+0000","last_undegraded":"2024-04-17T15:40:58.205705+0000","last_fullsized":"2024-04-17T15:40:58.205705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"112'18","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868852+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:40:58.868852+0000","last_peered":"2024-04-17T15:40:58.868852+0000","last_clean":"2024-04-17T15:40:58.868852+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:40:58.868852+0000","last_undegraded":"2024-04-17T15:40:58.868852+0000","last_fullsized":"2024-04-17T15:40:58.868852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550780+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:40:58.550780+0000","last_peered":"2024-04-17T15:40:58.550780+0000","last_clean":"2024-04-17T15:40:58.550780+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:40:58.550780+0000","last_undegraded":"2024-04-17T15:40:58.550780+0000","last_fullsized":"2024-04-17T15:40:58.550780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546804+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:58.546804+0000","last_peered":"2024-04-17T15:40:58.546804+0000","last_clean":"2024-04-17T15:40:58.546804+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:58.546804+0000","last_undegraded":"2024-04-17T15:40:58.546804+0000","last_fullsized":"2024-04-17T15:40:58.546804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544901+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:40:58.544901+0000","last_peered":"2024-04-17T15:40:58.544901+0000","last_clean":"2024-04-17T15:40:58.544901+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:40:58.544901+0000","last_undegraded":"2024-04-17T15:40:58.544901+0000","last_fullsized":"2024-04-17T15:40:58.544901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'22","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547319+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:40:58.547319+0000","last_peered":"2024-04-17T15:40:58.547319+0000","last_clean":"2024-04-17T15:40:58.547319+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:40:58.547319+0000","last_undegraded":"2024-04-17T15:40:58.547319+0000","last_fullsized":"2024-04-17T15:40:58.547319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205607+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:40:58.205607+0000","last_peered":"2024-04-17T15:40:58.205607+0000","last_clean":"2024-04-17T15:40:58.205607+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:40:58.205607+0000","last_undegraded":"2024-04-17T15:40:58.205607+0000","last_fullsized":"2024-04-17T15:40:58.205607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"112'13","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546215+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:40:58.546215+0000","last_peered":"2024-04-17T15:40:58.546215+0000","last_clean":"2024-04-17T15:40:58.546215+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:40:58.546215+0000","last_undegraded":"2024-04-17T15:40:58.546215+0000","last_fullsized":"2024-04-17T15:40:58.546215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207130+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:58.207130+0000","last_peered":"2024-04-17T15:40:58.207130+0000","last_clean":"2024-04-17T15:40:58.207130+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:58.207130+0000","last_undegraded":"2024-04-17T15:40:58.207130+0000","last_fullsized":"2024-04-17T15:40:58.207130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513344+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:58.513344+0000","last_peered":"2024-04-17T15:40:58.513344+0000","last_clean":"2024-04-17T15:40:58.513344+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:58.513344+0000","last_undegraded":"2024-04-17T15:40:58.513344+0000","last_fullsized":"2024-04-17T15:40:58.513344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206775+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:40:58.206775+0000","last_peered":"2024-04-17T15:40:58.206775+0000","last_clean":"2024-04-17T15:40:58.206775+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:40:58.206775+0000","last_undegraded":"2024-04-17T15:40:58.206775+0000","last_fullsized":"2024-04-17T15:40:58.206775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'22","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870410+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:40:58.870410+0000","last_peered":"2024-04-17T15:40:58.870410+0000","last_clean":"2024-04-17T15:40:58.870410+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:40:58.870410+0000","last_undegraded":"2024-04-17T15:40:58.870410+0000","last_fullsized":"2024-04-17T15:40:58.870410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205395+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:40:58.205395+0000","last_peered":"2024-04-17T15:40:58.205395+0000","last_clean":"2024-04-17T15:40:58.205395+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:40:58.205395+0000","last_undegraded":"2024-04-17T15:40:58.205395+0000","last_fullsized":"2024-04-17T15:40:58.205395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"112'18","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207629+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:40:58.207629+0000","last_peered":"2024-04-17T15:40:58.207629+0000","last_clean":"2024-04-17T15:40:58.207629+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:40:58.207629+0000","last_undegraded":"2024-04-17T15:40:58.207629+0000","last_fullsized":"2024-04-17T15:40:58.207629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869445+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:40:58.869445+0000","last_peered":"2024-04-17T15:40:58.869445+0000","last_clean":"2024-04-17T15:40:58.869445+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:40:58.869445+0000","last_undegraded":"2024-04-17T15:40:58.869445+0000","last_fullsized":"2024-04-17T15:40:58.869445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209600+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:58.209600+0000","last_peered":"2024-04-17T15:40:58.209600+0000","last_clean":"2024-04-17T15:40:58.209600+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:58.209600+0000","last_undegraded":"2024-04-17T15:40:58.209600+0000","last_fullsized":"2024-04-17T15:40:58.209600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208657+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:40:58.208657+0000","last_peered":"2024-04-17T15:40:58.208657+0000","last_clean":"2024-04-17T15:40:58.208657+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:40:58.208657+0000","last_undegraded":"2024-04-17T15:40:58.208657+0000","last_fullsized":"2024-04-17T15:40:58.208657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550802+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:40:58.550802+0000","last_peered":"2024-04-17T15:40:58.550802+0000","last_clean":"2024-04-17T15:40:58.550802+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:40:58.550802+0000","last_undegraded":"2024-04-17T15:40:58.550802+0000","last_fullsized":"2024-04-17T15:40:58.550802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207501+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:40:58.207501+0000","last_peered":"2024-04-17T15:40:58.207501+0000","last_clean":"2024-04-17T15:40:58.207501+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:40:58.207501+0000","last_undegraded":"2024-04-17T15:40:58.207501+0000","last_fullsized":"2024-04-17T15:40:58.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831195+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:40:58.831195+0000","last_peered":"2024-04-17T15:40:58.831195+0000","last_clean":"2024-04-17T15:40:58.831195+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:40:58.831195+0000","last_undegraded":"2024-04-17T15:40:58.831195+0000","last_fullsized":"2024-04-17T15:40:58.831195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210291+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:40:58.210291+0000","last_peered":"2024-04-17T15:40:58.210291+0000","last_clean":"2024-04-17T15:40:58.210291+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:40:58.210291+0000","last_undegraded":"2024-04-17T15:40:58.210291+0000","last_fullsized":"2024-04-17T15:40:58.210291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207297+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:40:58.207297+0000","last_peered":"2024-04-17T15:40:58.207297+0000","last_clean":"2024-04-17T15:40:58.207297+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:40:58.207297+0000","last_undegraded":"2024-04-17T15:40:58.207297+0000","last_fullsized":"2024-04-17T15:40:58.207297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207964+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:40:58.207964+0000","last_peered":"2024-04-17T15:40:58.207964+0000","last_clean":"2024-04-17T15:40:58.207964+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:40:58.207964+0000","last_undegraded":"2024-04-17T15:40:58.207964+0000","last_fullsized":"2024-04-17T15:40:58.207964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'21","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869962+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:40:58.869962+0000","last_peered":"2024-04-17T15:40:58.869962+0000","last_clean":"2024-04-17T15:40:58.869962+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:40:58.869962+0000","last_undegraded":"2024-04-17T15:40:58.869962+0000","last_fullsized":"2024-04-17T15:40:58.869962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546037+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:40:58.546037+0000","last_peered":"2024-04-17T15:40:58.546037+0000","last_clean":"2024-04-17T15:40:58.546037+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:40:58.546037+0000","last_undegraded":"2024-04-17T15:40:58.546037+0000","last_fullsized":"2024-04-17T15:40:58.546037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"111'25","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831752+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:40:58.831752+0000","last_peered":"2024-04-17T15:40:58.831752+0000","last_clean":"2024-04-17T15:40:58.831752+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:40:58.831752+0000","last_undegraded":"2024-04-17T15:40:58.831752+0000","last_fullsized":"2024-04-17T15:40:58.831752+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209479+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:40:58.209479+0000","last_peered":"2024-04-17T15:40:58.209479+0000","last_clean":"2024-04-17T15:40:58.209479+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:40:58.209479+0000","last_undegraded":"2024-04-17T15:40:58.209479+0000","last_fullsized":"2024-04-17T15:40:58.209479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'32","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208331+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:40:58.208331+0000","last_peered":"2024-04-17T15:40:58.208331+0000","last_clean":"2024-04-17T15:40:58.208331+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:40:58.208331+0000","last_undegraded":"2024-04-17T15:40:58.208331+0000","last_fullsized":"2024-04-17T15:40:58.208331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544752+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:40:58.544752+0000","last_peered":"2024-04-17T15:40:58.544752+0000","last_clean":"2024-04-17T15:40:58.544752+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:40:58.544752+0000","last_undegraded":"2024-04-17T15:40:58.544752+0000","last_fullsized":"2024-04-17T15:40:58.544752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'25","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553487+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:40:58.553487+0000","last_peered":"2024-04-17T15:40:58.553487+0000","last_clean":"2024-04-17T15:40:58.553487+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:40:58.553487+0000","last_undegraded":"2024-04-17T15:40:58.553487+0000","last_fullsized":"2024-04-17T15:40:58.553487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550656+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:40:58.550656+0000","last_peered":"2024-04-17T15:40:58.550656+0000","last_clean":"2024-04-17T15:40:58.550656+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:40:58.550656+0000","last_undegraded":"2024-04-17T15:40:58.550656+0000","last_fullsized":"2024-04-17T15:40:58.550656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546883+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:40:58.546883+0000","last_peered":"2024-04-17T15:40:58.546883+0000","last_clean":"2024-04-17T15:40:58.546883+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:40:58.546883+0000","last_undegraded":"2024-04-17T15:40:58.546883+0000","last_fullsized":"2024-04-17T15:40:58.546883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870300+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:40:58.870300+0000","last_peered":"2024-04-17T15:40:58.870300+0000","last_clean":"2024-04-17T15:40:58.870300+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:40:58.870300+0000","last_undegraded":"2024-04-17T15:40:58.870300+0000","last_fullsized":"2024-04-17T15:40:58.870300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205823+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:40:58.205823+0000","last_peered":"2024-04-17T15:40:58.205823+0000","last_clean":"2024-04-17T15:40:58.205823+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:40:58.205823+0000","last_undegraded":"2024-04-17T15:40:58.205823+0000","last_fullsized":"2024-04-17T15:40:58.205823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212281+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:40:58.212281+0000","last_peered":"2024-04-17T15:40:58.212281+0000","last_clean":"2024-04-17T15:40:58.212281+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:40:58.212281+0000","last_undegraded":"2024-04-17T15:40:58.212281+0000","last_fullsized":"2024-04-17T15:40:58.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"111'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544966+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:40:58.544966+0000","last_peered":"2024-04-17T15:40:58.544966+0000","last_clean":"2024-04-17T15:40:58.544966+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:40:58.544966+0000","last_undegraded":"2024-04-17T15:40:58.544966+0000","last_fullsized":"2024-04-17T15:40:58.544966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832094+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:40:58.832094+0000","last_peered":"2024-04-17T15:40:58.832094+0000","last_clean":"2024-04-17T15:40:58.832094+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:40:58.832094+0000","last_undegraded":"2024-04-17T15:40:58.832094+0000","last_fullsized":"2024-04-17T15:40:58.832094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'24","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206917+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:40:58.206917+0000","last_peered":"2024-04-17T15:40:58.206917+0000","last_clean":"2024-04-17T15:40:58.206917+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:40:58.206917+0000","last_undegraded":"2024-04-17T15:40:58.206917+0000","last_fullsized":"2024-04-17T15:40:58.206917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209083+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:40:58.209083+0000","last_peered":"2024-04-17T15:40:58.209083+0000","last_clean":"2024-04-17T15:40:58.209083+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:40:58.209083+0000","last_undegraded":"2024-04-17T15:40:58.209083+0000","last_fullsized":"2024-04-17T15:40:58.209083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870191+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:40:58.870191+0000","last_peered":"2024-04-17T15:40:58.870191+0000","last_clean":"2024-04-17T15:40:58.870191+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:40:58.870191+0000","last_undegraded":"2024-04-17T15:40:58.870191+0000","last_fullsized":"2024-04-17T15:40:58.870191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512328+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:40:58.512328+0000","last_peered":"2024-04-17T15:40:58.512328+0000","last_clean":"2024-04-17T15:40:58.512328+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:40:58.512328+0000","last_undegraded":"2024-04-17T15:40:58.512328+0000","last_fullsized":"2024-04-17T15:40:58.512328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552057+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:40:58.552057+0000","last_peered":"2024-04-17T15:40:58.552057+0000","last_clean":"2024-04-17T15:40:58.552057+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:40:58.552057+0000","last_undegraded":"2024-04-17T15:40:58.552057+0000","last_fullsized":"2024-04-17T15:40:58.552057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869267+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:40:58.869267+0000","last_peered":"2024-04-17T15:40:58.869267+0000","last_clean":"2024-04-17T15:40:58.869267+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:40:58.869267+0000","last_undegraded":"2024-04-17T15:40:58.869267+0000","last_fullsized":"2024-04-17T15:40:58.869267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'20","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514166+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:40:58.514166+0000","last_peered":"2024-04-17T15:40:58.514166+0000","last_clean":"2024-04-17T15:40:58.514166+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:40:58.514166+0000","last_undegraded":"2024-04-17T15:40:58.514166+0000","last_fullsized":"2024-04-17T15:40:58.514166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830799+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:40:58.830799+0000","last_peered":"2024-04-17T15:40:58.830799+0000","last_clean":"2024-04-17T15:40:58.830799+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:40:58.830799+0000","last_undegraded":"2024-04-17T15:40:58.830799+0000","last_fullsized":"2024-04-17T15:40:58.830799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"111'16","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832080+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:40:58.832080+0000","last_peered":"2024-04-17T15:40:58.832080+0000","last_clean":"2024-04-17T15:40:58.832080+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:40:58.832080+0000","last_undegraded":"2024-04-17T15:40:58.832080+0000","last_fullsized":"2024-04-17T15:40:58.832080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511460+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:40:58.511460+0000","last_peered":"2024-04-17T15:40:58.511460+0000","last_clean":"2024-04-17T15:40:58.511460+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:40:58.511460+0000","last_undegraded":"2024-04-17T15:40:58.511460+0000","last_fullsized":"2024-04-17T15:40:58.511460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'24","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"111'33","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205512+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:40:58.205512+0000","last_peered":"2024-04-17T15:40:58.205512+0000","last_clean":"2024-04-17T15:40:58.205512+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:40:58.205512+0000","last_undegraded":"2024-04-17T15:40:58.205512+0000","last_fullsized":"2024-04-17T15:40:58.205512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870275+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:40:58.870275+0000","last_peered":"2024-04-17T15:40:58.870275+0000","last_clean":"2024-04-17T15:40:58.870275+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:40:58.870275+0000","last_undegraded":"2024-04-17T15:40:58.870275+0000","last_fullsized":"2024-04-17T15:40:58.870275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'14","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206299+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:40:58.206299+0000","last_peered":"2024-04-17T15:40:58.206299+0000","last_clean":"2024-04-17T15:40:58.206299+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:40:58.206299+0000","last_undegraded":"2024-04-17T15:40:58.206299+0000","last_fullsized":"2024-04-17T15:40:58.206299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210809+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:40:58.210809+0000","last_peered":"2024-04-17T15:40:58.210809+0000","last_clean":"2024-04-17T15:40:58.210809+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:40:58.210809+0000","last_undegraded":"2024-04-17T15:40:58.210809+0000","last_fullsized":"2024-04-17T15:40:58.210809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1080,"ondisk_log_size":1080,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":374963,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":851,"num_read_kb":619,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":710066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1817372,"kb_used_data":1786196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92554468,"statfs":{"total":96636764160,"available":94775775232,"internally_reserved":0,"allocated":1829064704,"data_stored":1828373077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1179776,"kb_used_data":1148600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93192064,"statfs":{"total":96636764160,"available":95428673536,"internally_reserved":0,"allocated":1176166400,"data_stored":1175509012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716408,"kb_used_data":1681072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92655432,"statfs":{"total":96636764160,"available":94879162368,"internally_reserved":0,"allocated":1721417728,"data_stored":1720711657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542201,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1898444,"kb_used_data":1867260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92473396,"statfs":{"total":96636764160,"available":94692757504,"internally_reserved":0,"allocated":1912074240,"data_stored":1911433504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812524,"kb_used_data":1777188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92559316,"statfs":{"total":96636764160,"available":94780739584,"internally_reserved":0,"allocated":1819840512,"data_stored":1819161110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079296,"kb_used_data":1048120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93292544,"statfs":{"total":96636764160,"available":95531565056,"internally_reserved":0,"allocated":1073274880,"data_stored":1072630977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1103964,"kb_used_data":1072788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93267876,"statfs":{"total":96636764160,"available":95506305024,"internally_reserved":0,"allocated":1098534912,"data_stored":1097857316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1968684,"kb_used_data":1937496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92403156,"statfs":{"total":96636764160,"available":94620831744,"internally_reserved":0,"allocated":1983995904,"data_stored":1983329157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1981808640,"data_stored":1981808640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1096810496,"data_stored":1096810496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1071644672,"data_stored":1071644672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1910505472,"data_stored":1910505472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1719664640,"data_stored":1719664640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1174405120,"data_stored":1174405120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1826619392,"data_stored":1826619392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":58539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":118666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":176172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:41:12.040 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T15:41:12.040 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:41:12.419 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:12.425 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:41:12.435 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-17T15:41:12.329386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616016,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5028,"num_read_kb":3926,"num_write":4421,"num_write_kb":6187915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5530,"ondisk_log_size":5530,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6707008,"kb_used_data":6440656,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":748267712,"statfs":{"total":773094113280,"available":766226137088,"internally_reserved":0,"allocated":6595231744,"data_stored":6589886125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":272354866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195939,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1724,"num_read_kb":930,"num_write":1578,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007172"},"pg_stats":[{"pgid":"3.3f","version":"130'38","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.109316+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:41:11.109316+0000","last_peered":"2024-04-17T15:41:11.109316+0000","last_clean":"2024-04-17T15:41:11.109316+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:41:11.109316+0000","last_undegraded":"2024-04-17T15:41:11.109316+0000","last_fullsized":"2024-04-17T15:41:11.109316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205015+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:40:58.205015+0000","last_peered":"2024-04-17T15:40:58.205015+0000","last_clean":"2024-04-17T15:40:58.205015+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:40:58.205015+0000","last_undegraded":"2024-04-17T15:40:58.205015+0000","last_fullsized":"2024-04-17T15:40:58.205015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"130'52","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.179588+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:41:11.179588+0000","last_peered":"2024-04-17T15:41:11.179588+0000","last_clean":"2024-04-17T15:41:11.179588+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:41:11.179588+0000","last_undegraded":"2024-04-17T15:41:11.179588+0000","last_fullsized":"2024-04-17T15:41:11.179588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511785+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:40:58.511785+0000","last_peered":"2024-04-17T15:40:58.511785+0000","last_clean":"2024-04-17T15:40:58.511785+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:40:58.511785+0000","last_undegraded":"2024-04-17T15:40:58.511785+0000","last_fullsized":"2024-04-17T15:40:58.511785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"130'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.156678+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:41:11.156678+0000","last_peered":"2024-04-17T15:41:11.156678+0000","last_clean":"2024-04-17T15:41:11.156678+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:41:11.156678+0000","last_undegraded":"2024-04-17T15:41:11.156678+0000","last_fullsized":"2024-04-17T15:41:11.156678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208399+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:40:58.208399+0000","last_peered":"2024-04-17T15:40:58.208399+0000","last_clean":"2024-04-17T15:40:58.208399+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:40:58.208399+0000","last_undegraded":"2024-04-17T15:40:58.208399+0000","last_fullsized":"2024-04-17T15:40:58.208399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"130'38","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.182063+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:41:11.182063+0000","last_peered":"2024-04-17T15:41:11.182063+0000","last_clean":"2024-04-17T15:41:11.182063+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:41:11.182063+0000","last_undegraded":"2024-04-17T15:41:11.182063+0000","last_fullsized":"2024-04-17T15:41:11.182063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869758+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:40:58.869758+0000","last_peered":"2024-04-17T15:40:58.869758+0000","last_clean":"2024-04-17T15:40:58.869758+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:40:58.869758+0000","last_undegraded":"2024-04-17T15:40:58.869758+0000","last_fullsized":"2024-04-17T15:40:58.869758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"130'62","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.161949+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:41:11.161949+0000","last_peered":"2024-04-17T15:41:11.161949+0000","last_clean":"2024-04-17T15:41:11.161949+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:41:11.161949+0000","last_undegraded":"2024-04-17T15:41:11.161949+0000","last_fullsized":"2024-04-17T15:41:11.161949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551803+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:40:58.551803+0000","last_peered":"2024-04-17T15:40:58.551803+0000","last_clean":"2024-04-17T15:40:58.551803+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:40:58.551803+0000","last_undegraded":"2024-04-17T15:40:58.551803+0000","last_fullsized":"2024-04-17T15:40:58.551803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"130'38","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.191750+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:41:11.191750+0000","last_peered":"2024-04-17T15:41:11.191750+0000","last_clean":"2024-04-17T15:41:11.191750+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:41:11.191750+0000","last_undegraded":"2024-04-17T15:41:11.191750+0000","last_fullsized":"2024-04-17T15:41:11.191750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208574+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:40:58.208574+0000","last_peered":"2024-04-17T15:40:58.208574+0000","last_clean":"2024-04-17T15:40:58.208574+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:40:58.208574+0000","last_undegraded":"2024-04-17T15:40:58.208574+0000","last_fullsized":"2024-04-17T15:40:58.208574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"130'48","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.094952+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:41:11.094952+0000","last_peered":"2024-04-17T15:41:11.094952+0000","last_clean":"2024-04-17T15:41:11.094952+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:41:11.094952+0000","last_undegraded":"2024-04-17T15:41:11.094952+0000","last_fullsized":"2024-04-17T15:41:11.094952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210663+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:40:58.210663+0000","last_peered":"2024-04-17T15:40:58.210663+0000","last_clean":"2024-04-17T15:40:58.210663+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:40:58.210663+0000","last_undegraded":"2024-04-17T15:40:58.210663+0000","last_fullsized":"2024-04-17T15:40:58.210663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"130'58","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.146258+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:41:11.146258+0000","last_peered":"2024-04-17T15:41:11.146258+0000","last_clean":"2024-04-17T15:41:11.146258+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:41:11.146258+0000","last_undegraded":"2024-04-17T15:41:11.146258+0000","last_fullsized":"2024-04-17T15:41:11.146258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832766+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:40:58.832766+0000","last_peered":"2024-04-17T15:40:58.832766+0000","last_clean":"2024-04-17T15:40:58.832766+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:40:58.832766+0000","last_undegraded":"2024-04-17T15:40:58.832766+0000","last_fullsized":"2024-04-17T15:40:58.832766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:57:00.091333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206425+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:40:58.206425+0000","last_peered":"2024-04-17T15:40:58.206425+0000","last_clean":"2024-04-17T15:40:58.206425+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:40:58.206425+0000","last_undegraded":"2024-04-17T15:40:58.206425+0000","last_fullsized":"2024-04-17T15:40:58.206425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"130'30","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.070090+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:41:11.070090+0000","last_peered":"2024-04-17T15:41:11.070090+0000","last_clean":"2024-04-17T15:41:11.070090+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:41:11.070090+0000","last_undegraded":"2024-04-17T15:41:11.070090+0000","last_fullsized":"2024-04-17T15:41:11.070090+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511961+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:40:58.511961+0000","last_peered":"2024-04-17T15:40:58.511961+0000","last_clean":"2024-04-17T15:40:58.511961+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:40:58.511961+0000","last_undegraded":"2024-04-17T15:40:58.511961+0000","last_fullsized":"2024-04-17T15:40:58.511961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"130'38","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.156852+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:41:11.156852+0000","last_peered":"2024-04-17T15:41:11.156852+0000","last_clean":"2024-04-17T15:41:11.156852+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:41:11.156852+0000","last_undegraded":"2024-04-17T15:41:11.156852+0000","last_fullsized":"2024-04-17T15:41:11.156852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206650+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:40:58.206650+0000","last_peered":"2024-04-17T15:40:58.206650+0000","last_clean":"2024-04-17T15:40:58.206650+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:40:58.206650+0000","last_undegraded":"2024-04-17T15:40:58.206650+0000","last_fullsized":"2024-04-17T15:40:58.206650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"130'44","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.081276+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:41:11.081276+0000","last_peered":"2024-04-17T15:41:11.081276+0000","last_clean":"2024-04-17T15:41:11.081276+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:41:11.081276+0000","last_undegraded":"2024-04-17T15:41:11.081276+0000","last_fullsized":"2024-04-17T15:41:11.081276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831158+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:40:58.831158+0000","last_peered":"2024-04-17T15:40:58.831158+0000","last_clean":"2024-04-17T15:40:58.831158+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:40:58.831158+0000","last_undegraded":"2024-04-17T15:40:58.831158+0000","last_fullsized":"2024-04-17T15:40:58.831158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:53.478008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"130'46","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.136782+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:41:11.136782+0000","last_peered":"2024-04-17T15:41:11.136782+0000","last_clean":"2024-04-17T15:41:11.136782+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:41:11.136782+0000","last_undegraded":"2024-04-17T15:41:11.136782+0000","last_fullsized":"2024-04-17T15:41:11.136782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831948+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:40:58.831948+0000","last_peered":"2024-04-17T15:40:58.831948+0000","last_clean":"2024-04-17T15:40:58.831948+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:40:58.831948+0000","last_undegraded":"2024-04-17T15:40:58.831948+0000","last_fullsized":"2024-04-17T15:40:58.831948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:05.987584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"130'40","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.172516+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:41:11.172516+0000","last_peered":"2024-04-17T15:41:11.172516+0000","last_clean":"2024-04-17T15:41:11.172516+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:41:11.172516+0000","last_undegraded":"2024-04-17T15:41:11.172516+0000","last_fullsized":"2024-04-17T15:41:11.172516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208742+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:40:58.208742+0000","last_peered":"2024-04-17T15:40:58.208742+0000","last_clean":"2024-04-17T15:40:58.208742+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:40:58.208742+0000","last_undegraded":"2024-04-17T15:40:58.208742+0000","last_fullsized":"2024-04-17T15:40:58.208742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"130'48","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.192385+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:41:11.192385+0000","last_peered":"2024-04-17T15:41:11.192385+0000","last_clean":"2024-04-17T15:41:11.192385+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:41:11.192385+0000","last_undegraded":"2024-04-17T15:41:11.192385+0000","last_fullsized":"2024-04-17T15:41:11.192385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206151+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:58.206151+0000","last_peered":"2024-04-17T15:40:58.206151+0000","last_clean":"2024-04-17T15:40:58.206151+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:58.206151+0000","last_undegraded":"2024-04-17T15:40:58.206151+0000","last_fullsized":"2024-04-17T15:40:58.206151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546278+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:40:58.546278+0000","last_peered":"2024-04-17T15:40:58.546278+0000","last_clean":"2024-04-17T15:40:58.546278+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:40:58.546278+0000","last_undegraded":"2024-04-17T15:40:58.546278+0000","last_fullsized":"2024-04-17T15:40:58.546278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"130'52","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.121523+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:41:11.121523+0000","last_peered":"2024-04-17T15:41:11.121523+0000","last_clean":"2024-04-17T15:41:11.121523+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:41:11.121523+0000","last_undegraded":"2024-04-17T15:41:11.121523+0000","last_fullsized":"2024-04-17T15:41:11.121523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210023+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:40:58.210023+0000","last_peered":"2024-04-17T15:40:58.210023+0000","last_clean":"2024-04-17T15:40:58.210023+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:40:58.210023+0000","last_undegraded":"2024-04-17T15:40:58.210023+0000","last_fullsized":"2024-04-17T15:40:58.210023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"130'20","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.919087+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:41:10.919087+0000","last_peered":"2024-04-17T15:41:10.919087+0000","last_clean":"2024-04-17T15:41:10.919087+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:41:10.919087+0000","last_undegraded":"2024-04-17T15:41:10.919087+0000","last_fullsized":"2024-04-17T15:41:10.919087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513403+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:58.513403+0000","last_peered":"2024-04-17T15:40:58.513403+0000","last_clean":"2024-04-17T15:40:58.513403+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:58.513403+0000","last_undegraded":"2024-04-17T15:40:58.513403+0000","last_fullsized":"2024-04-17T15:40:58.513403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"112'52","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205103+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:58.205103+0000","last_peered":"2024-04-17T15:40:58.205103+0000","last_clean":"2024-04-17T15:40:58.205103+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:58.205103+0000","last_undegraded":"2024-04-17T15:40:58.205103+0000","last_fullsized":"2024-04-17T15:40:58.205103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211084+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:40:58.211084+0000","last_peered":"2024-04-17T15:40:58.211084+0000","last_clean":"2024-04-17T15:40:58.211084+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:40:58.211084+0000","last_undegraded":"2024-04-17T15:40:58.211084+0000","last_fullsized":"2024-04-17T15:40:58.211084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"130'36","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.190232+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:41:11.190232+0000","last_peered":"2024-04-17T15:41:11.190232+0000","last_clean":"2024-04-17T15:41:11.190232+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:41:11.190232+0000","last_undegraded":"2024-04-17T15:41:11.190232+0000","last_fullsized":"2024-04-17T15:41:11.190232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546176+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:58.546176+0000","last_peered":"2024-04-17T15:40:58.546176+0000","last_clean":"2024-04-17T15:40:58.546176+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:58.546176+0000","last_undegraded":"2024-04-17T15:40:58.546176+0000","last_fullsized":"2024-04-17T15:40:58.546176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212440+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:40:58.212440+0000","last_peered":"2024-04-17T15:40:58.212440+0000","last_clean":"2024-04-17T15:40:58.212440+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:40:58.212440+0000","last_undegraded":"2024-04-17T15:40:58.212440+0000","last_fullsized":"2024-04-17T15:40:58.212440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209905+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:58.209905+0000","last_peered":"2024-04-17T15:40:58.209905+0000","last_clean":"2024-04-17T15:40:58.209905+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:58.209905+0000","last_undegraded":"2024-04-17T15:40:58.209905+0000","last_fullsized":"2024-04-17T15:40:58.209905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869399+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:58.869399+0000","last_peered":"2024-04-17T15:40:58.869399+0000","last_clean":"2024-04-17T15:40:58.869399+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:58.869399+0000","last_undegraded":"2024-04-17T15:40:58.869399+0000","last_fullsized":"2024-04-17T15:40:58.869399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870379+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:40:58.870379+0000","last_peered":"2024-04-17T15:40:58.870379+0000","last_clean":"2024-04-17T15:40:58.870379+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:40:58.870379+0000","last_undegraded":"2024-04-17T15:40:58.870379+0000","last_fullsized":"2024-04-17T15:40:58.870379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"130'64","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.199676+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:41:11.199676+0000","last_peered":"2024-04-17T15:41:11.199676+0000","last_clean":"2024-04-17T15:41:11.199676+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:41:11.199676+0000","last_undegraded":"2024-04-17T15:41:11.199676+0000","last_fullsized":"2024-04-17T15:41:11.199676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544211+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:40:58.544211+0000","last_peered":"2024-04-17T15:40:58.544211+0000","last_clean":"2024-04-17T15:40:58.544211+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:40:58.544211+0000","last_undegraded":"2024-04-17T15:40:58.544211+0000","last_fullsized":"2024-04-17T15:40:58.544211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"73'11","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:04.869174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'138","reported_seq":401,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.070581+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:41:10.070581+0000","last_peered":"2024-04-17T15:41:10.070581+0000","last_clean":"2024-04-17T15:41:10.070581+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:41:10.070581+0000","last_undegraded":"2024-04-17T15:41:10.070581+0000","last_fullsized":"2024-04-17T15:41:10.070581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207086+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:58.207086+0000","last_peered":"2024-04-17T15:40:58.207086+0000","last_clean":"2024-04-17T15:40:58.207086+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:58.207086+0000","last_undegraded":"2024-04-17T15:40:58.207086+0000","last_fullsized":"2024-04-17T15:40:58.207086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546763+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:40:58.546763+0000","last_peered":"2024-04-17T15:40:58.546763+0000","last_clean":"2024-04-17T15:40:58.546763+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:40:58.546763+0000","last_undegraded":"2024-04-17T15:40:58.546763+0000","last_fullsized":"2024-04-17T15:40:58.546763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"130'64","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.151285+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:41:11.151285+0000","last_peered":"2024-04-17T15:41:11.151285+0000","last_clean":"2024-04-17T15:41:11.151285+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:41:11.151285+0000","last_undegraded":"2024-04-17T15:41:11.151285+0000","last_fullsized":"2024-04-17T15:41:11.151285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210404+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:40:58.210404+0000","last_peered":"2024-04-17T15:40:58.210404+0000","last_clean":"2024-04-17T15:40:58.210404+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:40:58.210404+0000","last_undegraded":"2024-04-17T15:40:58.210404+0000","last_fullsized":"2024-04-17T15:40:58.210404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"130'20","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.606295+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:41:10.606295+0000","last_peered":"2024-04-17T15:41:10.606295+0000","last_clean":"2024-04-17T15:41:10.606295+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:41:10.606295+0000","last_undegraded":"2024-04-17T15:41:10.606295+0000","last_fullsized":"2024-04-17T15:41:10.606295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'138","reported_seq":481,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.077550+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:41:10.077550+0000","last_peered":"2024-04-17T15:41:10.077550+0000","last_clean":"2024-04-17T15:41:10.077550+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:41:10.077550+0000","last_undegraded":"2024-04-17T15:41:10.077550+0000","last_fullsized":"2024-04-17T15:41:10.077550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205567+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:40:58.205567+0000","last_peered":"2024-04-17T15:40:58.205567+0000","last_clean":"2024-04-17T15:40:58.205567+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:40:58.205567+0000","last_undegraded":"2024-04-17T15:40:58.205567+0000","last_fullsized":"2024-04-17T15:40:58.205567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"130'46","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.145453+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:41:11.145453+0000","last_peered":"2024-04-17T15:41:11.145453+0000","last_clean":"2024-04-17T15:41:11.145453+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:41:11.145453+0000","last_undegraded":"2024-04-17T15:41:11.145453+0000","last_fullsized":"2024-04-17T15:41:11.145453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511485+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:40:58.511485+0000","last_peered":"2024-04-17T15:40:58.511485+0000","last_clean":"2024-04-17T15:40:58.511485+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:40:58.511485+0000","last_undegraded":"2024-04-17T15:40:58.511485+0000","last_fullsized":"2024-04-17T15:40:58.511485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"130'30","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.211550+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:41:11.211550+0000","last_peered":"2024-04-17T15:41:11.211550+0000","last_clean":"2024-04-17T15:41:11.211550+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:41:11.211550+0000","last_undegraded":"2024-04-17T15:41:11.211550+0000","last_fullsized":"2024-04-17T15:41:11.211550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206195+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:40:58.206195+0000","last_peered":"2024-04-17T15:40:58.206195+0000","last_clean":"2024-04-17T15:40:58.206195+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:40:58.206195+0000","last_undegraded":"2024-04-17T15:40:58.206195+0000","last_fullsized":"2024-04-17T15:40:58.206195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:38.467988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206198+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:40:58.206198+0000","last_peered":"2024-04-17T15:40:58.206198+0000","last_clean":"2024-04-17T15:40:58.206198+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:40:58.206198+0000","last_undegraded":"2024-04-17T15:40:58.206198+0000","last_fullsized":"2024-04-17T15:40:58.206198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207810+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:40:58.207810+0000","last_peered":"2024-04-17T15:40:58.207810+0000","last_clean":"2024-04-17T15:40:58.207810+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:40:58.207810+0000","last_undegraded":"2024-04-17T15:40:58.207810+0000","last_fullsized":"2024-04-17T15:40:58.207810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"130'22","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.178168+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:41:11.178168+0000","last_peered":"2024-04-17T15:41:11.178168+0000","last_clean":"2024-04-17T15:41:11.178168+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:41:11.178168+0000","last_undegraded":"2024-04-17T15:41:11.178168+0000","last_fullsized":"2024-04-17T15:41:11.178168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830647+0000","last_change":"2024-04-17T15:36:58.223281+0000","last_active":"2024-04-17T15:40:58.830647+0000","last_peered":"2024-04-17T15:40:58.830647+0000","last_clean":"2024-04-17T15:40:58.830647+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:40:58.830647+0000","last_undegraded":"2024-04-17T15:40:58.830647+0000","last_fullsized":"2024-04-17T15:40:58.830647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:06.341174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"130'21","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.397518+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:41:10.397518+0000","last_peered":"2024-04-17T15:41:10.397518+0000","last_clean":"2024-04-17T15:41:10.397518+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:41:10.397518+0000","last_undegraded":"2024-04-17T15:41:10.397518+0000","last_fullsized":"2024-04-17T15:41:10.397518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544949+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:40:58.544949+0000","last_peered":"2024-04-17T15:40:58.544949+0000","last_clean":"2024-04-17T15:40:58.544949+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:40:58.544949+0000","last_undegraded":"2024-04-17T15:40:58.544949+0000","last_fullsized":"2024-04-17T15:40:58.544949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553003+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:40:58.553003+0000","last_peered":"2024-04-17T15:40:58.553003+0000","last_clean":"2024-04-17T15:40:58.553003+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:40:58.553003+0000","last_undegraded":"2024-04-17T15:40:58.553003+0000","last_fullsized":"2024-04-17T15:40:58.553003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551609+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:40:58.551609+0000","last_peered":"2024-04-17T15:40:58.551609+0000","last_clean":"2024-04-17T15:40:58.551609+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:40:58.551609+0000","last_undegraded":"2024-04-17T15:40:58.551609+0000","last_fullsized":"2024-04-17T15:40:58.551609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"130'40","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.191632+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:41:11.191632+0000","last_peered":"2024-04-17T15:41:11.191632+0000","last_clean":"2024-04-17T15:41:11.191632+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:41:11.191632+0000","last_undegraded":"2024-04-17T15:41:11.191632+0000","last_fullsized":"2024-04-17T15:41:11.191632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831481+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:40:58.831481+0000","last_peered":"2024-04-17T15:40:58.831481+0000","last_clean":"2024-04-17T15:40:58.831481+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:40:58.831481+0000","last_undegraded":"2024-04-17T15:40:58.831481+0000","last_fullsized":"2024-04-17T15:40:58.831481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:44.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"130'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.357543+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:41:10.357543+0000","last_peered":"2024-04-17T15:41:10.357543+0000","last_clean":"2024-04-17T15:41:10.357543+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:41:10.357543+0000","last_undegraded":"2024-04-17T15:41:10.357543+0000","last_fullsized":"2024-04-17T15:41:10.357543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":151,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"130'138","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.078804+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:41:10.078804+0000","last_peered":"2024-04-17T15:41:10.078804+0000","last_clean":"2024-04-17T15:41:10.078804+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:41:10.078804+0000","last_undegraded":"2024-04-17T15:41:10.078804+0000","last_fullsized":"2024-04-17T15:41:10.078804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869978+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:40:58.869978+0000","last_peered":"2024-04-17T15:40:58.869978+0000","last_clean":"2024-04-17T15:40:58.869978+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:40:58.869978+0000","last_undegraded":"2024-04-17T15:40:58.869978+0000","last_fullsized":"2024-04-17T15:40:58.869978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:53.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870694+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:40:58.870694+0000","last_peered":"2024-04-17T15:40:58.870694+0000","last_clean":"2024-04-17T15:40:58.870694+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:40:58.870694+0000","last_undegraded":"2024-04-17T15:40:58.870694+0000","last_fullsized":"2024-04-17T15:40:58.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:53:07.176417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"130'44","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.042449+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:41:11.042449+0000","last_peered":"2024-04-17T15:41:11.042449+0000","last_clean":"2024-04-17T15:41:11.042449+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:41:11.042449+0000","last_undegraded":"2024-04-17T15:41:11.042449+0000","last_fullsized":"2024-04-17T15:41:11.042449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830470+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:40:58.830470+0000","last_peered":"2024-04-17T15:40:58.830470+0000","last_clean":"2024-04-17T15:40:58.830470+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:40:58.830470+0000","last_undegraded":"2024-04-17T15:40:58.830470+0000","last_fullsized":"2024-04-17T15:40:58.830470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:05.869722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"130'36","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.413279+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:41:10.413279+0000","last_peered":"2024-04-17T15:41:10.413279+0000","last_clean":"2024-04-17T15:41:10.413279+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:41:10.413279+0000","last_undegraded":"2024-04-17T15:41:10.413279+0000","last_fullsized":"2024-04-17T15:41:10.413279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830535+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:40:58.830535+0000","last_peered":"2024-04-17T15:40:58.830535+0000","last_clean":"2024-04-17T15:40:58.830535+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:40:58.830535+0000","last_undegraded":"2024-04-17T15:40:58.830535+0000","last_fullsized":"2024-04-17T15:40:58.830535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:04.940977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207046+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:40:58.207046+0000","last_peered":"2024-04-17T15:40:58.207046+0000","last_clean":"2024-04-17T15:40:58.207046+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:40:58.207046+0000","last_undegraded":"2024-04-17T15:40:58.207046+0000","last_fullsized":"2024-04-17T15:40:58.207046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:21.832691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208754+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:40:58.208754+0000","last_peered":"2024-04-17T15:40:58.208754+0000","last_clean":"2024-04-17T15:40:58.208754+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:40:58.208754+0000","last_undegraded":"2024-04-17T15:40:58.208754+0000","last_fullsized":"2024-04-17T15:40:58.208754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"130'42","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.173016+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:41:11.173016+0000","last_peered":"2024-04-17T15:41:11.173016+0000","last_clean":"2024-04-17T15:41:11.173016+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:41:11.173016+0000","last_undegraded":"2024-04-17T15:41:11.173016+0000","last_fullsized":"2024-04-17T15:41:11.173016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831472+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:40:58.831472+0000","last_peered":"2024-04-17T15:40:58.831472+0000","last_clean":"2024-04-17T15:40:58.831472+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:40:58.831472+0000","last_undegraded":"2024-04-17T15:40:58.831472+0000","last_fullsized":"2024-04-17T15:40:58.831472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:35.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"130'22","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.417376+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:41:10.417376+0000","last_peered":"2024-04-17T15:41:10.417376+0000","last_clean":"2024-04-17T15:41:10.417376+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:41:10.417376+0000","last_undegraded":"2024-04-17T15:41:10.417376+0000","last_fullsized":"2024-04-17T15:41:10.417376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:42:17.801114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870126+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:40:58.870126+0000","last_peered":"2024-04-17T15:40:58.870126+0000","last_clean":"2024-04-17T15:40:58.870126+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:40:58.870126+0000","last_undegraded":"2024-04-17T15:40:58.870126+0000","last_fullsized":"2024-04-17T15:40:58.870126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.410409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544417+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:40:58.544417+0000","last_peered":"2024-04-17T15:40:58.544417+0000","last_clean":"2024-04-17T15:40:58.544417+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:40:58.544417+0000","last_undegraded":"2024-04-17T15:40:58.544417+0000","last_fullsized":"2024-04-17T15:40:58.544417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209073+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:40:58.209073+0000","last_peered":"2024-04-17T15:40:58.209073+0000","last_clean":"2024-04-17T15:40:58.209073+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:40:58.209073+0000","last_undegraded":"2024-04-17T15:40:58.209073+0000","last_fullsized":"2024-04-17T15:40:58.209073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:22.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"130'54","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.157408+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:41:11.157408+0000","last_peered":"2024-04-17T15:41:11.157408+0000","last_clean":"2024-04-17T15:41:11.157408+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:41:11.157408+0000","last_undegraded":"2024-04-17T15:41:11.157408+0000","last_fullsized":"2024-04-17T15:41:11.157408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206959+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:40:58.206959+0000","last_peered":"2024-04-17T15:40:58.206959+0000","last_clean":"2024-04-17T15:40:58.206959+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:40:58.206959+0000","last_undegraded":"2024-04-17T15:40:58.206959+0000","last_fullsized":"2024-04-17T15:40:58.206959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:47.010971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"130'26","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.386609+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:41:10.386609+0000","last_peered":"2024-04-17T15:41:10.386609+0000","last_clean":"2024-04-17T15:41:10.386609+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:41:10.386609+0000","last_undegraded":"2024-04-17T15:41:10.386609+0000","last_fullsized":"2024-04-17T15:41:10.386609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:31:00.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"130'138","reported_seq":447,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.073762+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:41:10.073762+0000","last_peered":"2024-04-17T15:41:10.073762+0000","last_clean":"2024-04-17T15:41:10.073762+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:41:10.073762+0000","last_undegraded":"2024-04-17T15:41:10.073762+0000","last_fullsized":"2024-04-17T15:41:10.073762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:09.486959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205716+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:40:58.205716+0000","last_peered":"2024-04-17T15:40:58.205716+0000","last_clean":"2024-04-17T15:40:58.205716+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:40:58.205716+0000","last_undegraded":"2024-04-17T15:40:58.205716+0000","last_fullsized":"2024-04-17T15:40:58.205716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:28.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212582+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:40:58.212582+0000","last_peered":"2024-04-17T15:40:58.212582+0000","last_clean":"2024-04-17T15:40:58.212582+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:40:58.212582+0000","last_undegraded":"2024-04-17T15:40:58.212582+0000","last_fullsized":"2024-04-17T15:40:58.212582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:26.217734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"130'48","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.125596+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:41:11.125596+0000","last_peered":"2024-04-17T15:41:11.125596+0000","last_clean":"2024-04-17T15:41:11.125596+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:41:11.125596+0000","last_undegraded":"2024-04-17T15:41:11.125596+0000","last_fullsized":"2024-04-17T15:41:11.125596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":408,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.038172+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:41:10.038172+0000","last_peered":"2024-04-17T15:41:10.038172+0000","last_clean":"2024-04-17T15:41:10.038172+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:41:10.038172+0000","last_undegraded":"2024-04-17T15:41:10.038172+0000","last_fullsized":"2024-04-17T15:41:10.038172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545986+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:40:58.545986+0000","last_peered":"2024-04-17T15:40:58.545986+0000","last_clean":"2024-04-17T15:40:58.545986+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:40:58.545986+0000","last_undegraded":"2024-04-17T15:40:58.545986+0000","last_fullsized":"2024-04-17T15:40:58.545986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"130'138","reported_seq":454,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.074420+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:41:10.074420+0000","last_peered":"2024-04-17T15:41:10.074420+0000","last_clean":"2024-04-17T15:41:10.074420+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:41:10.074420+0000","last_undegraded":"2024-04-17T15:41:10.074420+0000","last_fullsized":"2024-04-17T15:41:10.074420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208093+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:40:58.208093+0000","last_peered":"2024-04-17T15:40:58.208093+0000","last_clean":"2024-04-17T15:40:58.208093+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:40:58.208093+0000","last_undegraded":"2024-04-17T15:40:58.208093+0000","last_fullsized":"2024-04-17T15:40:58.208093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208922+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:40:58.208922+0000","last_peered":"2024-04-17T15:40:58.208922+0000","last_clean":"2024-04-17T15:40:58.208922+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:40:58.208922+0000","last_undegraded":"2024-04-17T15:40:58.208922+0000","last_fullsized":"2024-04-17T15:40:58.208922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:00.811360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"130'58","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.192693+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:41:11.192693+0000","last_peered":"2024-04-17T15:41:11.192693+0000","last_clean":"2024-04-17T15:41:11.192693+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:41:11.192693+0000","last_undegraded":"2024-04-17T15:41:11.192693+0000","last_fullsized":"2024-04-17T15:41:11.192693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212265+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:40:58.212265+0000","last_peered":"2024-04-17T15:40:58.212265+0000","last_clean":"2024-04-17T15:40:58.212265+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:40:58.212265+0000","last_undegraded":"2024-04-17T15:40:58.212265+0000","last_fullsized":"2024-04-17T15:40:58.212265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"130'28","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.921836+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:41:10.921836+0000","last_peered":"2024-04-17T15:41:10.921836+0000","last_clean":"2024-04-17T15:41:10.921836+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:41:10.921836+0000","last_undegraded":"2024-04-17T15:41:10.921836+0000","last_fullsized":"2024-04-17T15:41:10.921836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551513+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:40:58.551513+0000","last_peered":"2024-04-17T15:40:58.551513+0000","last_clean":"2024-04-17T15:40:58.551513+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:40:58.551513+0000","last_undegraded":"2024-04-17T15:40:58.551513+0000","last_fullsized":"2024-04-17T15:40:58.551513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206128+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:40:58.206128+0000","last_peered":"2024-04-17T15:40:58.206128+0000","last_clean":"2024-04-17T15:40:58.206128+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:40:58.206128+0000","last_undegraded":"2024-04-17T15:40:58.206128+0000","last_fullsized":"2024-04-17T15:40:58.206128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:52.161840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552674+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:40:58.552674+0000","last_peered":"2024-04-17T15:40:58.552674+0000","last_clean":"2024-04-17T15:40:58.552674+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:40:58.552674+0000","last_undegraded":"2024-04-17T15:40:58.552674+0000","last_fullsized":"2024-04-17T15:40:58.552674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":387,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512174+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:58.512174+0000","last_peered":"2024-04-17T15:40:58.512174+0000","last_clean":"2024-04-17T15:40:58.512174+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:58.512174+0000","last_undegraded":"2024-04-17T15:40:58.512174+0000","last_fullsized":"2024-04-17T15:40:58.512174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206221+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:40:58.206221+0000","last_peered":"2024-04-17T15:40:58.206221+0000","last_clean":"2024-04-17T15:40:58.206221+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:40:58.206221+0000","last_undegraded":"2024-04-17T15:40:58.206221+0000","last_fullsized":"2024-04-17T15:40:58.206221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"130'40","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.998738+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:41:10.998738+0000","last_peered":"2024-04-17T15:41:10.998738+0000","last_clean":"2024-04-17T15:41:10.998738+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:41:10.998738+0000","last_undegraded":"2024-04-17T15:41:10.998738+0000","last_fullsized":"2024-04-17T15:41:10.998738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512565+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:40:58.512565+0000","last_peered":"2024-04-17T15:40:58.512565+0000","last_clean":"2024-04-17T15:40:58.512565+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:40:58.512565+0000","last_undegraded":"2024-04-17T15:40:58.512565+0000","last_fullsized":"2024-04-17T15:40:58.512565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"130'46","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.208128+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:41:11.208128+0000","last_peered":"2024-04-17T15:41:11.208128+0000","last_clean":"2024-04-17T15:41:11.208128+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:41:11.208128+0000","last_undegraded":"2024-04-17T15:41:11.208128+0000","last_fullsized":"2024-04-17T15:41:11.208128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870042+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:40:58.870042+0000","last_peered":"2024-04-17T15:40:58.870042+0000","last_clean":"2024-04-17T15:40:58.870042+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:40:58.870042+0000","last_undegraded":"2024-04-17T15:40:58.870042+0000","last_fullsized":"2024-04-17T15:40:58.870042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:31.461367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550525+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:40:58.550525+0000","last_peered":"2024-04-17T15:40:58.550525+0000","last_clean":"2024-04-17T15:40:58.550525+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:40:58.550525+0000","last_undegraded":"2024-04-17T15:40:58.550525+0000","last_fullsized":"2024-04-17T15:40:58.550525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870224+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:40:58.870224+0000","last_peered":"2024-04-17T15:40:58.870224+0000","last_clean":"2024-04-17T15:40:58.870224+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:40:58.870224+0000","last_undegraded":"2024-04-17T15:40:58.870224+0000","last_fullsized":"2024-04-17T15:40:58.870224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511901+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:58.511901+0000","last_peered":"2024-04-17T15:40:58.511901+0000","last_clean":"2024-04-17T15:40:58.511901+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:58.511901+0000","last_undegraded":"2024-04-17T15:40:58.511901+0000","last_fullsized":"2024-04-17T15:40:58.511901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"130'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.137444+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:41:11.137444+0000","last_peered":"2024-04-17T15:41:11.137444+0000","last_clean":"2024-04-17T15:41:11.137444+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:41:11.137444+0000","last_undegraded":"2024-04-17T15:41:11.137444+0000","last_fullsized":"2024-04-17T15:41:11.137444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":316,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.025542+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:41:10.025542+0000","last_peered":"2024-04-17T15:41:10.025542+0000","last_clean":"2024-04-17T15:41:10.025542+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:41:10.025542+0000","last_undegraded":"2024-04-17T15:41:10.025542+0000","last_fullsized":"2024-04-17T15:41:10.025542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"130'150","reported_seq":496,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.215565+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:41:11.215565+0000","last_peered":"2024-04-17T15:41:11.215565+0000","last_clean":"2024-04-17T15:41:11.215565+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:41:11.215565+0000","last_undegraded":"2024-04-17T15:41:11.215565+0000","last_fullsized":"2024-04-17T15:41:11.215565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:26.565869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513196+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:40:58.513196+0000","last_peered":"2024-04-17T15:40:58.513196+0000","last_clean":"2024-04-17T15:40:58.513196+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:40:58.513196+0000","last_undegraded":"2024-04-17T15:40:58.513196+0000","last_fullsized":"2024-04-17T15:40:58.513196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205369+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:40:58.205369+0000","last_peered":"2024-04-17T15:40:58.205369+0000","last_clean":"2024-04-17T15:40:58.205369+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:40:58.205369+0000","last_undegraded":"2024-04-17T15:40:58.205369+0000","last_fullsized":"2024-04-17T15:40:58.205369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:16.170957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208927+0000","last_change":"2024-04-17T15:36:56.200404+0000","last_active":"2024-04-17T15:40:58.208927+0000","last_peered":"2024-04-17T15:40:58.208927+0000","last_clean":"2024-04-17T15:40:58.208927+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:40:58.208927+0000","last_undegraded":"2024-04-17T15:40:58.208927+0000","last_fullsized":"2024-04-17T15:40:58.208927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831329+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:40:58.831329+0000","last_peered":"2024-04-17T15:40:58.831329+0000","last_clean":"2024-04-17T15:40:58.831329+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:40:58.831329+0000","last_undegraded":"2024-04-17T15:40:58.831329+0000","last_fullsized":"2024-04-17T15:40:58.831329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"130'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.125482+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:41:11.125482+0000","last_peered":"2024-04-17T15:41:11.125482+0000","last_clean":"2024-04-17T15:41:11.125482+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:41:11.125482+0000","last_undegraded":"2024-04-17T15:41:11.125482+0000","last_fullsized":"2024-04-17T15:41:11.125482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830548+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:40:58.830548+0000","last_peered":"2024-04-17T15:40:58.830548+0000","last_clean":"2024-04-17T15:40:58.830548+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:40:58.830548+0000","last_undegraded":"2024-04-17T15:40:58.830548+0000","last_fullsized":"2024-04-17T15:40:58.830548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:32.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'17","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.692836+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:41:03.692836+0000","last_peered":"2024-04-17T15:41:03.692836+0000","last_clean":"2024-04-17T15:41:03.692836+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:41:03.692836+0000","last_undegraded":"2024-04-17T15:41:03.692836+0000","last_fullsized":"2024-04-17T15:41:03.692836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869505+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:40:58.869505+0000","last_peered":"2024-04-17T15:40:58.869505+0000","last_clean":"2024-04-17T15:40:58.869505+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:40:58.869505+0000","last_undegraded":"2024-04-17T15:40:58.869505+0000","last_fullsized":"2024-04-17T15:40:58.869505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.539852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545821+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:40:58.545821+0000","last_peered":"2024-04-17T15:40:58.545821+0000","last_clean":"2024-04-17T15:40:58.545821+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:40:58.545821+0000","last_undegraded":"2024-04-17T15:40:58.545821+0000","last_fullsized":"2024-04-17T15:40:58.545821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207544+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:40:58.207544+0000","last_peered":"2024-04-17T15:40:58.207544+0000","last_clean":"2024-04-17T15:40:58.207544+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:40:58.207544+0000","last_undegraded":"2024-04-17T15:40:58.207544+0000","last_fullsized":"2024-04-17T15:40:58.207544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207531+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:58.207531+0000","last_peered":"2024-04-17T15:40:58.207531+0000","last_clean":"2024-04-17T15:40:58.207531+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:58.207531+0000","last_undegraded":"2024-04-17T15:40:58.207531+0000","last_fullsized":"2024-04-17T15:40:58.207531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"130'48","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.195798+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:41:11.195798+0000","last_peered":"2024-04-17T15:41:11.195798+0000","last_clean":"2024-04-17T15:41:11.195798+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:41:11.195798+0000","last_undegraded":"2024-04-17T15:41:11.195798+0000","last_fullsized":"2024-04-17T15:41:11.195798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:19:49.030511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868812+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:40:58.868812+0000","last_peered":"2024-04-17T15:40:58.868812+0000","last_clean":"2024-04-17T15:40:58.868812+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:40:58.868812+0000","last_undegraded":"2024-04-17T15:40:58.868812+0000","last_fullsized":"2024-04-17T15:40:58.868812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547104+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:40:58.547104+0000","last_peered":"2024-04-17T15:40:58.547104+0000","last_clean":"2024-04-17T15:40:58.547104+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:40:58.547104+0000","last_undegraded":"2024-04-17T15:40:58.547104+0000","last_fullsized":"2024-04-17T15:40:58.547104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553452+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:40:58.553452+0000","last_peered":"2024-04-17T15:40:58.553452+0000","last_clean":"2024-04-17T15:40:58.553452+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:40:58.553452+0000","last_undegraded":"2024-04-17T15:40:58.553452+0000","last_fullsized":"2024-04-17T15:40:58.553452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.204708+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:40:58.204708+0000","last_peered":"2024-04-17T15:40:58.204708+0000","last_clean":"2024-04-17T15:40:58.204708+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:40:58.204708+0000","last_undegraded":"2024-04-17T15:40:58.204708+0000","last_fullsized":"2024-04-17T15:40:58.204708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205991+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:40:58.205991+0000","last_peered":"2024-04-17T15:40:58.205991+0000","last_clean":"2024-04-17T15:40:58.205991+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:40:58.205991+0000","last_undegraded":"2024-04-17T15:40:58.205991+0000","last_fullsized":"2024-04-17T15:40:58.205991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:15.806075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"130'44","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.142233+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:41:11.142233+0000","last_peered":"2024-04-17T15:41:11.142233+0000","last_clean":"2024-04-17T15:41:11.142233+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:41:11.142233+0000","last_undegraded":"2024-04-17T15:41:11.142233+0000","last_fullsized":"2024-04-17T15:41:11.142233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208313+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:40:58.208313+0000","last_peered":"2024-04-17T15:40:58.208313+0000","last_clean":"2024-04-17T15:40:58.208313+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:40:58.208313+0000","last_undegraded":"2024-04-17T15:40:58.208313+0000","last_fullsized":"2024-04-17T15:40:58.208313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870109+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:40:58.870109+0000","last_peered":"2024-04-17T15:40:58.870109+0000","last_clean":"2024-04-17T15:40:58.870109+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:40:58.870109+0000","last_undegraded":"2024-04-17T15:40:58.870109+0000","last_fullsized":"2024-04-17T15:40:58.870109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'40","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.610594+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:41:10.610594+0000","last_peered":"2024-04-17T15:41:10.610594+0000","last_clean":"2024-04-17T15:41:10.610594+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:41:10.610594+0000","last_undegraded":"2024-04-17T15:41:10.610594+0000","last_fullsized":"2024-04-17T15:41:10.610594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207322+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:40:58.207322+0000","last_peered":"2024-04-17T15:40:58.207322+0000","last_clean":"2024-04-17T15:40:58.207322+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:40:58.207322+0000","last_undegraded":"2024-04-17T15:40:58.207322+0000","last_fullsized":"2024-04-17T15:40:58.207322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869786+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:40:58.869786+0000","last_peered":"2024-04-17T15:40:58.869786+0000","last_clean":"2024-04-17T15:40:58.869786+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:40:58.869786+0000","last_undegraded":"2024-04-17T15:40:58.869786+0000","last_fullsized":"2024-04-17T15:40:58.869786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:19:32.297164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870655+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:40:58.870655+0000","last_peered":"2024-04-17T15:40:58.870655+0000","last_clean":"2024-04-17T15:40:58.870655+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:40:58.870655+0000","last_undegraded":"2024-04-17T15:40:58.870655+0000","last_fullsized":"2024-04-17T15:40:58.870655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"130'42","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.170256+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:41:11.170256+0000","last_peered":"2024-04-17T15:41:11.170256+0000","last_clean":"2024-04-17T15:41:11.170256+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:41:11.170256+0000","last_undegraded":"2024-04-17T15:41:11.170256+0000","last_fullsized":"2024-04-17T15:41:11.170256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514348+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:40:58.514348+0000","last_peered":"2024-04-17T15:40:58.514348+0000","last_clean":"2024-04-17T15:40:58.514348+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:40:58.514348+0000","last_undegraded":"2024-04-17T15:40:58.514348+0000","last_fullsized":"2024-04-17T15:40:58.514348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551430+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:40:58.551430+0000","last_peered":"2024-04-17T15:40:58.551430+0000","last_clean":"2024-04-17T15:40:58.551430+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:40:58.551430+0000","last_undegraded":"2024-04-17T15:40:58.551430+0000","last_fullsized":"2024-04-17T15:40:58.551430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205331+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:40:58.205331+0000","last_peered":"2024-04-17T15:40:58.205331+0000","last_clean":"2024-04-17T15:40:58.205331+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:40:58.205331+0000","last_undegraded":"2024-04-17T15:40:58.205331+0000","last_fullsized":"2024-04-17T15:40:58.205331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:15.991172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"130'138","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.068182+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:41:10.068182+0000","last_peered":"2024-04-17T15:41:10.068182+0000","last_clean":"2024-04-17T15:41:10.068182+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:41:10.068182+0000","last_undegraded":"2024-04-17T15:41:10.068182+0000","last_fullsized":"2024-04-17T15:41:10.068182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546955+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:40:58.546955+0000","last_peered":"2024-04-17T15:40:58.546955+0000","last_clean":"2024-04-17T15:40:58.546955+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:40:58.546955+0000","last_undegraded":"2024-04-17T15:40:58.546955+0000","last_fullsized":"2024-04-17T15:40:58.546955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544700+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:40:58.544700+0000","last_peered":"2024-04-17T15:40:58.544700+0000","last_clean":"2024-04-17T15:40:58.544700+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:40:58.544700+0000","last_undegraded":"2024-04-17T15:40:58.544700+0000","last_fullsized":"2024-04-17T15:40:58.544700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"130'38","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.110189+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:41:11.110189+0000","last_peered":"2024-04-17T15:41:11.110189+0000","last_clean":"2024-04-17T15:41:11.110189+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:41:11.110189+0000","last_undegraded":"2024-04-17T15:41:11.110189+0000","last_fullsized":"2024-04-17T15:41:11.110189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208024+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:40:58.208024+0000","last_peered":"2024-04-17T15:40:58.208024+0000","last_clean":"2024-04-17T15:40:58.208024+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:40:58.208024+0000","last_undegraded":"2024-04-17T15:40:58.208024+0000","last_fullsized":"2024-04-17T15:40:58.208024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207849+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:40:58.207849+0000","last_peered":"2024-04-17T15:40:58.207849+0000","last_clean":"2024-04-17T15:40:58.207849+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:40:58.207849+0000","last_undegraded":"2024-04-17T15:40:58.207849+0000","last_fullsized":"2024-04-17T15:40:58.207849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209271+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:40:58.209271+0000","last_peered":"2024-04-17T15:40:58.209271+0000","last_clean":"2024-04-17T15:40:58.209271+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:40:58.209271+0000","last_undegraded":"2024-04-17T15:40:58.209271+0000","last_fullsized":"2024-04-17T15:40:58.209271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'138","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.222763+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:41:11.222763+0000","last_peered":"2024-04-17T15:41:11.222763+0000","last_clean":"2024-04-17T15:41:11.222763+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:41:11.222763+0000","last_undegraded":"2024-04-17T15:41:11.222763+0000","last_fullsized":"2024-04-17T15:41:11.222763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869584+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:40:58.869584+0000","last_peered":"2024-04-17T15:40:58.869584+0000","last_clean":"2024-04-17T15:40:58.869584+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:40:58.869584+0000","last_undegraded":"2024-04-17T15:40:58.869584+0000","last_fullsized":"2024-04-17T15:40:58.869584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:18:27.435376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208160+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:40:58.208160+0000","last_peered":"2024-04-17T15:40:58.208160+0000","last_clean":"2024-04-17T15:40:58.208160+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:40:58.208160+0000","last_undegraded":"2024-04-17T15:40:58.208160+0000","last_fullsized":"2024-04-17T15:40:58.208160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:33.734637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"130'56","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.103822+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:41:11.103822+0000","last_peered":"2024-04-17T15:41:11.103822+0000","last_clean":"2024-04-17T15:41:11.103822+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:41:11.103822+0000","last_undegraded":"2024-04-17T15:41:11.103822+0000","last_fullsized":"2024-04-17T15:41:11.103822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553901+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:40:58.553901+0000","last_peered":"2024-04-17T15:40:58.553901+0000","last_clean":"2024-04-17T15:40:58.553901+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:40:58.553901+0000","last_undegraded":"2024-04-17T15:40:58.553901+0000","last_fullsized":"2024-04-17T15:40:58.553901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544172+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:40:58.544172+0000","last_peered":"2024-04-17T15:40:58.544172+0000","last_clean":"2024-04-17T15:40:58.544172+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:40:58.544172+0000","last_undegraded":"2024-04-17T15:40:58.544172+0000","last_fullsized":"2024-04-17T15:40:58.544172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"130'57","reported_seq":305,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.916134+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:41:10.916134+0000","last_peered":"2024-04-17T15:41:10.916134+0000","last_clean":"2024-04-17T15:41:10.916134+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:41:10.916134+0000","last_undegraded":"2024-04-17T15:41:10.916134+0000","last_fullsized":"2024-04-17T15:41:10.916134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":410,"num_write":38,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545167+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:40:58.545167+0000","last_peered":"2024-04-17T15:40:58.545167+0000","last_clean":"2024-04-17T15:40:58.545167+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:40:58.545167+0000","last_undegraded":"2024-04-17T15:40:58.545167+0000","last_fullsized":"2024-04-17T15:40:58.545167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205831+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:40:58.205831+0000","last_peered":"2024-04-17T15:40:58.205831+0000","last_clean":"2024-04-17T15:40:58.205831+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:40:58.205831+0000","last_undegraded":"2024-04-17T15:40:58.205831+0000","last_fullsized":"2024-04-17T15:40:58.205831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869887+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:40:58.869887+0000","last_peered":"2024-04-17T15:40:58.869887+0000","last_clean":"2024-04-17T15:40:58.869887+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:40:58.869887+0000","last_undegraded":"2024-04-17T15:40:58.869887+0000","last_fullsized":"2024-04-17T15:40:58.869887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:04.671117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207678+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:40:58.207678+0000","last_peered":"2024-04-17T15:40:58.207678+0000","last_clean":"2024-04-17T15:40:58.207678+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:40:58.207678+0000","last_undegraded":"2024-04-17T15:40:58.207678+0000","last_fullsized":"2024-04-17T15:40:58.207678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"130'54","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.186719+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:41:11.186719+0000","last_peered":"2024-04-17T15:41:11.186719+0000","last_clean":"2024-04-17T15:41:11.186719+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:41:11.186719+0000","last_undegraded":"2024-04-17T15:41:11.186719+0000","last_fullsized":"2024-04-17T15:41:11.186719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205988+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:40:58.205988+0000","last_peered":"2024-04-17T15:40:58.205988+0000","last_clean":"2024-04-17T15:40:58.205988+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:40:58.205988+0000","last_undegraded":"2024-04-17T15:40:58.205988+0000","last_fullsized":"2024-04-17T15:40:58.205988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:17.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"130'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.162146+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:41:10.162146+0000","last_peered":"2024-04-17T15:41:10.162146+0000","last_clean":"2024-04-17T15:41:10.162146+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:41:10.162146+0000","last_undegraded":"2024-04-17T15:41:10.162146+0000","last_fullsized":"2024-04-17T15:41:10.162146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544482+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:40:58.544482+0000","last_peered":"2024-04-17T15:40:58.544482+0000","last_clean":"2024-04-17T15:40:58.544482+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:40:58.544482+0000","last_undegraded":"2024-04-17T15:40:58.544482+0000","last_fullsized":"2024-04-17T15:40:58.544482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546660+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:40:58.546660+0000","last_peered":"2024-04-17T15:40:58.546660+0000","last_clean":"2024-04-17T15:40:58.546660+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:40:58.546660+0000","last_undegraded":"2024-04-17T15:40:58.546660+0000","last_fullsized":"2024-04-17T15:40:58.546660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":195,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205059+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:58.205059+0000","last_peered":"2024-04-17T15:40:58.205059+0000","last_clean":"2024-04-17T15:40:58.205059+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:58.205059+0000","last_undegraded":"2024-04-17T15:40:58.205059+0000","last_fullsized":"2024-04-17T15:40:58.205059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"130'48","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.142493+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:41:11.142493+0000","last_peered":"2024-04-17T15:41:11.142493+0000","last_clean":"2024-04-17T15:41:11.142493+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:41:11.142493+0000","last_undegraded":"2024-04-17T15:41:11.142493+0000","last_fullsized":"2024-04-17T15:41:11.142493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":316,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.025470+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:41:10.025470+0000","last_peered":"2024-04-17T15:41:10.025470+0000","last_clean":"2024-04-17T15:41:10.025470+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:41:10.025470+0000","last_undegraded":"2024-04-17T15:41:10.025470+0000","last_fullsized":"2024-04-17T15:41:10.025470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'9","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869028+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:58.869028+0000","last_peered":"2024-04-17T15:40:58.869028+0000","last_clean":"2024-04-17T15:40:58.869028+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:58.869028+0000","last_undegraded":"2024-04-17T15:40:58.869028+0000","last_fullsized":"2024-04-17T15:40:58.869028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511688+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:58.511688+0000","last_peered":"2024-04-17T15:40:58.511688+0000","last_clean":"2024-04-17T15:40:58.511688+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:58.511688+0000","last_undegraded":"2024-04-17T15:40:58.511688+0000","last_fullsized":"2024-04-17T15:40:58.511688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870459+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:58.870459+0000","last_peered":"2024-04-17T15:40:58.870459+0000","last_clean":"2024-04-17T15:40:58.870459+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:58.870459+0000","last_undegraded":"2024-04-17T15:40:58.870459+0000","last_fullsized":"2024-04-17T15:40:58.870459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:39.190185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544795+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:40:58.544795+0000","last_peered":"2024-04-17T15:40:58.544795+0000","last_clean":"2024-04-17T15:40:58.544795+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:40:58.544795+0000","last_undegraded":"2024-04-17T15:40:58.544795+0000","last_fullsized":"2024-04-17T15:40:58.544795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"130'62","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.055964+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:41:11.055964+0000","last_peered":"2024-04-17T15:41:11.055964+0000","last_clean":"2024-04-17T15:41:11.055964+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:41:11.055964+0000","last_undegraded":"2024-04-17T15:41:11.055964+0000","last_fullsized":"2024-04-17T15:41:11.055964+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:03.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510907+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:40:58.510907+0000","last_peered":"2024-04-17T15:40:58.510907+0000","last_clean":"2024-04-17T15:40:58.510907+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:40:58.510907+0000","last_undegraded":"2024-04-17T15:40:58.510907+0000","last_fullsized":"2024-04-17T15:40:58.510907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"130'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.603297+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:41:10.603297+0000","last_peered":"2024-04-17T15:41:10.603297+0000","last_clean":"2024-04-17T15:41:10.603297+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:41:10.603297+0000","last_undegraded":"2024-04-17T15:41:10.603297+0000","last_fullsized":"2024-04-17T15:41:10.603297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551183+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:40:58.551183+0000","last_peered":"2024-04-17T15:40:58.551183+0000","last_clean":"2024-04-17T15:40:58.551183+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:40:58.551183+0000","last_undegraded":"2024-04-17T15:40:58.551183+0000","last_fullsized":"2024-04-17T15:40:58.551183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205899+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:58.205899+0000","last_peered":"2024-04-17T15:40:58.205899+0000","last_clean":"2024-04-17T15:40:58.205899+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:58.205899+0000","last_undegraded":"2024-04-17T15:40:58.205899+0000","last_fullsized":"2024-04-17T15:40:58.205899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544812+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:40:58.544812+0000","last_peered":"2024-04-17T15:40:58.544812+0000","last_clean":"2024-04-17T15:40:58.544812+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:40:58.544812+0000","last_undegraded":"2024-04-17T15:40:58.544812+0000","last_fullsized":"2024-04-17T15:40:58.544812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"130'56","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.105928+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:41:11.105928+0000","last_peered":"2024-04-17T15:41:11.105928+0000","last_clean":"2024-04-17T15:41:11.105928+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:41:11.105928+0000","last_undegraded":"2024-04-17T15:41:11.105928+0000","last_fullsized":"2024-04-17T15:41:11.105928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550102+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:40:58.550102+0000","last_peered":"2024-04-17T15:40:58.550102+0000","last_clean":"2024-04-17T15:40:58.550102+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:40:58.550102+0000","last_undegraded":"2024-04-17T15:40:58.550102+0000","last_fullsized":"2024-04-17T15:40:58.550102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"130'21","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.427101+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:41:10.427101+0000","last_peered":"2024-04-17T15:41:10.427101+0000","last_clean":"2024-04-17T15:41:10.427101+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:41:10.427101+0000","last_undegraded":"2024-04-17T15:41:10.427101+0000","last_fullsized":"2024-04-17T15:41:10.427101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870490+0000","last_change":"2024-04-17T15:37:02.268470+0000","last_active":"2024-04-17T15:40:58.870490+0000","last_peered":"2024-04-17T15:40:58.870490+0000","last_clean":"2024-04-17T15:40:58.870490+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:40:58.870490+0000","last_undegraded":"2024-04-17T15:40:58.870490+0000","last_fullsized":"2024-04-17T15:40:58.870490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553733+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:40:58.553733+0000","last_peered":"2024-04-17T15:40:58.553733+0000","last_clean":"2024-04-17T15:40:58.553733+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:40:58.553733+0000","last_undegraded":"2024-04-17T15:40:58.553733+0000","last_fullsized":"2024-04-17T15:40:58.553733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"130'50","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.025577+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:41:11.025577+0000","last_peered":"2024-04-17T15:41:11.025577+0000","last_clean":"2024-04-17T15:41:11.025577+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:41:11.025577+0000","last_undegraded":"2024-04-17T15:41:11.025577+0000","last_fullsized":"2024-04-17T15:41:11.025577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870131+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:40:58.870131+0000","last_peered":"2024-04-17T15:40:58.870131+0000","last_clean":"2024-04-17T15:40:58.870131+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:40:58.870131+0000","last_undegraded":"2024-04-17T15:40:58.870131+0000","last_fullsized":"2024-04-17T15:40:58.870131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"130'34","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.422641+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:41:10.422641+0000","last_peered":"2024-04-17T15:41:10.422641+0000","last_clean":"2024-04-17T15:41:10.422641+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:41:10.422641+0000","last_undegraded":"2024-04-17T15:41:10.422641+0000","last_fullsized":"2024-04-17T15:41:10.422641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:31.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206391+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:40:58.206391+0000","last_peered":"2024-04-17T15:40:58.206391+0000","last_clean":"2024-04-17T15:40:58.206391+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:40:58.206391+0000","last_undegraded":"2024-04-17T15:40:58.206391+0000","last_fullsized":"2024-04-17T15:40:58.206391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545154+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:58.545154+0000","last_peered":"2024-04-17T15:40:58.545154+0000","last_clean":"2024-04-17T15:40:58.545154+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:58.545154+0000","last_undegraded":"2024-04-17T15:40:58.545154+0000","last_fullsized":"2024-04-17T15:40:58.545154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870197+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:40:58.870197+0000","last_peered":"2024-04-17T15:40:58.870197+0000","last_clean":"2024-04-17T15:40:58.870197+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:40:58.870197+0000","last_undegraded":"2024-04-17T15:40:58.870197+0000","last_fullsized":"2024-04-17T15:40:58.870197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"130'48","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.185864+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:41:11.185864+0000","last_peered":"2024-04-17T15:41:11.185864+0000","last_clean":"2024-04-17T15:41:11.185864+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:41:11.185864+0000","last_undegraded":"2024-04-17T15:41:11.185864+0000","last_fullsized":"2024-04-17T15:41:11.185864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550405+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:40:58.550405+0000","last_peered":"2024-04-17T15:40:58.550405+0000","last_clean":"2024-04-17T15:40:58.550405+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:40:58.550405+0000","last_undegraded":"2024-04-17T15:40:58.550405+0000","last_fullsized":"2024-04-17T15:40:58.550405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"130'26","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.431921+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:41:10.431921+0000","last_peered":"2024-04-17T15:41:10.431921+0000","last_clean":"2024-04-17T15:41:10.431921+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:41:10.431921+0000","last_undegraded":"2024-04-17T15:41:10.431921+0000","last_fullsized":"2024-04-17T15:41:10.431921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207231+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:58.207231+0000","last_peered":"2024-04-17T15:40:58.207231+0000","last_clean":"2024-04-17T15:40:58.207231+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:58.207231+0000","last_undegraded":"2024-04-17T15:40:58.207231+0000","last_fullsized":"2024-04-17T15:40:58.207231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:54.681353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550842+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:58.550842+0000","last_peered":"2024-04-17T15:40:58.550842+0000","last_clean":"2024-04-17T15:40:58.550842+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:58.550842+0000","last_undegraded":"2024-04-17T15:40:58.550842+0000","last_fullsized":"2024-04-17T15:40:58.550842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546595+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:40:58.546595+0000","last_peered":"2024-04-17T15:40:58.546595+0000","last_clean":"2024-04-17T15:40:58.546595+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:40:58.546595+0000","last_undegraded":"2024-04-17T15:40:58.546595+0000","last_fullsized":"2024-04-17T15:40:58.546595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"130'56","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.058674+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:41:11.058674+0000","last_peered":"2024-04-17T15:41:11.058674+0000","last_clean":"2024-04-17T15:41:11.058674+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:41:11.058674+0000","last_undegraded":"2024-04-17T15:41:11.058674+0000","last_fullsized":"2024-04-17T15:41:11.058674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:38.917381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209537+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:58.209537+0000","last_peered":"2024-04-17T15:40:58.209537+0000","last_clean":"2024-04-17T15:40:58.209537+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:58.209537+0000","last_undegraded":"2024-04-17T15:40:58.209537+0000","last_fullsized":"2024-04-17T15:40:58.209537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.368949+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:41:10.368949+0000","last_peered":"2024-04-17T15:41:10.368949+0000","last_clean":"2024-04-17T15:41:10.368949+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:41:10.368949+0000","last_undegraded":"2024-04-17T15:41:10.368949+0000","last_fullsized":"2024-04-17T15:41:10.368949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206857+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:40:58.206857+0000","last_peered":"2024-04-17T15:40:58.206857+0000","last_clean":"2024-04-17T15:40:58.206857+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:40:58.206857+0000","last_undegraded":"2024-04-17T15:40:58.206857+0000","last_fullsized":"2024-04-17T15:40:58.206857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:15.579342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205399+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:58.205399+0000","last_peered":"2024-04-17T15:40:58.205399+0000","last_clean":"2024-04-17T15:40:58.205399+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:58.205399+0000","last_undegraded":"2024-04-17T15:40:58.205399+0000","last_fullsized":"2024-04-17T15:40:58.205399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832037+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:40:58.832037+0000","last_peered":"2024-04-17T15:40:58.832037+0000","last_clean":"2024-04-17T15:40:58.832037+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:40:58.832037+0000","last_undegraded":"2024-04-17T15:40:58.832037+0000","last_fullsized":"2024-04-17T15:40:58.832037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:36.851630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"130'54","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.168015+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:41:11.168015+0000","last_peered":"2024-04-17T15:41:11.168015+0000","last_clean":"2024-04-17T15:41:11.168015+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:41:11.168015+0000","last_undegraded":"2024-04-17T15:41:11.168015+0000","last_fullsized":"2024-04-17T15:41:11.168015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207897+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:40:58.207897+0000","last_peered":"2024-04-17T15:40:58.207897+0000","last_clean":"2024-04-17T15:40:58.207897+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:40:58.207897+0000","last_undegraded":"2024-04-17T15:40:58.207897+0000","last_fullsized":"2024-04-17T15:40:58.207897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:51.222123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"98'12","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210312+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:40:58.210312+0000","last_peered":"2024-04-17T15:40:58.210312+0000","last_clean":"2024-04-17T15:40:58.210312+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:40:58.210312+0000","last_undegraded":"2024-04-17T15:40:58.210312+0000","last_fullsized":"2024-04-17T15:40:58.210312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:49.798531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"130'138","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.215887+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:41:11.215887+0000","last_peered":"2024-04-17T15:41:11.215887+0000","last_clean":"2024-04-17T15:41:11.215887+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:41:11.215887+0000","last_undegraded":"2024-04-17T15:41:11.215887+0000","last_fullsized":"2024-04-17T15:41:11.215887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511119+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:58.511119+0000","last_peered":"2024-04-17T15:40:58.511119+0000","last_clean":"2024-04-17T15:40:58.511119+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:58.511119+0000","last_undegraded":"2024-04-17T15:40:58.511119+0000","last_fullsized":"2024-04-17T15:40:58.511119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207401+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:58.207401+0000","last_peered":"2024-04-17T15:40:58.207401+0000","last_clean":"2024-04-17T15:40:58.207401+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:58.207401+0000","last_undegraded":"2024-04-17T15:40:58.207401+0000","last_fullsized":"2024-04-17T15:40:58.207401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"130'42","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.180332+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:41:11.180332+0000","last_peered":"2024-04-17T15:41:11.180332+0000","last_clean":"2024-04-17T15:41:11.180332+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:41:11.180332+0000","last_undegraded":"2024-04-17T15:41:11.180332+0000","last_fullsized":"2024-04-17T15:41:11.180332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510932+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:40:58.510932+0000","last_peered":"2024-04-17T15:40:58.510932+0000","last_clean":"2024-04-17T15:40:58.510932+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:40:58.510932+0000","last_undegraded":"2024-04-17T15:40:58.510932+0000","last_fullsized":"2024-04-17T15:40:58.510932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"130'26","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.389504+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:41:10.389504+0000","last_peered":"2024-04-17T15:41:10.389504+0000","last_clean":"2024-04-17T15:41:10.389504+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:41:10.389504+0000","last_undegraded":"2024-04-17T15:41:10.389504+0000","last_fullsized":"2024-04-17T15:41:10.389504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868782+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:40:58.868782+0000","last_peered":"2024-04-17T15:40:58.868782+0000","last_clean":"2024-04-17T15:40:58.868782+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:40:58.868782+0000","last_undegraded":"2024-04-17T15:40:58.868782+0000","last_fullsized":"2024-04-17T15:40:58.868782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514028+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:58.514028+0000","last_peered":"2024-04-17T15:40:58.514028+0000","last_clean":"2024-04-17T15:40:58.514028+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:58.514028+0000","last_undegraded":"2024-04-17T15:40:58.514028+0000","last_fullsized":"2024-04-17T15:40:58.514028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208859+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:58.208859+0000","last_peered":"2024-04-17T15:40:58.208859+0000","last_clean":"2024-04-17T15:40:58.208859+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:58.208859+0000","last_undegraded":"2024-04-17T15:40:58.208859+0000","last_fullsized":"2024-04-17T15:40:58.208859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:20:58.858377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"130'50","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.088478+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:41:11.088478+0000","last_peered":"2024-04-17T15:41:11.088478+0000","last_clean":"2024-04-17T15:41:11.088478+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:41:11.088478+0000","last_undegraded":"2024-04-17T15:41:11.088478+0000","last_fullsized":"2024-04-17T15:41:11.088478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205705+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:58.205705+0000","last_peered":"2024-04-17T15:40:58.205705+0000","last_clean":"2024-04-17T15:40:58.205705+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:58.205705+0000","last_undegraded":"2024-04-17T15:40:58.205705+0000","last_fullsized":"2024-04-17T15:40:58.205705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"130'21","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.393888+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:41:10.393888+0000","last_peered":"2024-04-17T15:41:10.393888+0000","last_clean":"2024-04-17T15:41:10.393888+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:41:10.393888+0000","last_undegraded":"2024-04-17T15:41:10.393888+0000","last_fullsized":"2024-04-17T15:41:10.393888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:21:52.656567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550780+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:40:58.550780+0000","last_peered":"2024-04-17T15:40:58.550780+0000","last_clean":"2024-04-17T15:40:58.550780+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:40:58.550780+0000","last_undegraded":"2024-04-17T15:40:58.550780+0000","last_fullsized":"2024-04-17T15:40:58.550780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546804+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:58.546804+0000","last_peered":"2024-04-17T15:40:58.546804+0000","last_clean":"2024-04-17T15:40:58.546804+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:58.546804+0000","last_undegraded":"2024-04-17T15:40:58.546804+0000","last_fullsized":"2024-04-17T15:40:58.546804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544901+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:40:58.544901+0000","last_peered":"2024-04-17T15:40:58.544901+0000","last_clean":"2024-04-17T15:40:58.544901+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:40:58.544901+0000","last_undegraded":"2024-04-17T15:40:58.544901+0000","last_fullsized":"2024-04-17T15:40:58.544901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"130'44","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.178426+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:41:11.178426+0000","last_peered":"2024-04-17T15:41:11.178426+0000","last_clean":"2024-04-17T15:41:11.178426+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:41:11.178426+0000","last_undegraded":"2024-04-17T15:41:11.178426+0000","last_fullsized":"2024-04-17T15:41:11.178426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205607+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:40:58.205607+0000","last_peered":"2024-04-17T15:40:58.205607+0000","last_clean":"2024-04-17T15:40:58.205607+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:40:58.205607+0000","last_undegraded":"2024-04-17T15:40:58.205607+0000","last_fullsized":"2024-04-17T15:40:58.205607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"130'16","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.361582+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:41:10.361582+0000","last_peered":"2024-04-17T15:41:10.361582+0000","last_clean":"2024-04-17T15:41:10.361582+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:41:10.361582+0000","last_undegraded":"2024-04-17T15:41:10.361582+0000","last_fullsized":"2024-04-17T15:41:10.361582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207130+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:58.207130+0000","last_peered":"2024-04-17T15:40:58.207130+0000","last_clean":"2024-04-17T15:40:58.207130+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:58.207130+0000","last_undegraded":"2024-04-17T15:40:58.207130+0000","last_fullsized":"2024-04-17T15:40:58.207130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513344+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:58.513344+0000","last_peered":"2024-04-17T15:40:58.513344+0000","last_clean":"2024-04-17T15:40:58.513344+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:58.513344+0000","last_undegraded":"2024-04-17T15:40:58.513344+0000","last_fullsized":"2024-04-17T15:40:58.513344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206775+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:40:58.206775+0000","last_peered":"2024-04-17T15:40:58.206775+0000","last_clean":"2024-04-17T15:40:58.206775+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:40:58.206775+0000","last_undegraded":"2024-04-17T15:40:58.206775+0000","last_fullsized":"2024-04-17T15:40:58.206775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"130'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.111163+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:41:11.111163+0000","last_peered":"2024-04-17T15:41:11.111163+0000","last_clean":"2024-04-17T15:41:11.111163+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:41:11.111163+0000","last_undegraded":"2024-04-17T15:41:11.111163+0000","last_fullsized":"2024-04-17T15:41:11.111163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205395+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:40:58.205395+0000","last_peered":"2024-04-17T15:40:58.205395+0000","last_clean":"2024-04-17T15:40:58.205395+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:40:58.205395+0000","last_undegraded":"2024-04-17T15:40:58.205395+0000","last_fullsized":"2024-04-17T15:40:58.205395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:21.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"130'21","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.370442+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:41:10.370442+0000","last_peered":"2024-04-17T15:41:10.370442+0000","last_clean":"2024-04-17T15:41:10.370442+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:41:10.370442+0000","last_undegraded":"2024-04-17T15:41:10.370442+0000","last_fullsized":"2024-04-17T15:41:10.370442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869445+0000","last_change":"2024-04-17T15:37:02.271133+0000","last_active":"2024-04-17T15:40:58.869445+0000","last_peered":"2024-04-17T15:40:58.869445+0000","last_clean":"2024-04-17T15:40:58.869445+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:40:58.869445+0000","last_undegraded":"2024-04-17T15:40:58.869445+0000","last_fullsized":"2024-04-17T15:40:58.869445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209600+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:58.209600+0000","last_peered":"2024-04-17T15:40:58.209600+0000","last_clean":"2024-04-17T15:40:58.209600+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:58.209600+0000","last_undegraded":"2024-04-17T15:40:58.209600+0000","last_fullsized":"2024-04-17T15:40:58.209600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208657+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:40:58.208657+0000","last_peered":"2024-04-17T15:40:58.208657+0000","last_clean":"2024-04-17T15:40:58.208657+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:40:58.208657+0000","last_undegraded":"2024-04-17T15:40:58.208657+0000","last_fullsized":"2024-04-17T15:40:58.208657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:45.285622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'56","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.166338+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:41:11.166338+0000","last_peered":"2024-04-17T15:41:11.166338+0000","last_clean":"2024-04-17T15:41:11.166338+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:41:11.166338+0000","last_undegraded":"2024-04-17T15:41:11.166338+0000","last_fullsized":"2024-04-17T15:41:11.166338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207501+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:40:58.207501+0000","last_peered":"2024-04-17T15:40:58.207501+0000","last_clean":"2024-04-17T15:40:58.207501+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:40:58.207501+0000","last_undegraded":"2024-04-17T15:40:58.207501+0000","last_fullsized":"2024-04-17T15:40:58.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:06.243158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"130'44","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.129092+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:41:11.129092+0000","last_peered":"2024-04-17T15:41:11.129092+0000","last_clean":"2024-04-17T15:41:11.129092+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:41:11.129092+0000","last_undegraded":"2024-04-17T15:41:11.129092+0000","last_fullsized":"2024-04-17T15:41:11.129092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:22.797588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210291+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:40:58.210291+0000","last_peered":"2024-04-17T15:40:58.210291+0000","last_clean":"2024-04-17T15:40:58.210291+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:40:58.210291+0000","last_undegraded":"2024-04-17T15:40:58.210291+0000","last_fullsized":"2024-04-17T15:40:58.210291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"130'42","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.151416+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:41:11.151416+0000","last_peered":"2024-04-17T15:41:11.151416+0000","last_clean":"2024-04-17T15:41:11.151416+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:41:11.151416+0000","last_undegraded":"2024-04-17T15:41:11.151416+0000","last_fullsized":"2024-04-17T15:41:11.151416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207964+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:40:58.207964+0000","last_peered":"2024-04-17T15:40:58.207964+0000","last_clean":"2024-04-17T15:40:58.207964+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:40:58.207964+0000","last_undegraded":"2024-04-17T15:40:58.207964+0000","last_fullsized":"2024-04-17T15:40:58.207964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:15.597252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"130'42","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.134164+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:41:11.134164+0000","last_peered":"2024-04-17T15:41:11.134164+0000","last_clean":"2024-04-17T15:41:11.134164+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:41:11.134164+0000","last_undegraded":"2024-04-17T15:41:11.134164+0000","last_fullsized":"2024-04-17T15:41:11.134164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546037+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:40:58.546037+0000","last_peered":"2024-04-17T15:40:58.546037+0000","last_clean":"2024-04-17T15:40:58.546037+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:40:58.546037+0000","last_undegraded":"2024-04-17T15:40:58.546037+0000","last_fullsized":"2024-04-17T15:40:58.546037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"130'50","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.001896+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:41:11.001896+0000","last_peered":"2024-04-17T15:41:11.001896+0000","last_clean":"2024-04-17T15:41:11.001896+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:41:11.001896+0000","last_undegraded":"2024-04-17T15:41:11.001896+0000","last_fullsized":"2024-04-17T15:41:11.001896+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:25.867844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209479+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:40:58.209479+0000","last_peered":"2024-04-17T15:40:58.209479+0000","last_clean":"2024-04-17T15:40:58.209479+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:40:58.209479+0000","last_undegraded":"2024-04-17T15:40:58.209479+0000","last_fullsized":"2024-04-17T15:40:58.209479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"130'64","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.167900+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:41:11.167900+0000","last_peered":"2024-04-17T15:41:11.167900+0000","last_clean":"2024-04-17T15:41:11.167900+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:41:11.167900+0000","last_undegraded":"2024-04-17T15:41:11.167900+0000","last_fullsized":"2024-04-17T15:41:11.167900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544752+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:40:58.544752+0000","last_peered":"2024-04-17T15:40:58.544752+0000","last_clean":"2024-04-17T15:40:58.544752+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:40:58.544752+0000","last_undegraded":"2024-04-17T15:40:58.544752+0000","last_fullsized":"2024-04-17T15:40:58.544752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"130'50","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.128920+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:41:11.128920+0000","last_peered":"2024-04-17T15:41:11.128920+0000","last_clean":"2024-04-17T15:41:11.128920+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:41:11.128920+0000","last_undegraded":"2024-04-17T15:41:11.128920+0000","last_fullsized":"2024-04-17T15:41:11.128920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550656+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:40:58.550656+0000","last_peered":"2024-04-17T15:40:58.550656+0000","last_clean":"2024-04-17T15:40:58.550656+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:40:58.550656+0000","last_undegraded":"2024-04-17T15:40:58.550656+0000","last_fullsized":"2024-04-17T15:40:58.550656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"130'42","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.152143+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:41:11.152143+0000","last_peered":"2024-04-17T15:41:11.152143+0000","last_clean":"2024-04-17T15:41:11.152143+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:41:11.152143+0000","last_undegraded":"2024-04-17T15:41:11.152143+0000","last_fullsized":"2024-04-17T15:41:11.152143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870300+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:40:58.870300+0000","last_peered":"2024-04-17T15:40:58.870300+0000","last_clean":"2024-04-17T15:40:58.870300+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:40:58.870300+0000","last_undegraded":"2024-04-17T15:40:58.870300+0000","last_fullsized":"2024-04-17T15:40:58.870300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"130'50","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.118206+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:41:11.118206+0000","last_peered":"2024-04-17T15:41:11.118206+0000","last_clean":"2024-04-17T15:41:11.118206+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:41:11.118206+0000","last_undegraded":"2024-04-17T15:41:11.118206+0000","last_fullsized":"2024-04-17T15:41:11.118206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212281+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:40:58.212281+0000","last_peered":"2024-04-17T15:40:58.212281+0000","last_clean":"2024-04-17T15:40:58.212281+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:40:58.212281+0000","last_undegraded":"2024-04-17T15:40:58.212281+0000","last_fullsized":"2024-04-17T15:40:58.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"130'44","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.132788+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:41:11.132788+0000","last_peered":"2024-04-17T15:41:11.132788+0000","last_clean":"2024-04-17T15:41:11.132788+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:41:11.132788+0000","last_undegraded":"2024-04-17T15:41:11.132788+0000","last_fullsized":"2024-04-17T15:41:11.132788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832094+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:40:58.832094+0000","last_peered":"2024-04-17T15:40:58.832094+0000","last_clean":"2024-04-17T15:40:58.832094+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:40:58.832094+0000","last_undegraded":"2024-04-17T15:40:58.832094+0000","last_fullsized":"2024-04-17T15:40:58.832094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:51.439967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"130'48","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.142243+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:41:11.142243+0000","last_peered":"2024-04-17T15:41:11.142243+0000","last_clean":"2024-04-17T15:41:11.142243+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:41:11.142243+0000","last_undegraded":"2024-04-17T15:41:11.142243+0000","last_fullsized":"2024-04-17T15:41:11.142243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209083+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:40:58.209083+0000","last_peered":"2024-04-17T15:40:58.209083+0000","last_clean":"2024-04-17T15:40:58.209083+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:40:58.209083+0000","last_undegraded":"2024-04-17T15:40:58.209083+0000","last_fullsized":"2024-04-17T15:40:58.209083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"130'52","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.160265+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:41:11.160265+0000","last_peered":"2024-04-17T15:41:11.160265+0000","last_clean":"2024-04-17T15:41:11.160265+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:41:11.160265+0000","last_undegraded":"2024-04-17T15:41:11.160265+0000","last_fullsized":"2024-04-17T15:41:11.160265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512328+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:40:58.512328+0000","last_peered":"2024-04-17T15:40:58.512328+0000","last_clean":"2024-04-17T15:40:58.512328+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:40:58.512328+0000","last_undegraded":"2024-04-17T15:40:58.512328+0000","last_fullsized":"2024-04-17T15:40:58.512328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"130'58","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.119049+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:41:11.119049+0000","last_peered":"2024-04-17T15:41:11.119049+0000","last_clean":"2024-04-17T15:41:11.119049+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:41:11.119049+0000","last_undegraded":"2024-04-17T15:41:11.119049+0000","last_fullsized":"2024-04-17T15:41:11.119049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869267+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:40:58.869267+0000","last_peered":"2024-04-17T15:40:58.869267+0000","last_clean":"2024-04-17T15:40:58.869267+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:40:58.869267+0000","last_undegraded":"2024-04-17T15:40:58.869267+0000","last_fullsized":"2024-04-17T15:40:58.869267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:56.817914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"130'40","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.165696+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:41:11.165696+0000","last_peered":"2024-04-17T15:41:11.165696+0000","last_clean":"2024-04-17T15:41:11.165696+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:41:11.165696+0000","last_undegraded":"2024-04-17T15:41:11.165696+0000","last_fullsized":"2024-04-17T15:41:11.165696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830799+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:40:58.830799+0000","last_peered":"2024-04-17T15:40:58.830799+0000","last_clean":"2024-04-17T15:40:58.830799+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:40:58.830799+0000","last_undegraded":"2024-04-17T15:40:58.830799+0000","last_fullsized":"2024-04-17T15:40:58.830799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:00.333486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"130'32","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.178873+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:41:11.178873+0000","last_peered":"2024-04-17T15:41:11.178873+0000","last_clean":"2024-04-17T15:41:11.178873+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:41:11.178873+0000","last_undegraded":"2024-04-17T15:41:11.178873+0000","last_fullsized":"2024-04-17T15:41:11.178873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:05.428643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511460+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:40:58.511460+0000","last_peered":"2024-04-17T15:40:58.511460+0000","last_clean":"2024-04-17T15:40:58.511460+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:40:58.511460+0000","last_undegraded":"2024-04-17T15:40:58.511460+0000","last_fullsized":"2024-04-17T15:40:58.511460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"130'46","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.060768+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:41:11.060768+0000","last_peered":"2024-04-17T15:41:11.060768+0000","last_clean":"2024-04-17T15:41:11.060768+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:41:11.060768+0000","last_undegraded":"2024-04-17T15:41:11.060768+0000","last_fullsized":"2024-04-17T15:41:11.060768+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:55.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"130'66","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.115311+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:41:11.115311+0000","last_peered":"2024-04-17T15:41:11.115311+0000","last_clean":"2024-04-17T15:41:11.115311+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:41:11.115311+0000","last_undegraded":"2024-04-17T15:41:11.115311+0000","last_fullsized":"2024-04-17T15:41:11.115311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870275+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:40:58.870275+0000","last_peered":"2024-04-17T15:40:58.870275+0000","last_clean":"2024-04-17T15:40:58.870275+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:40:58.870275+0000","last_undegraded":"2024-04-17T15:40:58.870275+0000","last_fullsized":"2024-04-17T15:40:58.870275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"130'28","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.098190+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:41:11.098190+0000","last_peered":"2024-04-17T15:41:11.098190+0000","last_clean":"2024-04-17T15:41:11.098190+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:41:11.098190+0000","last_undegraded":"2024-04-17T15:41:11.098190+0000","last_fullsized":"2024-04-17T15:41:11.098190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210809+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:40:58.210809+0000","last_peered":"2024-04-17T15:40:58.210809+0000","last_clean":"2024-04-17T15:40:58.210809+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:40:58.210809+0000","last_undegraded":"2024-04-17T15:40:58.210809+0000","last_fullsized":"2024-04-17T15:40:58.210809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1104,"ondisk_log_size":1104,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1539,"num_write":537,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":861,"ondisk_log_size":861,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542203,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1256284,"kb_used_data":1220824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93115556,"statfs":{"total":96636764160,"available":95350329344,"internally_reserved":0,"allocated":1250123776,"data_stored":1249441653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":860288,"kb_used_data":829112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93511552,"statfs":{"total":96636764160,"available":95755829248,"internally_reserved":0,"allocated":849010688,"data_stored":848353300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1118392,"kb_used_data":1083056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93253448,"statfs":{"total":96636764160,"available":95491530752,"internally_reserved":0,"allocated":1109049344,"data_stored":1108343273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542202,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":960452,"kb_used_data":929276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93411388,"statfs":{"total":96636764160,"available":95653261312,"internally_reserved":0,"allocated":951578624,"data_stored":950937888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542201,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1056812,"kb_used_data":1021476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93315028,"statfs":{"total":96636764160,"available":95554588672,"internally_reserved":0,"allocated":1045991424,"data_stored":1045312022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542202,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380928,"kb_used_data":349692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93990912,"statfs":{"total":96636764160,"available":96246693888,"internally_reserved":0,"allocated":358084608,"data_stored":357443936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37020,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334820,"statfs":{"total":96636764160,"available":96598855680,"internally_reserved":0,"allocated":1605632,"data_stored":929612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542201,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1036832,"kb_used_data":1005652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93335008,"statfs":{"total":96636764160,"available":95575048192,"internally_reserved":0,"allocated":1029787648,"data_stored":1029124441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:41:12.444 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T15:41:12.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:12.790 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":130,"fsid":"b60ce601-dc23-41b0-bc9a-dbbec538ec02","created":"2024-04-17T15:36:35.284161+0000","modified":"2024-04-17T15:40:58.197858+0000","last_up_change":"2024-04-17T15:36:46.049817+0000","last_in_change":"2024-04-17T15:36:37.641404+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T15:36:46.270784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T15:36:46.444362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-17T15:36:52.871633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-17T15:36:54.513126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-17T15:36:56.413136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-17T15:36:58.364100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-17T15:37:00.271798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-17T15:37:02.420124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c841b259-219b-4f39-a952-8ef354c8a4d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6825","nonce":4073594120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6827","nonce":4073594120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6831","nonce":4073594120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4073594120},{"type":"v1","addr":"172.21.15.44:6829","nonce":4073594120}]},"public_addr":"172.21.15.44:6825/4073594120","cluster_addr":"172.21.15.44:6827/4073594120","heartbeat_back_addr":"172.21.15.44:6831/4073594120","heartbeat_front_addr":"172.21.15.44:6829/4073594120","state":["exists","up"]},{"osd":1,"uuid":"daffe35c-9fda-4a02-81e2-b40855ff3e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6801","nonce":3956479268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6803","nonce":3956479268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6807","nonce":3956479268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3956479268},{"type":"v1","addr":"172.21.15.44:6805","nonce":3956479268}]},"public_addr":"172.21.15.44:6801/3956479268","cluster_addr":"172.21.15.44:6803/3956479268","heartbeat_back_addr":"172.21.15.44:6807/3956479268","heartbeat_front_addr":"172.21.15.44:6805/3956479268","state":["exists","up"]},{"osd":2,"uuid":"653abe6b-68bd-4e83-b0a7-2691e1d0dd0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6810","nonce":2986857736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6814","nonce":2986857736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6822","nonce":2986857736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2986857736},{"type":"v1","addr":"172.21.15.44:6818","nonce":2986857736}]},"public_addr":"172.21.15.44:6810/2986857736","cluster_addr":"172.21.15.44:6814/2986857736","heartbeat_back_addr":"172.21.15.44:6822/2986857736","heartbeat_front_addr":"172.21.15.44:6818/2986857736","state":["exists","up"]},{"osd":3,"uuid":"71cbfda2-d611-49da-b314-284be425b041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6811","nonce":3785559761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6815","nonce":3785559761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6821","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6823","nonce":3785559761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3785559761},{"type":"v1","addr":"172.21.15.44:6819","nonce":3785559761}]},"public_addr":"172.21.15.44:6811/3785559761","cluster_addr":"172.21.15.44:6815/3785559761","heartbeat_back_addr":"172.21.15.44:6823/3785559761","heartbeat_front_addr":"172.21.15.44:6819/3785559761","state":["exists","up"]},{"osd":4,"uuid":"c68cb5c7-9093-418d-be3c-db3e3bd8eab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6819","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6821","nonce":466020694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6825","nonce":466020694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6831","nonce":466020694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6827","nonce":466020694},{"type":"v1","addr":"172.21.15.63:6829","nonce":466020694}]},"public_addr":"172.21.15.63:6821/466020694","cluster_addr":"172.21.15.63:6825/466020694","heartbeat_back_addr":"172.21.15.63:6831/466020694","heartbeat_front_addr":"172.21.15.63:6829/466020694","state":["exists","up"]},{"osd":5,"uuid":"638215dd-8efa-4141-8ae7-3aa44152ab5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6802","nonce":1787755738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6806","nonce":1787755738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6814","nonce":1787755738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1787755738},{"type":"v1","addr":"172.21.15.63:6810","nonce":1787755738}]},"public_addr":"172.21.15.63:6802/1787755738","cluster_addr":"172.21.15.63:6806/1787755738","heartbeat_back_addr":"172.21.15.63:6814/1787755738","heartbeat_front_addr":"172.21.15.63:6810/1787755738","state":["exists","up"]},{"osd":6,"uuid":"b0cb7f79-bc86-4f01-9185-35d3b5166fc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6801","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6803","nonce":1209539994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6805","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6807","nonce":1209539994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6813","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6815","nonce":1209539994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":1209539994},{"type":"v1","addr":"172.21.15.63:6811","nonce":1209539994}]},"public_addr":"172.21.15.63:6803/1209539994","cluster_addr":"172.21.15.63:6807/1209539994","heartbeat_back_addr":"172.21.15.63:6815/1209539994","heartbeat_front_addr":"172.21.15.63:6811/1209539994","state":["exists","up"]},{"osd":7,"uuid":"dd1dcd37-cf5e-4ac9-8fa9-a9964dcd1b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6817","nonce":573406477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6820","nonce":573406477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6828","nonce":573406477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":573406477},{"type":"v1","addr":"172.21.15.63:6824","nonce":573406477}]},"public_addr":"172.21.15.63:6817/573406477","cluster_addr":"172.21.15.63:6820/573406477","heartbeat_back_addr":"172.21.15.63:6828/573406477","heartbeat_front_addr":"172.21.15.63:6824/573406477","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.230218+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.131179+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.228760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.255261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.248671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.197037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.153100+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T15:36:43.201227+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T15:41:13.810 INFO:tasks.ceph:Scrubbing osd.0 2024-04-17T15:41:13.810 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:41:13.976 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:41:13.977 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:41:13.977 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:41:13.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-17T15:41:14.285 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-04-17T15:41:14.303 INFO:tasks.ceph:Scrubbing osd.1 2024-04-17T15:41:14.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:41:14.444 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:41:14.444 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:41:14.444 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:41:14.459 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-17T15:41:14.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-17T15:41:14.750 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-04-17T15:41:14.771 INFO:tasks.ceph:Scrubbing osd.2 2024-04-17T15:41:14.771 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:41:14.920 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:41:14.920 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:41:14.920 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:41:14.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-17T15:41:15.235 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-04-17T15:41:15.255 INFO:tasks.ceph:Scrubbing osd.3 2024-04-17T15:41:15.256 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:41:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:41:15.405 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:41:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:41:15.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-17T15:41:15.722 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 3 to deep-scrub 2024-04-17T15:41:15.742 INFO:tasks.ceph:Scrubbing osd.4 2024-04-17T15:41:15.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:41:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:41:15.895 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:41:15.895 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:41:15.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-17T15:41:16.198 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 4 to deep-scrub 2024-04-17T15:41:16.217 INFO:tasks.ceph:Scrubbing osd.5 2024-04-17T15:41:16.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:41:16.362 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:41:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:41:16.362 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:41:16.378 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-17T15:41:16.668 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 5 to deep-scrub 2024-04-17T15:41:16.687 INFO:tasks.ceph:Scrubbing osd.6 2024-04-17T15:41:16.687 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:41:16.841 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:41:16.841 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:41:16.841 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:41:16.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-17T15:41:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 6 to deep-scrub 2024-04-17T15:41:17.179 INFO:tasks.ceph:Scrubbing osd.7 2024-04-17T15:41:17.179 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-17T15:41:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-17T15:41:17.339 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T15:41:17.339 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-17T15:41:17.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-17T15:41:17.652 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 7 to deep-scrub 2024-04-17T15:41:17.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:41:18.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:18.007 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:41:18.019 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-04-17T15:41:16.331316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616016,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5028,"num_read_kb":3926,"num_write":4421,"num_write_kb":6187915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5530,"ondisk_log_size":5530,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2527164,"kb_used_data":2252204,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":752447556,"statfs":{"total":773094113280,"available":770506297344,"internally_reserved":0,"allocated":2306256896,"data_stored":2300917719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":280874546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195939,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1724,"num_read_kb":930,"num_write":1578,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005886"},"pg_stats":[{"pgid":"3.3f","version":"130'38","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.109316+0000","last_change":"2024-04-17T15:36:54.209890+0000","last_active":"2024-04-17T15:41:11.109316+0000","last_peered":"2024-04-17T15:41:11.109316+0000","last_clean":"2024-04-17T15:41:11.109316+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:41:11.109316+0000","last_undegraded":"2024-04-17T15:41:11.109316+0000","last_fullsized":"2024-04-17T15:41:11.109316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:13.575513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205015+0000","last_change":"2024-04-17T15:36:56.215486+0000","last_active":"2024-04-17T15:40:58.205015+0000","last_peered":"2024-04-17T15:40:58.205015+0000","last_clean":"2024-04-17T15:40:58.205015+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:40:58.205015+0000","last_undegraded":"2024-04-17T15:40:58.205015+0000","last_fullsized":"2024-04-17T15:40:58.205015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"130'52","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.197016+0000","last_change":"2024-04-17T15:36:54.171754+0000","last_active":"2024-04-17T15:41:11.197016+0000","last_peered":"2024-04-17T15:41:11.197016+0000","last_clean":"2024-04-17T15:41:11.197016+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:41:11.197016+0000","last_undegraded":"2024-04-17T15:41:11.197016+0000","last_fullsized":"2024-04-17T15:41:11.197016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511785+0000","last_change":"2024-04-17T15:36:56.210274+0000","last_active":"2024-04-17T15:40:58.511785+0000","last_peered":"2024-04-17T15:40:58.511785+0000","last_clean":"2024-04-17T15:40:58.511785+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:40:58.511785+0000","last_undegraded":"2024-04-17T15:40:58.511785+0000","last_fullsized":"2024-04-17T15:40:58.511785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"130'44","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.171905+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:41:11.171905+0000","last_peered":"2024-04-17T15:41:11.171905+0000","last_clean":"2024-04-17T15:41:11.171905+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:41:11.171905+0000","last_undegraded":"2024-04-17T15:41:11.171905+0000","last_fullsized":"2024-04-17T15:41:11.171905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208533+0000","last_change":"2024-04-17T15:36:56.197600+0000","last_active":"2024-04-17T15:40:58.208533+0000","last_peered":"2024-04-17T15:40:58.208533+0000","last_clean":"2024-04-17T15:40:58.208533+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:40:58.208533+0000","last_undegraded":"2024-04-17T15:40:58.208533+0000","last_fullsized":"2024-04-17T15:40:58.208533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"130'38","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.182063+0000","last_change":"2024-04-17T15:36:54.182645+0000","last_active":"2024-04-17T15:41:11.182063+0000","last_peered":"2024-04-17T15:41:11.182063+0000","last_clean":"2024-04-17T15:41:11.182063+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:41:11.182063+0000","last_undegraded":"2024-04-17T15:41:11.182063+0000","last_fullsized":"2024-04-17T15:41:11.182063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:39.098332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869821+0000","last_change":"2024-04-17T15:36:56.195189+0000","last_active":"2024-04-17T15:40:58.869821+0000","last_peered":"2024-04-17T15:40:58.869821+0000","last_clean":"2024-04-17T15:40:58.869821+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:40:58.869821+0000","last_undegraded":"2024-04-17T15:40:58.869821+0000","last_fullsized":"2024-04-17T15:40:58.869821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"130'62","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.161949+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:41:11.161949+0000","last_peered":"2024-04-17T15:41:11.161949+0000","last_clean":"2024-04-17T15:41:11.161949+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:41:11.161949+0000","last_undegraded":"2024-04-17T15:41:11.161949+0000","last_fullsized":"2024-04-17T15:41:11.161949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:48:19.772029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551803+0000","last_change":"2024-04-17T15:36:56.192683+0000","last_active":"2024-04-17T15:40:58.551803+0000","last_peered":"2024-04-17T15:40:58.551803+0000","last_clean":"2024-04-17T15:40:58.551803+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:40:58.551803+0000","last_undegraded":"2024-04-17T15:40:58.551803+0000","last_fullsized":"2024-04-17T15:40:58.551803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:03.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"130'38","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.191750+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:41:11.191750+0000","last_peered":"2024-04-17T15:41:11.191750+0000","last_clean":"2024-04-17T15:41:11.191750+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:41:11.191750+0000","last_undegraded":"2024-04-17T15:41:11.191750+0000","last_fullsized":"2024-04-17T15:41:11.191750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:14:36.361078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.314609+0000","last_change":"2024-04-17T15:36:56.204004+0000","last_active":"2024-04-17T15:41:06.314609+0000","last_peered":"2024-04-17T15:41:06.314609+0000","last_clean":"2024-04-17T15:41:06.314609+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:41:06.314609+0000","last_undegraded":"2024-04-17T15:41:06.314609+0000","last_fullsized":"2024-04-17T15:41:06.314609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"130'48","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.094952+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:41:11.094952+0000","last_peered":"2024-04-17T15:41:11.094952+0000","last_clean":"2024-04-17T15:41:11.094952+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:41:11.094952+0000","last_undegraded":"2024-04-17T15:41:11.094952+0000","last_fullsized":"2024-04-17T15:41:11.094952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210663+0000","last_change":"2024-04-17T15:36:56.207643+0000","last_active":"2024-04-17T15:40:58.210663+0000","last_peered":"2024-04-17T15:40:58.210663+0000","last_clean":"2024-04-17T15:40:58.210663+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:40:58.210663+0000","last_undegraded":"2024-04-17T15:40:58.210663+0000","last_fullsized":"2024-04-17T15:40:58.210663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:15.379777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"130'58","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.146258+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:41:11.146258+0000","last_peered":"2024-04-17T15:41:11.146258+0000","last_clean":"2024-04-17T15:41:11.146258+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:41:11.146258+0000","last_undegraded":"2024-04-17T15:41:11.146258+0000","last_fullsized":"2024-04-17T15:41:11.146258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:56:52.851321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.295599+0000","last_change":"2024-04-17T15:36:56.195908+0000","last_active":"2024-04-17T15:41:06.295599+0000","last_peered":"2024-04-17T15:41:06.295599+0000","last_clean":"2024-04-17T15:41:06.295599+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:41:06.295599+0000","last_undegraded":"2024-04-17T15:41:06.295599+0000","last_fullsized":"2024-04-17T15:41:06.295599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206558+0000","last_change":"2024-04-17T15:36:56.197020+0000","last_active":"2024-04-17T15:40:58.206558+0000","last_peered":"2024-04-17T15:40:58.206558+0000","last_clean":"2024-04-17T15:40:58.206558+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:40:58.206558+0000","last_undegraded":"2024-04-17T15:40:58.206558+0000","last_fullsized":"2024-04-17T15:40:58.206558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"130'30","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.070090+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:41:11.070090+0000","last_peered":"2024-04-17T15:41:11.070090+0000","last_clean":"2024-04-17T15:41:11.070090+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:41:11.070090+0000","last_undegraded":"2024-04-17T15:41:11.070090+0000","last_fullsized":"2024-04-17T15:41:11.070090+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:50:44.110358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511961+0000","last_change":"2024-04-17T15:36:56.214224+0000","last_active":"2024-04-17T15:40:58.511961+0000","last_peered":"2024-04-17T15:40:58.511961+0000","last_clean":"2024-04-17T15:40:58.511961+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:40:58.511961+0000","last_undegraded":"2024-04-17T15:40:58.511961+0000","last_fullsized":"2024-04-17T15:40:58.511961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"130'38","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.156852+0000","last_change":"2024-04-17T15:36:54.197433+0000","last_active":"2024-04-17T15:41:11.156852+0000","last_peered":"2024-04-17T15:41:11.156852+0000","last_clean":"2024-04-17T15:41:11.156852+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:41:11.156852+0000","last_undegraded":"2024-04-17T15:41:11.156852+0000","last_fullsized":"2024-04-17T15:41:11.156852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:51.456269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206650+0000","last_change":"2024-04-17T15:36:56.193169+0000","last_active":"2024-04-17T15:40:58.206650+0000","last_peered":"2024-04-17T15:40:58.206650+0000","last_clean":"2024-04-17T15:40:58.206650+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:40:58.206650+0000","last_undegraded":"2024-04-17T15:40:58.206650+0000","last_fullsized":"2024-04-17T15:40:58.206650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:44.982699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"130'44","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.081276+0000","last_change":"2024-04-17T15:36:54.197048+0000","last_active":"2024-04-17T15:41:11.081276+0000","last_peered":"2024-04-17T15:41:11.081276+0000","last_clean":"2024-04-17T15:41:11.081276+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:41:11.081276+0000","last_undegraded":"2024-04-17T15:41:11.081276+0000","last_fullsized":"2024-04-17T15:41:11.081276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:56:58.069594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831209+0000","last_change":"2024-04-17T15:36:56.190168+0000","last_active":"2024-04-17T15:40:58.831209+0000","last_peered":"2024-04-17T15:40:58.831209+0000","last_clean":"2024-04-17T15:40:58.831209+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:40:58.831209+0000","last_undegraded":"2024-04-17T15:40:58.831209+0000","last_fullsized":"2024-04-17T15:40:58.831209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"130'46","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.142205+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:41:11.142205+0000","last_peered":"2024-04-17T15:41:11.142205+0000","last_clean":"2024-04-17T15:41:11.142205+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:41:11.142205+0000","last_undegraded":"2024-04-17T15:41:11.142205+0000","last_fullsized":"2024-04-17T15:41:11.142205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832097+0000","last_change":"2024-04-17T15:36:56.199327+0000","last_active":"2024-04-17T15:40:58.832097+0000","last_peered":"2024-04-17T15:40:58.832097+0000","last_clean":"2024-04-17T15:40:58.832097+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:40:58.832097+0000","last_undegraded":"2024-04-17T15:40:58.832097+0000","last_fullsized":"2024-04-17T15:40:58.832097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"130'40","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.172516+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:41:11.172516+0000","last_peered":"2024-04-17T15:41:11.172516+0000","last_clean":"2024-04-17T15:41:11.172516+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:41:11.172516+0000","last_undegraded":"2024-04-17T15:41:11.172516+0000","last_fullsized":"2024-04-17T15:41:11.172516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:15:02.547370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208877+0000","last_change":"2024-04-17T15:36:56.186970+0000","last_active":"2024-04-17T15:40:58.208877+0000","last_peered":"2024-04-17T15:40:58.208877+0000","last_clean":"2024-04-17T15:40:58.208877+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:40:58.208877+0000","last_undegraded":"2024-04-17T15:40:58.208877+0000","last_fullsized":"2024-04-17T15:40:58.208877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"130'48","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.196278+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:41:11.196278+0000","last_peered":"2024-04-17T15:41:11.196278+0000","last_clean":"2024-04-17T15:41:11.196278+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:41:11.196278+0000","last_undegraded":"2024-04-17T15:41:11.196278+0000","last_fullsized":"2024-04-17T15:41:11.196278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206230+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:58.206230+0000","last_peered":"2024-04-17T15:40:58.206230+0000","last_clean":"2024-04-17T15:40:58.206230+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:58.206230+0000","last_undegraded":"2024-04-17T15:40:58.206230+0000","last_fullsized":"2024-04-17T15:40:58.206230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546278+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:40:58.546278+0000","last_peered":"2024-04-17T15:40:58.546278+0000","last_clean":"2024-04-17T15:40:58.546278+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:40:58.546278+0000","last_undegraded":"2024-04-17T15:40:58.546278+0000","last_fullsized":"2024-04-17T15:40:58.546278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:33:51.182856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"130'52","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.121523+0000","last_change":"2024-04-17T15:36:54.211508+0000","last_active":"2024-04-17T15:41:11.121523+0000","last_peered":"2024-04-17T15:41:11.121523+0000","last_clean":"2024-04-17T15:41:11.121523+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:41:11.121523+0000","last_undegraded":"2024-04-17T15:41:11.121523+0000","last_fullsized":"2024-04-17T15:41:11.121523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210023+0000","last_change":"2024-04-17T15:36:58.219957+0000","last_active":"2024-04-17T15:40:58.210023+0000","last_peered":"2024-04-17T15:40:58.210023+0000","last_clean":"2024-04-17T15:40:58.210023+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:40:58.210023+0000","last_undegraded":"2024-04-17T15:40:58.210023+0000","last_fullsized":"2024-04-17T15:40:58.210023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:34.413659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"130'20","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.920116+0000","last_change":"2024-04-17T15:37:00.262747+0000","last_active":"2024-04-17T15:41:10.920116+0000","last_peered":"2024-04-17T15:41:10.920116+0000","last_clean":"2024-04-17T15:41:10.920116+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:41:10.920116+0000","last_undegraded":"2024-04-17T15:41:10.920116+0000","last_fullsized":"2024-04-17T15:41:10.920116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513403+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:58.513403+0000","last_peered":"2024-04-17T15:40:58.513403+0000","last_clean":"2024-04-17T15:40:58.513403+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:58.513403+0000","last_undegraded":"2024-04-17T15:40:58.513403+0000","last_fullsized":"2024-04-17T15:40:58.513403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:59:56.180258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"112'52","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205103+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:58.205103+0000","last_peered":"2024-04-17T15:40:58.205103+0000","last_clean":"2024-04-17T15:40:58.205103+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:58.205103+0000","last_undegraded":"2024-04-17T15:40:58.205103+0000","last_fullsized":"2024-04-17T15:40:58.205103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.211084+0000","last_change":"2024-04-17T15:36:56.216288+0000","last_active":"2024-04-17T15:40:58.211084+0000","last_peered":"2024-04-17T15:40:58.211084+0000","last_clean":"2024-04-17T15:40:58.211084+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:40:58.211084+0000","last_undegraded":"2024-04-17T15:40:58.211084+0000","last_fullsized":"2024-04-17T15:40:58.211084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:13.604977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"130'36","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.200636+0000","last_change":"2024-04-17T15:36:54.203175+0000","last_active":"2024-04-17T15:41:11.200636+0000","last_peered":"2024-04-17T15:41:11.200636+0000","last_clean":"2024-04-17T15:41:11.200636+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:41:11.200636+0000","last_undegraded":"2024-04-17T15:41:11.200636+0000","last_fullsized":"2024-04-17T15:41:11.200636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546176+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:58.546176+0000","last_peered":"2024-04-17T15:40:58.546176+0000","last_clean":"2024-04-17T15:40:58.546176+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:58.546176+0000","last_undegraded":"2024-04-17T15:40:58.546176+0000","last_fullsized":"2024-04-17T15:40:58.546176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:02:15.900386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212572+0000","last_change":"2024-04-17T15:37:00.242389+0000","last_active":"2024-04-17T15:40:58.212572+0000","last_peered":"2024-04-17T15:40:58.212572+0000","last_clean":"2024-04-17T15:40:58.212572+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:40:58.212572+0000","last_undegraded":"2024-04-17T15:40:58.212572+0000","last_fullsized":"2024-04-17T15:40:58.212572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210012+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:58.210012+0000","last_peered":"2024-04-17T15:40:58.210012+0000","last_clean":"2024-04-17T15:40:58.210012+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:58.210012+0000","last_undegraded":"2024-04-17T15:40:58.210012+0000","last_fullsized":"2024-04-17T15:40:58.210012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869463+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:58.869463+0000","last_peered":"2024-04-17T15:40:58.869463+0000","last_clean":"2024-04-17T15:40:58.869463+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:58.869463+0000","last_undegraded":"2024-04-17T15:40:58.869463+0000","last_fullsized":"2024-04-17T15:40:58.869463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870448+0000","last_change":"2024-04-17T15:36:56.195152+0000","last_active":"2024-04-17T15:40:58.870448+0000","last_peered":"2024-04-17T15:40:58.870448+0000","last_clean":"2024-04-17T15:40:58.870448+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:40:58.870448+0000","last_undegraded":"2024-04-17T15:40:58.870448+0000","last_fullsized":"2024-04-17T15:40:58.870448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"130'64","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.199676+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:41:11.199676+0000","last_peered":"2024-04-17T15:41:11.199676+0000","last_clean":"2024-04-17T15:41:11.199676+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:41:11.199676+0000","last_undegraded":"2024-04-17T15:41:11.199676+0000","last_fullsized":"2024-04-17T15:41:11.199676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544211+0000","last_change":"2024-04-17T15:36:58.217462+0000","last_active":"2024-04-17T15:40:58.544211+0000","last_peered":"2024-04-17T15:40:58.544211+0000","last_clean":"2024-04-17T15:40:58.544211+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:40:58.544211+0000","last_undegraded":"2024-04-17T15:40:58.544211+0000","last_fullsized":"2024-04-17T15:40:58.544211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:04.703078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"73'11","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831634+0000","last_change":"2024-04-17T15:37:00.232075+0000","last_active":"2024-04-17T15:40:58.831634+0000","last_peered":"2024-04-17T15:40:58.831634+0000","last_clean":"2024-04-17T15:40:58.831634+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:40:58.831634+0000","last_undegraded":"2024-04-17T15:40:58.831634+0000","last_fullsized":"2024-04-17T15:40:58.831634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'138","reported_seq":401,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.070581+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:41:10.070581+0000","last_peered":"2024-04-17T15:41:10.070581+0000","last_clean":"2024-04-17T15:41:10.070581+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:41:10.070581+0000","last_undegraded":"2024-04-17T15:41:10.070581+0000","last_fullsized":"2024-04-17T15:41:10.070581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:45.365121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207240+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:58.207240+0000","last_peered":"2024-04-17T15:40:58.207240+0000","last_clean":"2024-04-17T15:40:58.207240+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:58.207240+0000","last_undegraded":"2024-04-17T15:40:58.207240+0000","last_fullsized":"2024-04-17T15:40:58.207240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546763+0000","last_change":"2024-04-17T15:36:56.195636+0000","last_active":"2024-04-17T15:40:58.546763+0000","last_peered":"2024-04-17T15:40:58.546763+0000","last_clean":"2024-04-17T15:40:58.546763+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:40:58.546763+0000","last_undegraded":"2024-04-17T15:40:58.546763+0000","last_fullsized":"2024-04-17T15:40:58.546763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:46.799137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"130'64","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.151285+0000","last_change":"2024-04-17T15:36:54.177227+0000","last_active":"2024-04-17T15:41:11.151285+0000","last_peered":"2024-04-17T15:41:11.151285+0000","last_clean":"2024-04-17T15:41:11.151285+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:41:11.151285+0000","last_undegraded":"2024-04-17T15:41:11.151285+0000","last_fullsized":"2024-04-17T15:41:11.151285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:00:49.391081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210404+0000","last_change":"2024-04-17T15:36:58.222754+0000","last_active":"2024-04-17T15:40:58.210404+0000","last_peered":"2024-04-17T15:40:58.210404+0000","last_clean":"2024-04-17T15:40:58.210404+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:40:58.210404+0000","last_undegraded":"2024-04-17T15:40:58.210404+0000","last_fullsized":"2024-04-17T15:40:58.210404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:02.361757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"130'20","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.606295+0000","last_change":"2024-04-17T15:37:00.458096+0000","last_active":"2024-04-17T15:41:10.606295+0000","last_peered":"2024-04-17T15:41:10.606295+0000","last_clean":"2024-04-17T15:41:10.606295+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:41:10.606295+0000","last_undegraded":"2024-04-17T15:41:10.606295+0000","last_fullsized":"2024-04-17T15:41:10.606295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'138","reported_seq":481,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.077550+0000","last_change":"2024-04-17T15:37:02.280068+0000","last_active":"2024-04-17T15:41:10.077550+0000","last_peered":"2024-04-17T15:41:10.077550+0000","last_clean":"2024-04-17T15:41:10.077550+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:41:10.077550+0000","last_undegraded":"2024-04-17T15:41:10.077550+0000","last_fullsized":"2024-04-17T15:41:10.077550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:09:40.074778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205692+0000","last_change":"2024-04-17T15:36:56.221468+0000","last_active":"2024-04-17T15:40:58.205692+0000","last_peered":"2024-04-17T15:40:58.205692+0000","last_clean":"2024-04-17T15:40:58.205692+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:40:58.205692+0000","last_undegraded":"2024-04-17T15:40:58.205692+0000","last_fullsized":"2024-04-17T15:40:58.205692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:38:19.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"130'46","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.145453+0000","last_change":"2024-04-17T15:36:54.212860+0000","last_active":"2024-04-17T15:41:11.145453+0000","last_peered":"2024-04-17T15:41:11.145453+0000","last_clean":"2024-04-17T15:41:11.145453+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:41:11.145453+0000","last_undegraded":"2024-04-17T15:41:11.145453+0000","last_fullsized":"2024-04-17T15:41:11.145453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:20:58.789621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511485+0000","last_change":"2024-04-17T15:36:58.238897+0000","last_active":"2024-04-17T15:40:58.511485+0000","last_peered":"2024-04-17T15:40:58.511485+0000","last_clean":"2024-04-17T15:40:58.511485+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:40:58.511485+0000","last_undegraded":"2024-04-17T15:40:58.511485+0000","last_fullsized":"2024-04-17T15:40:58.511485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:06:24.536327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"130'30","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.211550+0000","last_change":"2024-04-17T15:37:00.454227+0000","last_active":"2024-04-17T15:41:11.211550+0000","last_peered":"2024-04-17T15:41:11.211550+0000","last_clean":"2024-04-17T15:41:11.211550+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:41:11.211550+0000","last_undegraded":"2024-04-17T15:41:11.211550+0000","last_fullsized":"2024-04-17T15:41:11.211550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206321+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:40:58.206321+0000","last_peered":"2024-04-17T15:40:58.206321+0000","last_clean":"2024-04-17T15:40:58.206321+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:40:58.206321+0000","last_undegraded":"2024-04-17T15:40:58.206321+0000","last_fullsized":"2024-04-17T15:40:58.206321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206322+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:40:58.206322+0000","last_peered":"2024-04-17T15:40:58.206322+0000","last_clean":"2024-04-17T15:40:58.206322+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:40:58.206322+0000","last_undegraded":"2024-04-17T15:40:58.206322+0000","last_fullsized":"2024-04-17T15:40:58.206322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:47.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.202042+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:41:16.202042+0000","last_peered":"2024-04-17T15:41:16.202042+0000","last_clean":"2024-04-17T15:41:16.202042+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:41:16.202042+0000","last_undegraded":"2024-04-17T15:41:16.202042+0000","last_fullsized":"2024-04-17T15:41:16.202042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"130'22","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.178168+0000","last_change":"2024-04-17T15:36:54.212498+0000","last_active":"2024-04-17T15:41:11.178168+0000","last_peered":"2024-04-17T15:41:11.178168+0000","last_clean":"2024-04-17T15:41:11.178168+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:41:11.178168+0000","last_undegraded":"2024-04-17T15:41:11.178168+0000","last_fullsized":"2024-04-17T15:41:11.178168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.882724+0000","last_change":"2024-04-17T15:41:15.882775+0000","last_active":"2024-04-17T15:41:15.882724+0000","last_peered":"2024-04-17T15:41:15.882724+0000","last_clean":"2024-04-17T15:41:15.882724+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:41:15.882724+0000","last_undegraded":"2024-04-17T15:41:15.882724+0000","last_fullsized":"2024-04-17T15:41:15.882724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.882598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.882598+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.882598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:40:28.164354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"130'21","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.397518+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:41:10.397518+0000","last_peered":"2024-04-17T15:41:10.397518+0000","last_clean":"2024-04-17T15:41:10.397518+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:41:10.397518+0000","last_undegraded":"2024-04-17T15:41:10.397518+0000","last_fullsized":"2024-04-17T15:41:10.397518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:12:48.649812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544949+0000","last_change":"2024-04-17T15:37:02.285605+0000","last_active":"2024-04-17T15:40:58.544949+0000","last_peered":"2024-04-17T15:40:58.544949+0000","last_clean":"2024-04-17T15:40:58.544949+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:40:58.544949+0000","last_undegraded":"2024-04-17T15:40:58.544949+0000","last_fullsized":"2024-04-17T15:40:58.544949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:08:33.399754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553149+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:40:58.553149+0000","last_peered":"2024-04-17T15:40:58.553149+0000","last_clean":"2024-04-17T15:40:58.553149+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:40:58.553149+0000","last_undegraded":"2024-04-17T15:40:58.553149+0000","last_fullsized":"2024-04-17T15:40:58.553149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:55:40.474778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551741+0000","last_change":"2024-04-17T15:36:56.211246+0000","last_active":"2024-04-17T15:40:58.551741+0000","last_peered":"2024-04-17T15:40:58.551741+0000","last_clean":"2024-04-17T15:40:58.551741+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:40:58.551741+0000","last_undegraded":"2024-04-17T15:40:58.551741+0000","last_fullsized":"2024-04-17T15:40:58.551741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:42.108013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"130'40","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.191632+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:41:11.191632+0000","last_peered":"2024-04-17T15:41:11.191632+0000","last_clean":"2024-04-17T15:41:11.191632+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:41:11.191632+0000","last_undegraded":"2024-04-17T15:41:11.191632+0000","last_fullsized":"2024-04-17T15:41:11.191632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:31.056283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832593+0000","last_change":"2024-04-17T15:36:58.225802+0000","last_active":"2024-04-17T15:40:58.832593+0000","last_peered":"2024-04-17T15:40:58.832593+0000","last_clean":"2024-04-17T15:40:58.832593+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:40:58.832593+0000","last_undegraded":"2024-04-17T15:40:58.832593+0000","last_fullsized":"2024-04-17T15:40:58.832593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"130'29","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.357543+0000","last_change":"2024-04-17T15:37:00.254189+0000","last_active":"2024-04-17T15:41:10.357543+0000","last_peered":"2024-04-17T15:41:10.357543+0000","last_clean":"2024-04-17T15:41:10.357543+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:41:10.357543+0000","last_undegraded":"2024-04-17T15:41:10.357543+0000","last_fullsized":"2024-04-17T15:41:10.357543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:39:23.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":151,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"130'138","reported_seq":405,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.225032+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:41:11.225032+0000","last_peered":"2024-04-17T15:41:11.225032+0000","last_clean":"2024-04-17T15:41:11.225032+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:41:11.225032+0000","last_undegraded":"2024-04-17T15:41:11.225032+0000","last_fullsized":"2024-04-17T15:41:11.225032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870009+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:40:58.870009+0000","last_peered":"2024-04-17T15:40:58.870009+0000","last_clean":"2024-04-17T15:40:58.870009+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:40:58.870009+0000","last_undegraded":"2024-04-17T15:40:58.870009+0000","last_fullsized":"2024-04-17T15:40:58.870009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870748+0000","last_change":"2024-04-17T15:36:56.191825+0000","last_active":"2024-04-17T15:40:58.870748+0000","last_peered":"2024-04-17T15:40:58.870748+0000","last_clean":"2024-04-17T15:40:58.870748+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:40:58.870748+0000","last_undegraded":"2024-04-17T15:40:58.870748+0000","last_fullsized":"2024-04-17T15:40:58.870748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"130'44","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.042449+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:41:11.042449+0000","last_peered":"2024-04-17T15:41:11.042449+0000","last_clean":"2024-04-17T15:41:11.042449+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:41:11.042449+0000","last_undegraded":"2024-04-17T15:41:11.042449+0000","last_fullsized":"2024-04-17T15:41:11.042449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:40:35.131072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830550+0000","last_change":"2024-04-17T15:36:58.211769+0000","last_active":"2024-04-17T15:40:58.830550+0000","last_peered":"2024-04-17T15:40:58.830550+0000","last_clean":"2024-04-17T15:40:58.830550+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:40:58.830550+0000","last_undegraded":"2024-04-17T15:40:58.830550+0000","last_fullsized":"2024-04-17T15:40:58.830550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"130'36","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.415792+0000","last_change":"2024-04-17T15:37:00.261393+0000","last_active":"2024-04-17T15:41:10.415792+0000","last_peered":"2024-04-17T15:41:10.415792+0000","last_clean":"2024-04-17T15:41:10.415792+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:41:10.415792+0000","last_undegraded":"2024-04-17T15:41:10.415792+0000","last_fullsized":"2024-04-17T15:41:10.415792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830584+0000","last_change":"2024-04-17T15:37:02.269990+0000","last_active":"2024-04-17T15:40:58.830584+0000","last_peered":"2024-04-17T15:40:58.830584+0000","last_clean":"2024-04-17T15:40:58.830584+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:40:58.830584+0000","last_undegraded":"2024-04-17T15:40:58.830584+0000","last_fullsized":"2024-04-17T15:40:58.830584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":242,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208781+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:40:58.208781+0000","last_peered":"2024-04-17T15:40:58.208781+0000","last_clean":"2024-04-17T15:40:58.208781+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:40:58.208781+0000","last_undegraded":"2024-04-17T15:40:58.208781+0000","last_fullsized":"2024-04-17T15:40:58.208781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208888+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:40:58.208888+0000","last_peered":"2024-04-17T15:40:58.208888+0000","last_clean":"2024-04-17T15:40:58.208888+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:40:58.208888+0000","last_undegraded":"2024-04-17T15:40:58.208888+0000","last_fullsized":"2024-04-17T15:40:58.208888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"130'42","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.173016+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:41:11.173016+0000","last_peered":"2024-04-17T15:41:11.173016+0000","last_clean":"2024-04-17T15:41:11.173016+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:41:11.173016+0000","last_undegraded":"2024-04-17T15:41:11.173016+0000","last_fullsized":"2024-04-17T15:41:11.173016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:35:56.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832435+0000","last_change":"2024-04-17T15:36:58.237467+0000","last_active":"2024-04-17T15:40:58.832435+0000","last_peered":"2024-04-17T15:40:58.832435+0000","last_clean":"2024-04-17T15:40:58.832435+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:40:58.832435+0000","last_undegraded":"2024-04-17T15:40:58.832435+0000","last_fullsized":"2024-04-17T15:40:58.832435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"130'22","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.418522+0000","last_change":"2024-04-17T15:37:00.251412+0000","last_active":"2024-04-17T15:41:10.418522+0000","last_peered":"2024-04-17T15:41:10.418522+0000","last_clean":"2024-04-17T15:41:10.418522+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:41:10.418522+0000","last_undegraded":"2024-04-17T15:41:10.418522+0000","last_fullsized":"2024-04-17T15:41:10.418522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870198+0000","last_change":"2024-04-17T15:37:02.283484+0000","last_active":"2024-04-17T15:40:58.870198+0000","last_peered":"2024-04-17T15:40:58.870198+0000","last_clean":"2024-04-17T15:40:58.870198+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:40:58.870198+0000","last_undegraded":"2024-04-17T15:40:58.870198+0000","last_fullsized":"2024-04-17T15:40:58.870198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544417+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:40:58.544417+0000","last_peered":"2024-04-17T15:40:58.544417+0000","last_clean":"2024-04-17T15:40:58.544417+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:40:58.544417+0000","last_undegraded":"2024-04-17T15:40:58.544417+0000","last_fullsized":"2024-04-17T15:40:58.544417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:01:31.184958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209219+0000","last_change":"2024-04-17T15:36:56.203198+0000","last_active":"2024-04-17T15:40:58.209219+0000","last_peered":"2024-04-17T15:40:58.209219+0000","last_clean":"2024-04-17T15:40:58.209219+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:40:58.209219+0000","last_undegraded":"2024-04-17T15:40:58.209219+0000","last_fullsized":"2024-04-17T15:40:58.209219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"130'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.170798+0000","last_change":"2024-04-17T15:36:54.183731+0000","last_active":"2024-04-17T15:41:11.170798+0000","last_peered":"2024-04-17T15:41:11.170798+0000","last_clean":"2024-04-17T15:41:11.170798+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:41:11.170798+0000","last_undegraded":"2024-04-17T15:41:11.170798+0000","last_fullsized":"2024-04-17T15:41:11.170798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:01:17.539012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207093+0000","last_change":"2024-04-17T15:36:58.208838+0000","last_active":"2024-04-17T15:40:58.207093+0000","last_peered":"2024-04-17T15:40:58.207093+0000","last_clean":"2024-04-17T15:40:58.207093+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:40:58.207093+0000","last_undegraded":"2024-04-17T15:40:58.207093+0000","last_fullsized":"2024-04-17T15:40:58.207093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"130'26","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.387708+0000","last_change":"2024-04-17T15:37:00.255061+0000","last_active":"2024-04-17T15:41:10.387708+0000","last_peered":"2024-04-17T15:41:10.387708+0000","last_clean":"2024-04-17T15:41:10.387708+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:41:10.387708+0000","last_undegraded":"2024-04-17T15:41:10.387708+0000","last_fullsized":"2024-04-17T15:41:10.387708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"130'138","reported_seq":448,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.220383+0000","last_change":"2024-04-17T15:37:02.274174+0000","last_active":"2024-04-17T15:41:11.220383+0000","last_peered":"2024-04-17T15:41:11.220383+0000","last_clean":"2024-04-17T15:41:11.220383+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:41:11.220383+0000","last_undegraded":"2024-04-17T15:41:11.220383+0000","last_fullsized":"2024-04-17T15:41:11.220383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.755164+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:41:14.755164+0000","last_peered":"2024-04-17T15:41:14.755164+0000","last_clean":"2024-04-17T15:41:14.755164+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:41:14.755164+0000","last_undegraded":"2024-04-17T15:41:14.755164+0000","last_fullsized":"2024-04-17T15:41:14.755164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212706+0000","last_change":"2024-04-17T15:36:56.201644+0000","last_active":"2024-04-17T15:40:58.212706+0000","last_peered":"2024-04-17T15:40:58.212706+0000","last_clean":"2024-04-17T15:40:58.212706+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:40:58.212706+0000","last_undegraded":"2024-04-17T15:40:58.212706+0000","last_fullsized":"2024-04-17T15:40:58.212706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"130'48","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.201760+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:41:16.201760+0000","last_peered":"2024-04-17T15:41:16.201760+0000","last_clean":"2024-04-17T15:41:16.201760+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:41:16.201760+0000","last_undegraded":"2024-04-17T15:41:16.201760+0000","last_fullsized":"2024-04-17T15:41:16.201760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'2","reported_seq":408,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.038172+0000","last_change":"2024-04-17T15:36:58.226867+0000","last_active":"2024-04-17T15:41:10.038172+0000","last_peered":"2024-04-17T15:41:10.038172+0000","last_clean":"2024-04-17T15:41:10.038172+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:41:10.038172+0000","last_undegraded":"2024-04-17T15:41:10.038172+0000","last_fullsized":"2024-04-17T15:41:10.038172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:41.935220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545986+0000","last_change":"2024-04-17T15:37:00.453305+0000","last_active":"2024-04-17T15:40:58.545986+0000","last_peered":"2024-04-17T15:40:58.545986+0000","last_clean":"2024-04-17T15:40:58.545986+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:40:58.545986+0000","last_undegraded":"2024-04-17T15:40:58.545986+0000","last_fullsized":"2024-04-17T15:40:58.545986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:12:55.781012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"130'138","reported_seq":454,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.074420+0000","last_change":"2024-04-17T15:37:02.268962+0000","last_active":"2024-04-17T15:41:10.074420+0000","last_peered":"2024-04-17T15:41:10.074420+0000","last_clean":"2024-04-17T15:41:10.074420+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:41:10.074420+0000","last_undegraded":"2024-04-17T15:41:10.074420+0000","last_fullsized":"2024-04-17T15:41:10.074420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:34:32.300335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.203168+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:41:16.203168+0000","last_peered":"2024-04-17T15:41:16.203168+0000","last_clean":"2024-04-17T15:41:16.203168+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:41:16.203168+0000","last_undegraded":"2024-04-17T15:41:16.203168+0000","last_fullsized":"2024-04-17T15:41:16.203168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.208995+0000","last_change":"2024-04-17T15:36:56.179882+0000","last_active":"2024-04-17T15:40:58.208995+0000","last_peered":"2024-04-17T15:40:58.208995+0000","last_clean":"2024-04-17T15:40:58.208995+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:40:58.208995+0000","last_undegraded":"2024-04-17T15:40:58.208995+0000","last_fullsized":"2024-04-17T15:40:58.208995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"130'58","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.192693+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:41:11.192693+0000","last_peered":"2024-04-17T15:41:11.192693+0000","last_clean":"2024-04-17T15:41:11.192693+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:41:11.192693+0000","last_undegraded":"2024-04-17T15:41:11.192693+0000","last_fullsized":"2024-04-17T15:41:11.192693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:21:50.065289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212387+0000","last_change":"2024-04-17T15:36:58.222921+0000","last_active":"2024-04-17T15:40:58.212387+0000","last_peered":"2024-04-17T15:40:58.212387+0000","last_clean":"2024-04-17T15:40:58.212387+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:40:58.212387+0000","last_undegraded":"2024-04-17T15:40:58.212387+0000","last_fullsized":"2024-04-17T15:40:58.212387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"130'28","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.921836+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:41:10.921836+0000","last_peered":"2024-04-17T15:41:10.921836+0000","last_clean":"2024-04-17T15:41:10.921836+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:41:10.921836+0000","last_undegraded":"2024-04-17T15:41:10.921836+0000","last_fullsized":"2024-04-17T15:41:10.921836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551513+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:40:58.551513+0000","last_peered":"2024-04-17T15:40:58.551513+0000","last_clean":"2024-04-17T15:40:58.551513+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:40:58.551513+0000","last_undegraded":"2024-04-17T15:40:58.551513+0000","last_fullsized":"2024-04-17T15:40:58.551513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:25:19.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.755325+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:41:14.755325+0000","last_peered":"2024-04-17T15:41:14.755325+0000","last_clean":"2024-04-17T15:41:14.755325+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:41:14.755325+0000","last_undegraded":"2024-04-17T15:41:14.755325+0000","last_fullsized":"2024-04-17T15:41:14.755325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.552674+0000","last_change":"2024-04-17T15:36:56.212082+0000","last_active":"2024-04-17T15:40:58.552674+0000","last_peered":"2024-04-17T15:40:58.552674+0000","last_clean":"2024-04-17T15:40:58.552674+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:40:58.552674+0000","last_undegraded":"2024-04-17T15:40:58.552674+0000","last_fullsized":"2024-04-17T15:40:58.552674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:19:33.078022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":387,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512174+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:58.512174+0000","last_peered":"2024-04-17T15:40:58.512174+0000","last_clean":"2024-04-17T15:40:58.512174+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:58.512174+0000","last_undegraded":"2024-04-17T15:40:58.512174+0000","last_fullsized":"2024-04-17T15:40:58.512174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:21:59.353548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206221+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:40:58.206221+0000","last_peered":"2024-04-17T15:40:58.206221+0000","last_clean":"2024-04-17T15:40:58.206221+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:40:58.206221+0000","last_undegraded":"2024-04-17T15:40:58.206221+0000","last_fullsized":"2024-04-17T15:40:58.206221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:28.273455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"130'40","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.998738+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:41:10.998738+0000","last_peered":"2024-04-17T15:41:10.998738+0000","last_clean":"2024-04-17T15:41:10.998738+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:41:10.998738+0000","last_undegraded":"2024-04-17T15:41:10.998738+0000","last_fullsized":"2024-04-17T15:41:10.998738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:29:38.203373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512565+0000","last_change":"2024-04-17T15:36:58.239326+0000","last_active":"2024-04-17T15:40:58.512565+0000","last_peered":"2024-04-17T15:40:58.512565+0000","last_clean":"2024-04-17T15:40:58.512565+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:40:58.512565+0000","last_undegraded":"2024-04-17T15:40:58.512565+0000","last_fullsized":"2024-04-17T15:40:58.512565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:59.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"130'46","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.208128+0000","last_change":"2024-04-17T15:37:00.260017+0000","last_active":"2024-04-17T15:41:11.208128+0000","last_peered":"2024-04-17T15:41:11.208128+0000","last_clean":"2024-04-17T15:41:11.208128+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:41:11.208128+0000","last_undegraded":"2024-04-17T15:41:11.208128+0000","last_fullsized":"2024-04-17T15:41:11.208128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:57:24.631096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870069+0000","last_change":"2024-04-17T15:37:02.267100+0000","last_active":"2024-04-17T15:40:58.870069+0000","last_peered":"2024-04-17T15:40:58.870069+0000","last_clean":"2024-04-17T15:40:58.870069+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:40:58.870069+0000","last_undegraded":"2024-04-17T15:40:58.870069+0000","last_fullsized":"2024-04-17T15:40:58.870069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550525+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:40:58.550525+0000","last_peered":"2024-04-17T15:40:58.550525+0000","last_clean":"2024-04-17T15:40:58.550525+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:40:58.550525+0000","last_undegraded":"2024-04-17T15:40:58.550525+0000","last_fullsized":"2024-04-17T15:40:58.550525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:08.422877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.289636+0000","last_change":"2024-04-17T15:36:56.195171+0000","last_active":"2024-04-17T15:41:14.289636+0000","last_peered":"2024-04-17T15:41:14.289636+0000","last_clean":"2024-04-17T15:41:14.289636+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:41:14.289636+0000","last_undegraded":"2024-04-17T15:41:14.289636+0000","last_fullsized":"2024-04-17T15:41:14.289636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511901+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:58.511901+0000","last_peered":"2024-04-17T15:40:58.511901+0000","last_clean":"2024-04-17T15:40:58.511901+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:58.511901+0000","last_undegraded":"2024-04-17T15:40:58.511901+0000","last_fullsized":"2024-04-17T15:40:58.511901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:49.093275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"130'56","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.162753+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:41:11.162753+0000","last_peered":"2024-04-17T15:41:11.162753+0000","last_clean":"2024-04-17T15:41:11.162753+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:41:11.162753+0000","last_undegraded":"2024-04-17T15:41:11.162753+0000","last_fullsized":"2024-04-17T15:41:11.162753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":316,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.025542+0000","last_change":"2024-04-17T15:36:58.220033+0000","last_active":"2024-04-17T15:41:10.025542+0000","last_peered":"2024-04-17T15:41:10.025542+0000","last_clean":"2024-04-17T15:41:10.025542+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:41:10.025542+0000","last_undegraded":"2024-04-17T15:41:10.025542+0000","last_fullsized":"2024-04-17T15:41:10.025542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:11.525013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"130'150","reported_seq":497,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.295962+0000","last_change":"2024-04-17T15:37:00.246728+0000","last_active":"2024-04-17T15:41:11.295962+0000","last_peered":"2024-04-17T15:41:11.295962+0000","last_clean":"2024-04-17T15:41:11.295962+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:41:11.295962+0000","last_undegraded":"2024-04-17T15:41:11.295962+0000","last_fullsized":"2024-04-17T15:41:11.295962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513196+0000","last_change":"2024-04-17T15:37:02.268179+0000","last_active":"2024-04-17T15:40:58.513196+0000","last_peered":"2024-04-17T15:40:58.513196+0000","last_clean":"2024-04-17T15:40:58.513196+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:40:58.513196+0000","last_undegraded":"2024-04-17T15:40:58.513196+0000","last_fullsized":"2024-04-17T15:40:58.513196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:13.495626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205515+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:40:58.205515+0000","last_peered":"2024-04-17T15:40:58.205515+0000","last_clean":"2024-04-17T15:40:58.205515+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:40:58.205515+0000","last_undegraded":"2024-04-17T15:40:58.205515+0000","last_fullsized":"2024-04-17T15:40:58.205515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.371151+0000","last_change":"2024-04-17T15:41:15.371151+0000","last_active":"2024-04-17T15:41:15.371151+0000","last_peered":"2024-04-17T15:41:15.371151+0000","last_clean":"2024-04-17T15:41:15.371151+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:41:15.371151+0000","last_undegraded":"2024-04-17T15:41:15.371151+0000","last_fullsized":"2024-04-17T15:41:15.371151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.371032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.371032+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.371032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:03.976479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.831443+0000","last_change":"2024-04-17T15:36:48.327933+0000","last_active":"2024-04-17T15:40:58.831443+0000","last_peered":"2024-04-17T15:40:58.831443+0000","last_clean":"2024-04-17T15:40:58.831443+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:40:58.831443+0000","last_undegraded":"2024-04-17T15:40:58.831443+0000","last_fullsized":"2024-04-17T15:40:58.831443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"130'44","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.202869+0000","last_change":"2024-04-17T15:36:54.169419+0000","last_active":"2024-04-17T15:41:11.202869+0000","last_peered":"2024-04-17T15:41:11.202869+0000","last_clean":"2024-04-17T15:41:11.202869+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:41:11.202869+0000","last_undegraded":"2024-04-17T15:41:11.202869+0000","last_fullsized":"2024-04-17T15:41:11.202869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830687+0000","last_change":"2024-04-17T15:36:58.214478+0000","last_active":"2024-04-17T15:40:58.830687+0000","last_peered":"2024-04-17T15:40:58.830687+0000","last_clean":"2024-04-17T15:40:58.830687+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:40:58.830687+0000","last_undegraded":"2024-04-17T15:40:58.830687+0000","last_fullsized":"2024-04-17T15:40:58.830687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'17","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:03.692836+0000","last_change":"2024-04-17T15:37:00.457657+0000","last_active":"2024-04-17T15:41:03.692836+0000","last_peered":"2024-04-17T15:41:03.692836+0000","last_clean":"2024-04-17T15:41:03.692836+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:41:03.692836+0000","last_undegraded":"2024-04-17T15:41:03.692836+0000","last_fullsized":"2024-04-17T15:41:03.692836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:16:48.130263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.317500+0000","last_change":"2024-04-17T15:37:02.280505+0000","last_active":"2024-04-17T15:41:11.317500+0000","last_peered":"2024-04-17T15:41:11.317500+0000","last_clean":"2024-04-17T15:41:11.317500+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:41:11.317500+0000","last_undegraded":"2024-04-17T15:41:11.317500+0000","last_fullsized":"2024-04-17T15:41:11.317500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545821+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:40:58.545821+0000","last_peered":"2024-04-17T15:40:58.545821+0000","last_clean":"2024-04-17T15:40:58.545821+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:40:58.545821+0000","last_undegraded":"2024-04-17T15:40:58.545821+0000","last_fullsized":"2024-04-17T15:40:58.545821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:20:45.851169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.295247+0000","last_change":"2024-04-17T15:36:56.186783+0000","last_active":"2024-04-17T15:41:06.295247+0000","last_peered":"2024-04-17T15:41:06.295247+0000","last_clean":"2024-04-17T15:41:06.295247+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:41:06.295247+0000","last_undegraded":"2024-04-17T15:41:06.295247+0000","last_fullsized":"2024-04-17T15:41:06.295247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207531+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:58.207531+0000","last_peered":"2024-04-17T15:40:58.207531+0000","last_clean":"2024-04-17T15:40:58.207531+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:58.207531+0000","last_undegraded":"2024-04-17T15:40:58.207531+0000","last_fullsized":"2024-04-17T15:40:58.207531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:08:35.501828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"130'48","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.199611+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:41:11.199611+0000","last_peered":"2024-04-17T15:41:11.199611+0000","last_clean":"2024-04-17T15:41:11.199611+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:41:11.199611+0000","last_undegraded":"2024-04-17T15:41:11.199611+0000","last_fullsized":"2024-04-17T15:41:11.199611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.317524+0000","last_change":"2024-04-17T15:36:58.221346+0000","last_active":"2024-04-17T15:41:11.317524+0000","last_peered":"2024-04-17T15:41:11.317524+0000","last_clean":"2024-04-17T15:41:11.317524+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:41:11.317524+0000","last_undegraded":"2024-04-17T15:41:11.317524+0000","last_fullsized":"2024-04-17T15:41:11.317524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.547104+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:40:58.547104+0000","last_peered":"2024-04-17T15:40:58.547104+0000","last_clean":"2024-04-17T15:40:58.547104+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:40:58.547104+0000","last_undegraded":"2024-04-17T15:40:58.547104+0000","last_fullsized":"2024-04-17T15:40:58.547104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:05:09.084798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553452+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:40:58.553452+0000","last_peered":"2024-04-17T15:40:58.553452+0000","last_clean":"2024-04-17T15:40:58.553452+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:40:58.553452+0000","last_undegraded":"2024-04-17T15:40:58.553452+0000","last_fullsized":"2024-04-17T15:40:58.553452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:18.015959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.204708+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:40:58.204708+0000","last_peered":"2024-04-17T15:40:58.204708+0000","last_clean":"2024-04-17T15:40:58.204708+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:40:58.204708+0000","last_undegraded":"2024-04-17T15:40:58.204708+0000","last_fullsized":"2024-04-17T15:40:58.204708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":267,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.295189+0000","last_change":"2024-04-17T15:36:56.195443+0000","last_active":"2024-04-17T15:41:06.295189+0000","last_peered":"2024-04-17T15:41:06.295189+0000","last_clean":"2024-04-17T15:41:06.295189+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:41:06.295189+0000","last_undegraded":"2024-04-17T15:41:06.295189+0000","last_fullsized":"2024-04-17T15:41:06.295189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"130'44","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.142233+0000","last_change":"2024-04-17T15:36:54.181088+0000","last_active":"2024-04-17T15:41:11.142233+0000","last_peered":"2024-04-17T15:41:11.142233+0000","last_clean":"2024-04-17T15:41:11.142233+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:41:11.142233+0000","last_undegraded":"2024-04-17T15:41:11.142233+0000","last_fullsized":"2024-04-17T15:41:11.142233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:01.294343+0000","last_change":"2024-04-17T15:36:48.280780+0000","last_active":"2024-04-17T15:41:01.294343+0000","last_peered":"2024-04-17T15:41:01.294343+0000","last_clean":"2024-04-17T15:41:01.294343+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:41:01.294343+0000","last_undegraded":"2024-04-17T15:41:01.294343+0000","last_fullsized":"2024-04-17T15:41:01.294343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.317459+0000","last_change":"2024-04-17T15:36:58.225117+0000","last_active":"2024-04-17T15:41:11.317459+0000","last_peered":"2024-04-17T15:41:11.317459+0000","last_clean":"2024-04-17T15:41:11.317459+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:41:11.317459+0000","last_undegraded":"2024-04-17T15:41:11.317459+0000","last_fullsized":"2024-04-17T15:41:11.317459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'40","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.614439+0000","last_change":"2024-04-17T15:37:00.262238+0000","last_active":"2024-04-17T15:41:10.614439+0000","last_peered":"2024-04-17T15:41:10.614439+0000","last_clean":"2024-04-17T15:41:10.614439+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:41:10.614439+0000","last_undegraded":"2024-04-17T15:41:10.614439+0000","last_fullsized":"2024-04-17T15:41:10.614439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.315360+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:41:11.315360+0000","last_peered":"2024-04-17T15:41:11.315360+0000","last_clean":"2024-04-17T15:41:11.315360+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:41:11.315360+0000","last_undegraded":"2024-04-17T15:41:11.315360+0000","last_fullsized":"2024-04-17T15:41:11.315360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869830+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:40:58.869830+0000","last_peered":"2024-04-17T15:40:58.869830+0000","last_clean":"2024-04-17T15:40:58.869830+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:40:58.869830+0000","last_undegraded":"2024-04-17T15:40:58.869830+0000","last_fullsized":"2024-04-17T15:40:58.869830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.316563+0000","last_change":"2024-04-17T15:36:56.205521+0000","last_active":"2024-04-17T15:41:06.316563+0000","last_peered":"2024-04-17T15:41:06.316563+0000","last_clean":"2024-04-17T15:41:06.316563+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:41:06.316563+0000","last_undegraded":"2024-04-17T15:41:06.316563+0000","last_fullsized":"2024-04-17T15:41:06.316563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"130'42","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.192048+0000","last_change":"2024-04-17T15:36:54.170902+0000","last_active":"2024-04-17T15:41:11.192048+0000","last_peered":"2024-04-17T15:41:11.192048+0000","last_clean":"2024-04-17T15:41:11.192048+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:41:11.192048+0000","last_undegraded":"2024-04-17T15:41:11.192048+0000","last_fullsized":"2024-04-17T15:41:11.192048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514348+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:40:58.514348+0000","last_peered":"2024-04-17T15:40:58.514348+0000","last_clean":"2024-04-17T15:40:58.514348+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:40:58.514348+0000","last_undegraded":"2024-04-17T15:40:58.514348+0000","last_fullsized":"2024-04-17T15:40:58.514348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:11:16.722493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551430+0000","last_change":"2024-04-17T15:36:58.229531+0000","last_active":"2024-04-17T15:40:58.551430+0000","last_peered":"2024-04-17T15:40:58.551430+0000","last_clean":"2024-04-17T15:40:58.551430+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:40:58.551430+0000","last_undegraded":"2024-04-17T15:40:58.551430+0000","last_fullsized":"2024-04-17T15:40:58.551430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:21:02.839632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.295908+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:41:11.295908+0000","last_peered":"2024-04-17T15:41:11.295908+0000","last_clean":"2024-04-17T15:41:11.295908+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:41:11.295908+0000","last_undegraded":"2024-04-17T15:41:11.295908+0000","last_fullsized":"2024-04-17T15:41:11.295908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"130'138","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.068182+0000","last_change":"2024-04-17T15:37:02.264651+0000","last_active":"2024-04-17T15:41:10.068182+0000","last_peered":"2024-04-17T15:41:10.068182+0000","last_clean":"2024-04-17T15:41:10.068182+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:41:10.068182+0000","last_undegraded":"2024-04-17T15:41:10.068182+0000","last_fullsized":"2024-04-17T15:41:10.068182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:05.240914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546955+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:40:58.546955+0000","last_peered":"2024-04-17T15:40:58.546955+0000","last_clean":"2024-04-17T15:40:58.546955+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:40:58.546955+0000","last_undegraded":"2024-04-17T15:40:58.546955+0000","last_fullsized":"2024-04-17T15:40:58.546955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:01.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544700+0000","last_change":"2024-04-17T15:36:56.189525+0000","last_active":"2024-04-17T15:40:58.544700+0000","last_peered":"2024-04-17T15:40:58.544700+0000","last_clean":"2024-04-17T15:40:58.544700+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:40:58.544700+0000","last_undegraded":"2024-04-17T15:40:58.544700+0000","last_fullsized":"2024-04-17T15:40:58.544700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:29:15.584612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"130'38","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.110189+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:41:11.110189+0000","last_peered":"2024-04-17T15:41:11.110189+0000","last_clean":"2024-04-17T15:41:11.110189+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:41:11.110189+0000","last_undegraded":"2024-04-17T15:41:11.110189+0000","last_fullsized":"2024-04-17T15:41:11.110189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:32:42.152580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.295422+0000","last_change":"2024-04-17T15:36:48.074061+0000","last_active":"2024-04-17T15:41:06.295422+0000","last_peered":"2024-04-17T15:41:06.295422+0000","last_clean":"2024-04-17T15:41:06.295422+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:41:06.295422+0000","last_undegraded":"2024-04-17T15:41:06.295422+0000","last_fullsized":"2024-04-17T15:41:06.295422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.315394+0000","last_change":"2024-04-17T15:36:58.222851+0000","last_active":"2024-04-17T15:41:11.315394+0000","last_peered":"2024-04-17T15:41:11.315394+0000","last_clean":"2024-04-17T15:41:11.315394+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:41:11.315394+0000","last_undegraded":"2024-04-17T15:41:11.315394+0000","last_fullsized":"2024-04-17T15:41:11.315394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.315437+0000","last_change":"2024-04-17T15:37:00.249383+0000","last_active":"2024-04-17T15:41:11.315437+0000","last_peered":"2024-04-17T15:41:11.315437+0000","last_clean":"2024-04-17T15:41:11.315437+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:41:11.315437+0000","last_undegraded":"2024-04-17T15:41:11.315437+0000","last_fullsized":"2024-04-17T15:41:11.315437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'138","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.222763+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:41:11.222763+0000","last_peered":"2024-04-17T15:41:11.222763+0000","last_clean":"2024-04-17T15:41:11.222763+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:41:11.222763+0000","last_undegraded":"2024-04-17T15:41:11.222763+0000","last_fullsized":"2024-04-17T15:41:11.222763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:10:26.093798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869664+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:40:58.869664+0000","last_peered":"2024-04-17T15:40:58.869664+0000","last_clean":"2024-04-17T15:40:58.869664+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:40:58.869664+0000","last_undegraded":"2024-04-17T15:40:58.869664+0000","last_fullsized":"2024-04-17T15:40:58.869664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.314433+0000","last_change":"2024-04-17T15:36:56.208090+0000","last_active":"2024-04-17T15:41:06.314433+0000","last_peered":"2024-04-17T15:41:06.314433+0000","last_clean":"2024-04-17T15:41:06.314433+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:41:06.314433+0000","last_undegraded":"2024-04-17T15:41:06.314433+0000","last_fullsized":"2024-04-17T15:41:06.314433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"130'56","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.289080+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:41:14.289080+0000","last_peered":"2024-04-17T15:41:14.289080+0000","last_clean":"2024-04-17T15:41:14.289080+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:41:14.289080+0000","last_undegraded":"2024-04-17T15:41:14.289080+0000","last_fullsized":"2024-04-17T15:41:14.289080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553901+0000","last_change":"2024-04-17T15:36:48.077856+0000","last_active":"2024-04-17T15:40:58.553901+0000","last_peered":"2024-04-17T15:40:58.553901+0000","last_clean":"2024-04-17T15:40:58.553901+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:40:58.553901+0000","last_undegraded":"2024-04-17T15:40:58.553901+0000","last_fullsized":"2024-04-17T15:40:58.553901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:32.058077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544172+0000","last_change":"2024-04-17T15:36:58.219182+0000","last_active":"2024-04-17T15:40:58.544172+0000","last_peered":"2024-04-17T15:40:58.544172+0000","last_clean":"2024-04-17T15:40:58.544172+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:40:58.544172+0000","last_undegraded":"2024-04-17T15:40:58.544172+0000","last_fullsized":"2024-04-17T15:40:58.544172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:12.145521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"130'57","reported_seq":305,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.916134+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:41:10.916134+0000","last_peered":"2024-04-17T15:41:10.916134+0000","last_clean":"2024-04-17T15:41:10.916134+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:41:10.916134+0000","last_undegraded":"2024-04-17T15:41:10.916134+0000","last_fullsized":"2024-04-17T15:41:10.916134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:34.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":410,"num_write":38,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545167+0000","last_change":"2024-04-17T15:37:02.278714+0000","last_active":"2024-04-17T15:40:58.545167+0000","last_peered":"2024-04-17T15:40:58.545167+0000","last_clean":"2024-04-17T15:40:58.545167+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:40:58.545167+0000","last_undegraded":"2024-04-17T15:40:58.545167+0000","last_fullsized":"2024-04-17T15:40:58.545167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:41:24.524752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205831+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:40:58.205831+0000","last_peered":"2024-04-17T15:40:58.205831+0000","last_clean":"2024-04-17T15:40:58.205831+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:40:58.205831+0000","last_undegraded":"2024-04-17T15:40:58.205831+0000","last_fullsized":"2024-04-17T15:40:58.205831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:19:34.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.290287+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:41:14.290287+0000","last_peered":"2024-04-17T15:41:14.290287+0000","last_clean":"2024-04-17T15:41:14.290287+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:41:14.290287+0000","last_undegraded":"2024-04-17T15:41:14.290287+0000","last_fullsized":"2024-04-17T15:41:14.290287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207846+0000","last_change":"2024-04-17T15:36:56.199664+0000","last_active":"2024-04-17T15:40:58.207846+0000","last_peered":"2024-04-17T15:40:58.207846+0000","last_clean":"2024-04-17T15:40:58.207846+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:40:58.207846+0000","last_undegraded":"2024-04-17T15:40:58.207846+0000","last_fullsized":"2024-04-17T15:40:58.207846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"130'54","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.201669+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:41:11.201669+0000","last_peered":"2024-04-17T15:41:11.201669+0000","last_clean":"2024-04-17T15:41:11.201669+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:41:11.201669+0000","last_undegraded":"2024-04-17T15:41:11.201669+0000","last_fullsized":"2024-04-17T15:41:11.201669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206100+0000","last_change":"2024-04-17T15:36:58.218584+0000","last_active":"2024-04-17T15:40:58.206100+0000","last_peered":"2024-04-17T15:40:58.206100+0000","last_clean":"2024-04-17T15:40:58.206100+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:40:58.206100+0000","last_undegraded":"2024-04-17T15:40:58.206100+0000","last_fullsized":"2024-04-17T15:40:58.206100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"130'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.162146+0000","last_change":"2024-04-17T15:37:00.262792+0000","last_active":"2024-04-17T15:41:10.162146+0000","last_peered":"2024-04-17T15:41:10.162146+0000","last_clean":"2024-04-17T15:41:10.162146+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:41:10.162146+0000","last_undegraded":"2024-04-17T15:41:10.162146+0000","last_fullsized":"2024-04-17T15:41:10.162146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:45:56.925933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544482+0000","last_change":"2024-04-17T15:37:02.279049+0000","last_active":"2024-04-17T15:40:58.544482+0000","last_peered":"2024-04-17T15:40:58.544482+0000","last_clean":"2024-04-17T15:40:58.544482+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:40:58.544482+0000","last_undegraded":"2024-04-17T15:40:58.544482+0000","last_fullsized":"2024-04-17T15:40:58.544482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:41.393734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546660+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:40:58.546660+0000","last_peered":"2024-04-17T15:40:58.546660+0000","last_clean":"2024-04-17T15:40:58.546660+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:40:58.546660+0000","last_undegraded":"2024-04-17T15:40:58.546660+0000","last_fullsized":"2024-04-17T15:40:58.546660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:59:06.801793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":195,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205059+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:58.205059+0000","last_peered":"2024-04-17T15:40:58.205059+0000","last_clean":"2024-04-17T15:40:58.205059+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:58.205059+0000","last_undegraded":"2024-04-17T15:40:58.205059+0000","last_fullsized":"2024-04-17T15:40:58.205059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:09.248993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"130'48","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.142493+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:41:11.142493+0000","last_peered":"2024-04-17T15:41:11.142493+0000","last_clean":"2024-04-17T15:41:11.142493+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:41:11.142493+0000","last_undegraded":"2024-04-17T15:41:11.142493+0000","last_fullsized":"2024-04-17T15:41:11.142493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:09:01.819712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"23'1","reported_seq":316,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.025470+0000","last_change":"2024-04-17T15:36:58.226298+0000","last_active":"2024-04-17T15:41:10.025470+0000","last_peered":"2024-04-17T15:41:10.025470+0000","last_clean":"2024-04-17T15:41:10.025470+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:41:10.025470+0000","last_undegraded":"2024-04-17T15:41:10.025470+0000","last_fullsized":"2024-04-17T15:41:10.025470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:34:38.896655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'9","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869076+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:58.869076+0000","last_peered":"2024-04-17T15:40:58.869076+0000","last_clean":"2024-04-17T15:40:58.869076+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:58.869076+0000","last_undegraded":"2024-04-17T15:40:58.869076+0000","last_fullsized":"2024-04-17T15:40:58.869076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511688+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:58.511688+0000","last_peered":"2024-04-17T15:40:58.511688+0000","last_clean":"2024-04-17T15:40:58.511688+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:58.511688+0000","last_undegraded":"2024-04-17T15:40:58.511688+0000","last_fullsized":"2024-04-17T15:40:58.511688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:54:55.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870546+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:58.870546+0000","last_peered":"2024-04-17T15:40:58.870546+0000","last_clean":"2024-04-17T15:40:58.870546+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:58.870546+0000","last_undegraded":"2024-04-17T15:40:58.870546+0000","last_fullsized":"2024-04-17T15:40:58.870546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544795+0000","last_change":"2024-04-17T15:36:56.199000+0000","last_active":"2024-04-17T15:40:58.544795+0000","last_peered":"2024-04-17T15:40:58.544795+0000","last_clean":"2024-04-17T15:40:58.544795+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:40:58.544795+0000","last_undegraded":"2024-04-17T15:40:58.544795+0000","last_fullsized":"2024-04-17T15:40:58.544795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:01:28.435954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"130'62","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.168285+0000","last_change":"2024-04-17T15:37:41.354554+0000","last_active":"2024-04-17T15:41:11.168285+0000","last_peered":"2024-04-17T15:41:11.168285+0000","last_clean":"2024-04-17T15:41:11.168285+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:41:11.168285+0000","last_undegraded":"2024-04-17T15:41:11.168285+0000","last_fullsized":"2024-04-17T15:41:11.168285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510907+0000","last_change":"2024-04-17T15:36:58.237224+0000","last_active":"2024-04-17T15:40:58.510907+0000","last_peered":"2024-04-17T15:40:58.510907+0000","last_clean":"2024-04-17T15:40:58.510907+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:40:58.510907+0000","last_undegraded":"2024-04-17T15:40:58.510907+0000","last_fullsized":"2024-04-17T15:40:58.510907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:17:13.961630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"130'22","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.603297+0000","last_change":"2024-04-17T15:37:00.263471+0000","last_active":"2024-04-17T15:41:10.603297+0000","last_peered":"2024-04-17T15:41:10.603297+0000","last_clean":"2024-04-17T15:41:10.603297+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:41:10.603297+0000","last_undegraded":"2024-04-17T15:41:10.603297+0000","last_fullsized":"2024-04-17T15:41:10.603297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:14:26.692560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551183+0000","last_change":"2024-04-17T15:37:02.269611+0000","last_active":"2024-04-17T15:40:58.551183+0000","last_peered":"2024-04-17T15:40:58.551183+0000","last_clean":"2024-04-17T15:40:58.551183+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:40:58.551183+0000","last_undegraded":"2024-04-17T15:40:58.551183+0000","last_fullsized":"2024-04-17T15:40:58.551183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:21:21.462377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205899+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:58.205899+0000","last_peered":"2024-04-17T15:40:58.205899+0000","last_clean":"2024-04-17T15:40:58.205899+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:58.205899+0000","last_undegraded":"2024-04-17T15:40:58.205899+0000","last_fullsized":"2024-04-17T15:40:58.205899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:11:16.843736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544812+0000","last_change":"2024-04-17T15:36:56.179392+0000","last_active":"2024-04-17T15:40:58.544812+0000","last_peered":"2024-04-17T15:40:58.544812+0000","last_clean":"2024-04-17T15:40:58.544812+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:40:58.544812+0000","last_undegraded":"2024-04-17T15:40:58.544812+0000","last_fullsized":"2024-04-17T15:40:58.544812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:57.600751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"130'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.172358+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:41:11.172358+0000","last_peered":"2024-04-17T15:41:11.172358+0000","last_clean":"2024-04-17T15:41:11.172358+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:41:11.172358+0000","last_undegraded":"2024-04-17T15:41:11.172358+0000","last_fullsized":"2024-04-17T15:41:11.172358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550102+0000","last_change":"2024-04-17T15:36:58.218933+0000","last_active":"2024-04-17T15:40:58.550102+0000","last_peered":"2024-04-17T15:40:58.550102+0000","last_clean":"2024-04-17T15:40:58.550102+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:40:58.550102+0000","last_undegraded":"2024-04-17T15:40:58.550102+0000","last_fullsized":"2024-04-17T15:40:58.550102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:47.313893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"130'21","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.427101+0000","last_change":"2024-04-17T15:37:00.255487+0000","last_active":"2024-04-17T15:41:10.427101+0000","last_peered":"2024-04-17T15:41:10.427101+0000","last_clean":"2024-04-17T15:41:10.427101+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:41:10.427101+0000","last_undegraded":"2024-04-17T15:41:10.427101+0000","last_fullsized":"2024-04-17T15:41:10.427101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:23:27.682637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.642331+0000","last_change":"2024-04-17T15:41:15.642389+0000","last_active":"2024-04-17T15:41:15.642331+0000","last_peered":"2024-04-17T15:41:15.642331+0000","last_clean":"2024-04-17T15:41:15.642331+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:41:15.642331+0000","last_undegraded":"2024-04-17T15:41:15.642331+0000","last_fullsized":"2024-04-17T15:41:15.642331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.642137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.642137+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.642137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:23.321426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.553733+0000","last_change":"2024-04-17T15:36:56.212240+0000","last_active":"2024-04-17T15:40:58.553733+0000","last_peered":"2024-04-17T15:40:58.553733+0000","last_clean":"2024-04-17T15:40:58.553733+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:40:58.553733+0000","last_undegraded":"2024-04-17T15:40:58.553733+0000","last_fullsized":"2024-04-17T15:40:58.553733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:30.175697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"130'50","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.025577+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:41:11.025577+0000","last_peered":"2024-04-17T15:41:11.025577+0000","last_clean":"2024-04-17T15:41:11.025577+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:41:11.025577+0000","last_undegraded":"2024-04-17T15:41:11.025577+0000","last_fullsized":"2024-04-17T15:41:11.025577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:40:50.284431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:01.315689+0000","last_change":"2024-04-17T15:36:58.239469+0000","last_active":"2024-04-17T15:41:01.315689+0000","last_peered":"2024-04-17T15:41:01.315689+0000","last_clean":"2024-04-17T15:41:01.315689+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:41:01.315689+0000","last_undegraded":"2024-04-17T15:41:01.315689+0000","last_fullsized":"2024-04-17T15:41:01.315689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"130'34","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.424575+0000","last_change":"2024-04-17T15:37:00.247112+0000","last_active":"2024-04-17T15:41:10.424575+0000","last_peered":"2024-04-17T15:41:10.424575+0000","last_clean":"2024-04-17T15:41:10.424575+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:41:10.424575+0000","last_undegraded":"2024-04-17T15:41:10.424575+0000","last_fullsized":"2024-04-17T15:41:10.424575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206391+0000","last_change":"2024-04-17T15:37:02.282311+0000","last_active":"2024-04-17T15:40:58.206391+0000","last_peered":"2024-04-17T15:40:58.206391+0000","last_clean":"2024-04-17T15:40:58.206391+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:40:58.206391+0000","last_undegraded":"2024-04-17T15:40:58.206391+0000","last_fullsized":"2024-04-17T15:40:58.206391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:31.852691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545154+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:58.545154+0000","last_peered":"2024-04-17T15:40:58.545154+0000","last_clean":"2024-04-17T15:40:58.545154+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:58.545154+0000","last_undegraded":"2024-04-17T15:40:58.545154+0000","last_fullsized":"2024-04-17T15:40:58.545154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:58:10.763328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870235+0000","last_change":"2024-04-17T15:36:56.214593+0000","last_active":"2024-04-17T15:40:58.870235+0000","last_peered":"2024-04-17T15:40:58.870235+0000","last_clean":"2024-04-17T15:40:58.870235+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:40:58.870235+0000","last_undegraded":"2024-04-17T15:40:58.870235+0000","last_fullsized":"2024-04-17T15:40:58.870235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"130'48","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.196294+0000","last_change":"2024-04-17T15:36:54.169649+0000","last_active":"2024-04-17T15:41:11.196294+0000","last_peered":"2024-04-17T15:41:11.196294+0000","last_clean":"2024-04-17T15:41:11.196294+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:41:11.196294+0000","last_undegraded":"2024-04-17T15:41:11.196294+0000","last_fullsized":"2024-04-17T15:41:11.196294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550405+0000","last_change":"2024-04-17T15:36:58.218415+0000","last_active":"2024-04-17T15:40:58.550405+0000","last_peered":"2024-04-17T15:40:58.550405+0000","last_clean":"2024-04-17T15:40:58.550405+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:40:58.550405+0000","last_undegraded":"2024-04-17T15:40:58.550405+0000","last_fullsized":"2024-04-17T15:40:58.550405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:58.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"130'26","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.431921+0000","last_change":"2024-04-17T15:37:00.257437+0000","last_active":"2024-04-17T15:41:10.431921+0000","last_peered":"2024-04-17T15:41:10.431921+0000","last_clean":"2024-04-17T15:41:10.431921+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:41:10.431921+0000","last_undegraded":"2024-04-17T15:41:10.431921+0000","last_fullsized":"2024-04-17T15:41:10.431921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:13:51.482931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207348+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:58.207348+0000","last_peered":"2024-04-17T15:40:58.207348+0000","last_clean":"2024-04-17T15:40:58.207348+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:58.207348+0000","last_undegraded":"2024-04-17T15:40:58.207348+0000","last_fullsized":"2024-04-17T15:40:58.207348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550842+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:58.550842+0000","last_peered":"2024-04-17T15:40:58.550842+0000","last_clean":"2024-04-17T15:40:58.550842+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:58.550842+0000","last_undegraded":"2024-04-17T15:40:58.550842+0000","last_fullsized":"2024-04-17T15:40:58.550842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:49:47.996339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546595+0000","last_change":"2024-04-17T15:36:56.183238+0000","last_active":"2024-04-17T15:40:58.546595+0000","last_peered":"2024-04-17T15:40:58.546595+0000","last_clean":"2024-04-17T15:40:58.546595+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:40:58.546595+0000","last_undegraded":"2024-04-17T15:40:58.546595+0000","last_fullsized":"2024-04-17T15:40:58.546595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:31.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"130'56","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.104087+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:41:11.104087+0000","last_peered":"2024-04-17T15:41:11.104087+0000","last_clean":"2024-04-17T15:41:11.104087+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:41:11.104087+0000","last_undegraded":"2024-04-17T15:41:11.104087+0000","last_fullsized":"2024-04-17T15:41:11.104087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209645+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:58.209645+0000","last_peered":"2024-04-17T15:40:58.209645+0000","last_clean":"2024-04-17T15:40:58.209645+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:58.209645+0000","last_undegraded":"2024-04-17T15:40:58.209645+0000","last_fullsized":"2024-04-17T15:40:58.209645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'24","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.368949+0000","last_change":"2024-04-17T15:37:00.456502+0000","last_active":"2024-04-17T15:41:10.368949+0000","last_peered":"2024-04-17T15:41:10.368949+0000","last_clean":"2024-04-17T15:41:10.368949+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:41:10.368949+0000","last_undegraded":"2024-04-17T15:41:10.368949+0000","last_fullsized":"2024-04-17T15:41:10.368949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:32.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:01.294383+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:41:01.294383+0000","last_peered":"2024-04-17T15:41:01.294383+0000","last_clean":"2024-04-17T15:41:01.294383+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:41:01.294383+0000","last_undegraded":"2024-04-17T15:41:01.294383+0000","last_fullsized":"2024-04-17T15:41:01.294383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":212,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205399+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:58.205399+0000","last_peered":"2024-04-17T15:40:58.205399+0000","last_clean":"2024-04-17T15:40:58.205399+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:58.205399+0000","last_undegraded":"2024-04-17T15:40:58.205399+0000","last_fullsized":"2024-04-17T15:40:58.205399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832159+0000","last_change":"2024-04-17T15:36:56.189897+0000","last_active":"2024-04-17T15:40:58.832159+0000","last_peered":"2024-04-17T15:40:58.832159+0000","last_clean":"2024-04-17T15:40:58.832159+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:40:58.832159+0000","last_undegraded":"2024-04-17T15:40:58.832159+0000","last_fullsized":"2024-04-17T15:40:58.832159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"130'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.179808+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:41:11.179808+0000","last_peered":"2024-04-17T15:41:11.179808+0000","last_clean":"2024-04-17T15:41:11.179808+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:41:11.179808+0000","last_undegraded":"2024-04-17T15:41:11.179808+0000","last_fullsized":"2024-04-17T15:41:11.179808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207965+0000","last_change":"2024-04-17T15:36:58.227665+0000","last_active":"2024-04-17T15:40:58.207965+0000","last_peered":"2024-04-17T15:40:58.207965+0000","last_clean":"2024-04-17T15:40:58.207965+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:40:58.207965+0000","last_undegraded":"2024-04-17T15:40:58.207965+0000","last_fullsized":"2024-04-17T15:40:58.207965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"98'12","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:01.313545+0000","last_change":"2024-04-17T15:37:00.458073+0000","last_active":"2024-04-17T15:41:01.313545+0000","last_peered":"2024-04-17T15:41:01.313545+0000","last_clean":"2024-04-17T15:41:01.313545+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:41:01.313545+0000","last_undegraded":"2024-04-17T15:41:01.313545+0000","last_fullsized":"2024-04-17T15:41:01.313545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"130'138","reported_seq":404,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.215887+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:41:11.215887+0000","last_peered":"2024-04-17T15:41:11.215887+0000","last_clean":"2024-04-17T15:41:11.215887+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:41:11.215887+0000","last_undegraded":"2024-04-17T15:41:11.215887+0000","last_fullsized":"2024-04-17T15:41:11.215887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:29.030457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511119+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:58.511119+0000","last_peered":"2024-04-17T15:40:58.511119+0000","last_clean":"2024-04-17T15:40:58.511119+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:58.511119+0000","last_undegraded":"2024-04-17T15:40:58.511119+0000","last_fullsized":"2024-04-17T15:40:58.511119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:41:49.485307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207533+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:58.207533+0000","last_peered":"2024-04-17T15:40:58.207533+0000","last_clean":"2024-04-17T15:40:58.207533+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:58.207533+0000","last_undegraded":"2024-04-17T15:40:58.207533+0000","last_fullsized":"2024-04-17T15:40:58.207533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"130'42","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.180332+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:41:11.180332+0000","last_peered":"2024-04-17T15:41:11.180332+0000","last_clean":"2024-04-17T15:41:11.180332+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:41:11.180332+0000","last_undegraded":"2024-04-17T15:41:11.180332+0000","last_fullsized":"2024-04-17T15:41:11.180332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:20:40.086274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.510932+0000","last_change":"2024-04-17T15:36:58.239800+0000","last_active":"2024-04-17T15:40:58.510932+0000","last_peered":"2024-04-17T15:40:58.510932+0000","last_clean":"2024-04-17T15:40:58.510932+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:40:58.510932+0000","last_undegraded":"2024-04-17T15:40:58.510932+0000","last_fullsized":"2024-04-17T15:40:58.510932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:11:29.917855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"130'26","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.389504+0000","last_change":"2024-04-17T15:37:00.250173+0000","last_active":"2024-04-17T15:41:10.389504+0000","last_peered":"2024-04-17T15:41:10.389504+0000","last_clean":"2024-04-17T15:41:10.389504+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:41:10.389504+0000","last_undegraded":"2024-04-17T15:41:10.389504+0000","last_fullsized":"2024-04-17T15:41:10.389504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:58:12.139380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.868848+0000","last_change":"2024-04-17T15:37:02.266761+0000","last_active":"2024-04-17T15:40:58.868848+0000","last_peered":"2024-04-17T15:40:58.868848+0000","last_clean":"2024-04-17T15:40:58.868848+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:40:58.868848+0000","last_undegraded":"2024-04-17T15:40:58.868848+0000","last_fullsized":"2024-04-17T15:40:58.868848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514028+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:58.514028+0000","last_peered":"2024-04-17T15:40:58.514028+0000","last_clean":"2024-04-17T15:40:58.514028+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:58.514028+0000","last_undegraded":"2024-04-17T15:40:58.514028+0000","last_fullsized":"2024-04-17T15:40:58.514028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:57:44.785705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209004+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:58.209004+0000","last_peered":"2024-04-17T15:40:58.209004+0000","last_clean":"2024-04-17T15:40:58.209004+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:58.209004+0000","last_undegraded":"2024-04-17T15:40:58.209004+0000","last_fullsized":"2024-04-17T15:40:58.209004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"130'50","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.088478+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:41:11.088478+0000","last_peered":"2024-04-17T15:41:11.088478+0000","last_clean":"2024-04-17T15:41:11.088478+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:41:11.088478+0000","last_undegraded":"2024-04-17T15:41:11.088478+0000","last_fullsized":"2024-04-17T15:41:11.088478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:39:25.571790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205705+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:58.205705+0000","last_peered":"2024-04-17T15:40:58.205705+0000","last_clean":"2024-04-17T15:40:58.205705+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:58.205705+0000","last_undegraded":"2024-04-17T15:40:58.205705+0000","last_fullsized":"2024-04-17T15:40:58.205705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:44:07.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"130'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.395059+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:41:10.395059+0000","last_peered":"2024-04-17T15:41:10.395059+0000","last_clean":"2024-04-17T15:41:10.395059+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:41:10.395059+0000","last_undegraded":"2024-04-17T15:41:10.395059+0000","last_fullsized":"2024-04-17T15:41:10.395059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550780+0000","last_change":"2024-04-17T15:37:02.266642+0000","last_active":"2024-04-17T15:40:58.550780+0000","last_peered":"2024-04-17T15:40:58.550780+0000","last_clean":"2024-04-17T15:40:58.550780+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:40:58.550780+0000","last_undegraded":"2024-04-17T15:40:58.550780+0000","last_fullsized":"2024-04-17T15:40:58.550780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:47.328473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546804+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:58.546804+0000","last_peered":"2024-04-17T15:40:58.546804+0000","last_clean":"2024-04-17T15:40:58.546804+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:58.546804+0000","last_undegraded":"2024-04-17T15:40:58.546804+0000","last_fullsized":"2024-04-17T15:40:58.546804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:13:54.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544901+0000","last_change":"2024-04-17T15:36:56.189972+0000","last_active":"2024-04-17T15:40:58.544901+0000","last_peered":"2024-04-17T15:40:58.544901+0000","last_clean":"2024-04-17T15:40:58.544901+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:40:58.544901+0000","last_undegraded":"2024-04-17T15:40:58.544901+0000","last_fullsized":"2024-04-17T15:40:58.544901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:28.840529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"130'44","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.178426+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:41:11.178426+0000","last_peered":"2024-04-17T15:41:11.178426+0000","last_clean":"2024-04-17T15:41:11.178426+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:41:11.178426+0000","last_undegraded":"2024-04-17T15:41:11.178426+0000","last_fullsized":"2024-04-17T15:41:11.178426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:33:18.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205734+0000","last_change":"2024-04-17T15:36:58.220617+0000","last_active":"2024-04-17T15:40:58.205734+0000","last_peered":"2024-04-17T15:40:58.205734+0000","last_clean":"2024-04-17T15:40:58.205734+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:40:58.205734+0000","last_undegraded":"2024-04-17T15:40:58.205734+0000","last_fullsized":"2024-04-17T15:40:58.205734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"130'16","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.361582+0000","last_change":"2024-04-17T15:37:00.259342+0000","last_active":"2024-04-17T15:41:10.361582+0000","last_peered":"2024-04-17T15:41:10.361582+0000","last_clean":"2024-04-17T15:41:10.361582+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:41:10.361582+0000","last_undegraded":"2024-04-17T15:41:10.361582+0000","last_fullsized":"2024-04-17T15:41:10.361582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:46:25.661558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207238+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:58.207238+0000","last_peered":"2024-04-17T15:40:58.207238+0000","last_clean":"2024-04-17T15:40:58.207238+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:58.207238+0000","last_undegraded":"2024-04-17T15:40:58.207238+0000","last_fullsized":"2024-04-17T15:40:58.207238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513344+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:58.513344+0000","last_peered":"2024-04-17T15:40:58.513344+0000","last_clean":"2024-04-17T15:40:58.513344+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:58.513344+0000","last_undegraded":"2024-04-17T15:40:58.513344+0000","last_fullsized":"2024-04-17T15:40:58.513344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:45:01.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206901+0000","last_change":"2024-04-17T15:36:56.199828+0000","last_active":"2024-04-17T15:40:58.206901+0000","last_peered":"2024-04-17T15:40:58.206901+0000","last_clean":"2024-04-17T15:40:58.206901+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:40:58.206901+0000","last_undegraded":"2024-04-17T15:40:58.206901+0000","last_fullsized":"2024-04-17T15:40:58.206901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"130'44","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.146638+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:41:11.146638+0000","last_peered":"2024-04-17T15:41:11.146638+0000","last_clean":"2024-04-17T15:41:11.146638+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:41:11.146638+0000","last_undegraded":"2024-04-17T15:41:11.146638+0000","last_fullsized":"2024-04-17T15:41:11.146638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205537+0000","last_change":"2024-04-17T15:36:58.220398+0000","last_active":"2024-04-17T15:40:58.205537+0000","last_peered":"2024-04-17T15:40:58.205537+0000","last_clean":"2024-04-17T15:40:58.205537+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:40:58.205537+0000","last_undegraded":"2024-04-17T15:40:58.205537+0000","last_fullsized":"2024-04-17T15:40:58.205537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"130'21","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.371502+0000","last_change":"2024-04-17T15:37:00.252267+0000","last_active":"2024-04-17T15:41:10.371502+0000","last_peered":"2024-04-17T15:41:10.371502+0000","last_clean":"2024-04-17T15:41:10.371502+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:41:10.371502+0000","last_undegraded":"2024-04-17T15:41:10.371502+0000","last_fullsized":"2024-04-17T15:41:10.371502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.683265+0000","last_change":"2024-04-17T15:41:14.683319+0000","last_active":"2024-04-17T15:41:14.683265+0000","last_peered":"2024-04-17T15:41:14.683265+0000","last_clean":"2024-04-17T15:41:14.683265+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:41:14.683265+0000","last_undegraded":"2024-04-17T15:41:14.683265+0000","last_fullsized":"2024-04-17T15:41:14.683265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:14.683062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:14.683062+0000","last_clean_scrub_stamp":"2024-04-17T15:41:14.683062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:57:18.851274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":211,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209797+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:58.209797+0000","last_peered":"2024-04-17T15:40:58.209797+0000","last_clean":"2024-04-17T15:40:58.209797+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:58.209797+0000","last_undegraded":"2024-04-17T15:40:58.209797+0000","last_fullsized":"2024-04-17T15:40:58.209797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.755037+0000","last_change":"2024-04-17T15:36:56.194613+0000","last_active":"2024-04-17T15:41:14.755037+0000","last_peered":"2024-04-17T15:41:14.755037+0000","last_clean":"2024-04-17T15:41:14.755037+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:41:14.755037+0000","last_undegraded":"2024-04-17T15:41:14.755037+0000","last_fullsized":"2024-04-17T15:41:14.755037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'56","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.166338+0000","last_change":"2024-04-17T15:36:54.186568+0000","last_active":"2024-04-17T15:41:11.166338+0000","last_peered":"2024-04-17T15:41:11.166338+0000","last_clean":"2024-04-17T15:41:11.166338+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:41:11.166338+0000","last_undegraded":"2024-04-17T15:41:11.166338+0000","last_fullsized":"2024-04-17T15:41:11.166338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:03.965845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":267,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.754962+0000","last_change":"2024-04-17T15:36:56.186317+0000","last_active":"2024-04-17T15:41:14.754962+0000","last_peered":"2024-04-17T15:41:14.754962+0000","last_clean":"2024-04-17T15:41:14.754962+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:41:14.754962+0000","last_undegraded":"2024-04-17T15:41:14.754962+0000","last_fullsized":"2024-04-17T15:41:14.754962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"130'44","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.146248+0000","last_change":"2024-04-17T15:36:54.177505+0000","last_active":"2024-04-17T15:41:11.146248+0000","last_peered":"2024-04-17T15:41:11.146248+0000","last_clean":"2024-04-17T15:41:11.146248+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:41:11.146248+0000","last_undegraded":"2024-04-17T15:41:11.146248+0000","last_fullsized":"2024-04-17T15:41:11.146248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210441+0000","last_change":"2024-04-17T15:36:56.216275+0000","last_active":"2024-04-17T15:40:58.210441+0000","last_peered":"2024-04-17T15:40:58.210441+0000","last_clean":"2024-04-17T15:40:58.210441+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:40:58.210441+0000","last_undegraded":"2024-04-17T15:40:58.210441+0000","last_fullsized":"2024-04-17T15:40:58.210441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"130'42","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.151416+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:41:11.151416+0000","last_peered":"2024-04-17T15:41:11.151416+0000","last_clean":"2024-04-17T15:41:11.151416+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:41:11.151416+0000","last_undegraded":"2024-04-17T15:41:11.151416+0000","last_fullsized":"2024-04-17T15:41:11.151416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:02.291163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.754910+0000","last_change":"2024-04-17T15:36:56.198396+0000","last_active":"2024-04-17T15:41:14.754910+0000","last_peered":"2024-04-17T15:41:14.754910+0000","last_clean":"2024-04-17T15:41:14.754910+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:41:14.754910+0000","last_undegraded":"2024-04-17T15:41:14.754910+0000","last_fullsized":"2024-04-17T15:41:14.754910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"130'42","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.188894+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:41:11.188894+0000","last_peered":"2024-04-17T15:41:11.188894+0000","last_clean":"2024-04-17T15:41:11.188894+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:41:11.188894+0000","last_undegraded":"2024-04-17T15:41:11.188894+0000","last_fullsized":"2024-04-17T15:41:11.188894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546037+0000","last_change":"2024-04-17T15:36:56.189609+0000","last_active":"2024-04-17T15:40:58.546037+0000","last_peered":"2024-04-17T15:40:58.546037+0000","last_clean":"2024-04-17T15:40:58.546037+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:40:58.546037+0000","last_undegraded":"2024-04-17T15:40:58.546037+0000","last_fullsized":"2024-04-17T15:40:58.546037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:28:58.145137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"130'50","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.113022+0000","last_change":"2024-04-17T15:37:41.344828+0000","last_active":"2024-04-17T15:41:11.113022+0000","last_peered":"2024-04-17T15:41:11.113022+0000","last_clean":"2024-04-17T15:41:11.113022+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:41:11.113022+0000","last_undegraded":"2024-04-17T15:41:11.113022+0000","last_fullsized":"2024-04-17T15:41:11.113022+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.314524+0000","last_change":"2024-04-17T15:36:56.218547+0000","last_active":"2024-04-17T15:41:06.314524+0000","last_peered":"2024-04-17T15:41:06.314524+0000","last_clean":"2024-04-17T15:41:06.314524+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:41:06.314524+0000","last_undegraded":"2024-04-17T15:41:06.314524+0000","last_fullsized":"2024-04-17T15:41:06.314524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"130'64","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.754703+0000","last_change":"2024-04-17T15:36:54.173026+0000","last_active":"2024-04-17T15:41:14.754703+0000","last_peered":"2024-04-17T15:41:14.754703+0000","last_clean":"2024-04-17T15:41:14.754703+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:41:14.754703+0000","last_undegraded":"2024-04-17T15:41:14.754703+0000","last_fullsized":"2024-04-17T15:41:14.754703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":229,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.544752+0000","last_change":"2024-04-17T15:36:56.189555+0000","last_active":"2024-04-17T15:40:58.544752+0000","last_peered":"2024-04-17T15:40:58.544752+0000","last_clean":"2024-04-17T15:40:58.544752+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:40:58.544752+0000","last_undegraded":"2024-04-17T15:40:58.544752+0000","last_fullsized":"2024-04-17T15:40:58.544752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:20:31.756544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"130'50","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.149001+0000","last_change":"2024-04-17T15:36:54.195684+0000","last_active":"2024-04-17T15:41:11.149001+0000","last_peered":"2024-04-17T15:41:11.149001+0000","last_clean":"2024-04-17T15:41:11.149001+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:41:11.149001+0000","last_undegraded":"2024-04-17T15:41:11.149001+0000","last_fullsized":"2024-04-17T15:41:11.149001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:08:49.418228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.550656+0000","last_change":"2024-04-17T15:36:56.192952+0000","last_active":"2024-04-17T15:40:58.550656+0000","last_peered":"2024-04-17T15:40:58.550656+0000","last_clean":"2024-04-17T15:40:58.550656+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:40:58.550656+0000","last_undegraded":"2024-04-17T15:40:58.550656+0000","last_fullsized":"2024-04-17T15:40:58.550656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:54:04.312902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"130'42","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.152143+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:41:11.152143+0000","last_peered":"2024-04-17T15:41:11.152143+0000","last_clean":"2024-04-17T15:41:11.152143+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:41:11.152143+0000","last_undegraded":"2024-04-17T15:41:11.152143+0000","last_fullsized":"2024-04-17T15:41:11.152143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:03:09.414466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870334+0000","last_change":"2024-04-17T15:36:56.198790+0000","last_active":"2024-04-17T15:40:58.870334+0000","last_peered":"2024-04-17T15:40:58.870334+0000","last_clean":"2024-04-17T15:40:58.870334+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:40:58.870334+0000","last_undegraded":"2024-04-17T15:40:58.870334+0000","last_fullsized":"2024-04-17T15:40:58.870334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"130'50","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.130643+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:41:11.130643+0000","last_peered":"2024-04-17T15:41:11.130643+0000","last_clean":"2024-04-17T15:41:11.130643+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:41:11.130643+0000","last_undegraded":"2024-04-17T15:41:11.130643+0000","last_fullsized":"2024-04-17T15:41:11.130643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:13.784336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.212421+0000","last_change":"2024-04-17T15:36:56.188684+0000","last_active":"2024-04-17T15:40:58.212421+0000","last_peered":"2024-04-17T15:40:58.212421+0000","last_clean":"2024-04-17T15:40:58.212421+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:40:58.212421+0000","last_undegraded":"2024-04-17T15:40:58.212421+0000","last_fullsized":"2024-04-17T15:40:58.212421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"130'44","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.132788+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:41:11.132788+0000","last_peered":"2024-04-17T15:41:11.132788+0000","last_clean":"2024-04-17T15:41:11.132788+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:41:11.132788+0000","last_undegraded":"2024-04-17T15:41:11.132788+0000","last_fullsized":"2024-04-17T15:41:11.132788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:35:56.945410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.832194+0000","last_change":"2024-04-17T15:36:56.193432+0000","last_active":"2024-04-17T15:40:58.832194+0000","last_peered":"2024-04-17T15:40:58.832194+0000","last_clean":"2024-04-17T15:40:58.832194+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:40:58.832194+0000","last_undegraded":"2024-04-17T15:40:58.832194+0000","last_fullsized":"2024-04-17T15:40:58.832194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"130'48","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.142243+0000","last_change":"2024-04-17T15:36:54.200838+0000","last_active":"2024-04-17T15:41:11.142243+0000","last_peered":"2024-04-17T15:41:11.142243+0000","last_clean":"2024-04-17T15:41:11.142243+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:41:11.142243+0000","last_undegraded":"2024-04-17T15:41:11.142243+0000","last_fullsized":"2024-04-17T15:41:11.142243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209237+0000","last_change":"2024-04-17T15:36:56.199617+0000","last_active":"2024-04-17T15:40:58.209237+0000","last_peered":"2024-04-17T15:40:58.209237+0000","last_clean":"2024-04-17T15:40:58.209237+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:40:58.209237+0000","last_undegraded":"2024-04-17T15:40:58.209237+0000","last_fullsized":"2024-04-17T15:40:58.209237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"130'52","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.185336+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:41:11.185336+0000","last_peered":"2024-04-17T15:41:11.185336+0000","last_clean":"2024-04-17T15:41:11.185336+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:41:11.185336+0000","last_undegraded":"2024-04-17T15:41:11.185336+0000","last_fullsized":"2024-04-17T15:41:11.185336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512328+0000","last_change":"2024-04-17T15:36:56.198014+0000","last_active":"2024-04-17T15:40:58.512328+0000","last_peered":"2024-04-17T15:40:58.512328+0000","last_clean":"2024-04-17T15:40:58.512328+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:40:58.512328+0000","last_undegraded":"2024-04-17T15:40:58.512328+0000","last_fullsized":"2024-04-17T15:40:58.512328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:00:49.193852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"130'58","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.119049+0000","last_change":"2024-04-17T15:36:54.210210+0000","last_active":"2024-04-17T15:41:11.119049+0000","last_peered":"2024-04-17T15:41:11.119049+0000","last_clean":"2024-04-17T15:41:11.119049+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:41:11.119049+0000","last_undegraded":"2024-04-17T15:41:11.119049+0000","last_fullsized":"2024-04-17T15:41:11.119049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:51:34.829891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":230,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869324+0000","last_change":"2024-04-17T15:36:56.191591+0000","last_active":"2024-04-17T15:40:58.869324+0000","last_peered":"2024-04-17T15:40:58.869324+0000","last_clean":"2024-04-17T15:40:58.869324+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:40:58.869324+0000","last_undegraded":"2024-04-17T15:40:58.869324+0000","last_fullsized":"2024-04-17T15:40:58.869324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"130'40","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.165696+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:41:11.165696+0000","last_peered":"2024-04-17T15:41:11.165696+0000","last_clean":"2024-04-17T15:41:11.165696+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:41:11.165696+0000","last_undegraded":"2024-04-17T15:41:11.165696+0000","last_fullsized":"2024-04-17T15:41:11.165696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:28.153958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":188,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.830929+0000","last_change":"2024-04-17T15:37:41.531297+0000","last_active":"2024-04-17T15:40:58.830929+0000","last_peered":"2024-04-17T15:40:58.830929+0000","last_clean":"2024-04-17T15:40:58.830929+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:40:58.830929+0000","last_undegraded":"2024-04-17T15:40:58.830929+0000","last_fullsized":"2024-04-17T15:40:58.830929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"130'32","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.188565+0000","last_change":"2024-04-17T15:36:54.188996+0000","last_active":"2024-04-17T15:41:11.188565+0000","last_peered":"2024-04-17T15:41:11.188565+0000","last_clean":"2024-04-17T15:41:11.188565+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:41:11.188565+0000","last_undegraded":"2024-04-17T15:41:11.188565+0000","last_fullsized":"2024-04-17T15:41:11.188565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511460+0000","last_change":"2024-04-17T15:36:56.198335+0000","last_active":"2024-04-17T15:40:58.511460+0000","last_peered":"2024-04-17T15:40:58.511460+0000","last_clean":"2024-04-17T15:40:58.511460+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:40:58.511460+0000","last_undegraded":"2024-04-17T15:40:58.511460+0000","last_fullsized":"2024-04-17T15:40:58.511460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:03.404358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"130'46","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.073234+0000","last_change":"2024-04-17T15:37:41.353143+0000","last_active":"2024-04-17T15:41:11.073234+0000","last_peered":"2024-04-17T15:41:11.073234+0000","last_clean":"2024-04-17T15:41:11.073234+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:41:11.073234+0000","last_undegraded":"2024-04-17T15:41:11.073234+0000","last_fullsized":"2024-04-17T15:41:11.073234+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"130'66","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.115311+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:41:11.115311+0000","last_peered":"2024-04-17T15:41:11.115311+0000","last_clean":"2024-04-17T15:41:11.115311+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:41:11.115311+0000","last_undegraded":"2024-04-17T15:41:11.115311+0000","last_fullsized":"2024-04-17T15:41:11.115311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:40:04.221419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870358+0000","last_change":"2024-04-17T15:36:56.198989+0000","last_active":"2024-04-17T15:40:58.870358+0000","last_peered":"2024-04-17T15:40:58.870358+0000","last_clean":"2024-04-17T15:40:58.870358+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:40:58.870358+0000","last_undegraded":"2024-04-17T15:40:58.870358+0000","last_fullsized":"2024-04-17T15:40:58.870358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"130'28","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.122522+0000","last_change":"2024-04-17T15:36:54.163114+0000","last_active":"2024-04-17T15:41:11.122522+0000","last_peered":"2024-04-17T15:41:11.122522+0000","last_clean":"2024-04-17T15:41:11.122522+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:41:11.122522+0000","last_undegraded":"2024-04-17T15:41:11.122522+0000","last_fullsized":"2024-04-17T15:41:11.122522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210809+0000","last_change":"2024-04-17T15:36:56.206829+0000","last_active":"2024-04-17T15:40:58.210809+0000","last_peered":"2024-04-17T15:40:58.210809+0000","last_clean":"2024-04-17T15:40:58.210809+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:40:58.210809+0000","last_undegraded":"2024-04-17T15:40:58.210809+0000","last_fullsized":"2024-04-17T15:40:58.210809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:41.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1104,"ondisk_log_size":1104,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1539,"num_write":537,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":861,"ondisk_log_size":861,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542203,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1256284,"kb_used_data":1220824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93115556,"statfs":{"total":96636764160,"available":95350329344,"internally_reserved":0,"allocated":1250123776,"data_stored":1249441653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542203,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1581056,"data_stored":928534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1634304,"data_stored":929809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1568768,"data_stored":928032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542201,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1056812,"kb_used_data":1021476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93315028,"statfs":{"total":96636764160,"available":95554588672,"internally_reserved":0,"allocated":1045991424,"data_stored":1045312022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542203,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1568768,"data_stored":928096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37020,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334820,"statfs":{"total":96636764160,"available":96598855680,"internally_reserved":0,"allocated":1605632,"data_stored":929612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542202,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1519961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:41:18.032 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.032 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.032 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.032 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.032 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.032 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.032 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.032 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.033 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.034 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.035 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.036 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.037 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.038 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.038 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.038 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.038 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.038 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.038 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.039 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.039 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.039 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.039 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.039 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.039 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.039 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.039 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.040 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.041 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.041 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.041 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.041 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.041 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.041 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.041 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.041 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.042 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.043 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.044 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.044 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.044 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.044 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.044 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.044 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.044 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.045 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.045 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.045 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.045 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.045 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.045 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.045 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.045 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.046 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.047 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.048 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.049 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.050 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.051 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.052 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.053 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.054 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.055 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.056 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.057 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.058 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.059 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.060 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:18.060 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T15:41:38.060 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:41:38.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:41:38.411 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-04-17T15:41:38.343747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616016,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5028,"num_read_kb":3926,"num_write":4421,"num_write_kb":6187915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5647,"ondisk_log_size":5647,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":292152,"kb_used_data":13624,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754682568,"statfs":{"total":773094113280,"available":772794949632,"internally_reserved":0,"allocated":13950976,"data_stored":8613932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":285134386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007096"},"pg_stats":[{"pgid":"3.3f","version":"130'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.617314+0000","last_change":"2024-04-17T15:41:34.617374+0000","last_active":"2024-04-17T15:41:34.617314+0000","last_peered":"2024-04-17T15:41:34.617314+0000","last_clean":"2024-04-17T15:41:34.617314+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:41:34.617314+0000","last_undegraded":"2024-04-17T15:41:34.617314+0000","last_fullsized":"2024-04-17T15:41:34.617314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:34.617105+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:34.617105+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.617105+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:50:59.994778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.797491+0000","last_change":"2024-04-17T15:41:23.797545+0000","last_active":"2024-04-17T15:41:23.797491+0000","last_peered":"2024-04-17T15:41:23.797491+0000","last_clean":"2024-04-17T15:41:23.797491+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:41:23.797491+0000","last_undegraded":"2024-04-17T15:41:23.797491+0000","last_fullsized":"2024-04-17T15:41:23.797491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.797290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.797290+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.797290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:26.763546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"130'52","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.493816+0000","last_change":"2024-04-17T15:41:34.493879+0000","last_active":"2024-04-17T15:41:34.493816+0000","last_peered":"2024-04-17T15:41:34.493816+0000","last_clean":"2024-04-17T15:41:34.493816+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:41:34.493816+0000","last_undegraded":"2024-04-17T15:41:34.493816+0000","last_fullsized":"2024-04-17T15:41:34.493816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'52","last_scrub_stamp":"2024-04-17T15:41:34.493584+0000","last_deep_scrub":"130'52","last_deep_scrub_stamp":"2024-04-17T15:41:34.493584+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.493584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:06.692647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.516248+0000","last_change":"2024-04-17T15:41:22.516308+0000","last_active":"2024-04-17T15:41:22.516248+0000","last_peered":"2024-04-17T15:41:22.516248+0000","last_clean":"2024-04-17T15:41:22.516248+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:41:22.516248+0000","last_undegraded":"2024-04-17T15:41:22.516248+0000","last_fullsized":"2024-04-17T15:41:22.516248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:22.516050+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:22.516050+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.516050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:42.156284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"130'44","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.171905+0000","last_change":"2024-04-17T15:36:54.174639+0000","last_active":"2024-04-17T15:41:11.171905+0000","last_peered":"2024-04-17T15:41:11.171905+0000","last_clean":"2024-04-17T15:41:11.171905+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:41:11.171905+0000","last_undegraded":"2024-04-17T15:41:11.171905+0000","last_fullsized":"2024-04-17T15:41:11.171905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":257,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.995044+0000","last_change":"2024-04-17T15:41:28.995193+0000","last_active":"2024-04-17T15:41:28.995044+0000","last_peered":"2024-04-17T15:41:28.995044+0000","last_clean":"2024-04-17T15:41:28.995044+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:41:28.995044+0000","last_undegraded":"2024-04-17T15:41:28.995044+0000","last_fullsized":"2024-04-17T15:41:28.995044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'8","last_scrub_stamp":"2024-04-17T15:41:28.994794+0000","last_deep_scrub":"77'8","last_deep_scrub_stamp":"2024-04-17T15:41:28.994794+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.994794+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:06.407245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"130'38","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.979316+0000","last_change":"2024-04-17T15:41:33.979447+0000","last_active":"2024-04-17T15:41:33.979316+0000","last_peered":"2024-04-17T15:41:33.979316+0000","last_clean":"2024-04-17T15:41:33.979316+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:41:33.979316+0000","last_undegraded":"2024-04-17T15:41:33.979316+0000","last_fullsized":"2024-04-17T15:41:33.979316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:33.979064+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:33.979064+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.979064+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:18:30.649416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.614931+0000","last_change":"2024-04-17T15:41:27.615086+0000","last_active":"2024-04-17T15:41:27.614931+0000","last_peered":"2024-04-17T15:41:27.614931+0000","last_clean":"2024-04-17T15:41:27.614931+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:41:27.614931+0000","last_undegraded":"2024-04-17T15:41:27.614931+0000","last_fullsized":"2024-04-17T15:41:27.614931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-17T15:41:27.614662+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-17T15:41:27.614662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.614662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:02.679627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"130'62","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.196960+0000","last_change":"2024-04-17T15:36:54.206615+0000","last_active":"2024-04-17T15:41:11.196960+0000","last_peered":"2024-04-17T15:41:11.196960+0000","last_clean":"2024-04-17T15:41:11.196960+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:41:11.196960+0000","last_undegraded":"2024-04-17T15:41:11.196960+0000","last_fullsized":"2024-04-17T15:41:11.196960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.338879+0000","last_change":"2024-04-17T15:41:25.338942+0000","last_active":"2024-04-17T15:41:25.338879+0000","last_peered":"2024-04-17T15:41:25.338879+0000","last_clean":"2024-04-17T15:41:25.338879+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:41:25.338879+0000","last_undegraded":"2024-04-17T15:41:25.338879+0000","last_fullsized":"2024-04-17T15:41:25.338879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:25.338660+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:25.338660+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.338660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:09.383031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"130'38","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.192004+0000","last_change":"2024-04-17T15:36:54.177736+0000","last_active":"2024-04-17T15:41:11.192004+0000","last_peered":"2024-04-17T15:41:11.192004+0000","last_clean":"2024-04-17T15:41:11.192004+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:41:11.192004+0000","last_undegraded":"2024-04-17T15:41:11.192004+0000","last_fullsized":"2024-04-17T15:41:11.192004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.969227+0000","last_change":"2024-04-17T15:41:25.969291+0000","last_active":"2024-04-17T15:41:25.969227+0000","last_peered":"2024-04-17T15:41:25.969227+0000","last_clean":"2024-04-17T15:41:25.969227+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:41:25.969227+0000","last_undegraded":"2024-04-17T15:41:25.969227+0000","last_fullsized":"2024-04-17T15:41:25.969227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:25.969023+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:25.969023+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.969023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:20:34.200894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"130'48","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.166455+0000","last_change":"2024-04-17T15:36:54.205272+0000","last_active":"2024-04-17T15:41:11.166455+0000","last_peered":"2024-04-17T15:41:11.166455+0000","last_clean":"2024-04-17T15:41:11.166455+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:41:11.166455+0000","last_undegraded":"2024-04-17T15:41:11.166455+0000","last_fullsized":"2024-04-17T15:41:11.166455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.787979+0000","last_change":"2024-04-17T15:41:25.788128+0000","last_active":"2024-04-17T15:41:25.787979+0000","last_peered":"2024-04-17T15:41:25.787979+0000","last_clean":"2024-04-17T15:41:25.787979+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:41:25.787979+0000","last_undegraded":"2024-04-17T15:41:25.787979+0000","last_fullsized":"2024-04-17T15:41:25.787979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-17T15:41:25.787631+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-17T15:41:25.787631+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.787631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:13.446342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"130'58","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.166115+0000","last_change":"2024-04-17T15:36:54.186368+0000","last_active":"2024-04-17T15:41:11.166115+0000","last_peered":"2024-04-17T15:41:11.166115+0000","last_clean":"2024-04-17T15:41:11.166115+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:41:11.166115+0000","last_undegraded":"2024-04-17T15:41:11.166115+0000","last_fullsized":"2024-04-17T15:41:11.166115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.804128+0000","last_change":"2024-04-17T15:41:26.804250+0000","last_active":"2024-04-17T15:41:26.804128+0000","last_peered":"2024-04-17T15:41:26.804128+0000","last_clean":"2024-04-17T15:41:26.804128+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:41:26.804128+0000","last_undegraded":"2024-04-17T15:41:26.804128+0000","last_fullsized":"2024-04-17T15:41:26.804128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:26.803898+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:26.803898+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.803898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:47:27.426934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.964726+0000","last_change":"2024-04-17T15:41:30.964726+0000","last_active":"2024-04-17T15:41:30.964726+0000","last_peered":"2024-04-17T15:41:30.964726+0000","last_clean":"2024-04-17T15:41:30.964726+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:41:30.964726+0000","last_undegraded":"2024-04-17T15:41:30.964726+0000","last_fullsized":"2024-04-17T15:41:30.964726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:30.964462+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:30.964462+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.964462+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:43.726934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"130'30","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.115664+0000","last_change":"2024-04-17T15:37:41.357984+0000","last_active":"2024-04-17T15:41:11.115664+0000","last_peered":"2024-04-17T15:41:11.115664+0000","last_clean":"2024-04-17T15:41:11.115664+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:41:11.115664+0000","last_undegraded":"2024-04-17T15:41:11.115664+0000","last_fullsized":"2024-04-17T15:41:11.115664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.518571+0000","last_change":"2024-04-17T15:41:21.518571+0000","last_active":"2024-04-17T15:41:21.518571+0000","last_peered":"2024-04-17T15:41:21.518571+0000","last_clean":"2024-04-17T15:41:21.518571+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:41:21.518571+0000","last_undegraded":"2024-04-17T15:41:21.518571+0000","last_fullsized":"2024-04-17T15:41:21.518571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:21.518229+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:21.518229+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.518229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:19.754292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"130'38","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.352152+0000","last_change":"2024-04-17T15:41:32.352217+0000","last_active":"2024-04-17T15:41:32.352152+0000","last_peered":"2024-04-17T15:41:32.352152+0000","last_clean":"2024-04-17T15:41:32.352152+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:41:32.352152+0000","last_undegraded":"2024-04-17T15:41:32.352152+0000","last_fullsized":"2024-04-17T15:41:32.352152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:32.351945+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:32.351945+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.351945+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:53.957332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.894223+0000","last_change":"2024-04-17T15:41:29.894223+0000","last_active":"2024-04-17T15:41:29.894223+0000","last_peered":"2024-04-17T15:41:29.894223+0000","last_clean":"2024-04-17T15:41:29.894223+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:41:29.894223+0000","last_undegraded":"2024-04-17T15:41:29.894223+0000","last_fullsized":"2024-04-17T15:41:29.894223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:29.893844+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:29.893844+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.893844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:42.656316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"130'44","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.338881+0000","last_change":"2024-04-17T15:41:31.338947+0000","last_active":"2024-04-17T15:41:31.338881+0000","last_peered":"2024-04-17T15:41:31.338881+0000","last_clean":"2024-04-17T15:41:31.338881+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:41:31.338881+0000","last_undegraded":"2024-04-17T15:41:31.338881+0000","last_fullsized":"2024-04-17T15:41:31.338881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:31.338675+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:31.338675+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.338675+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:57:35.506887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.859648+0000","last_change":"2024-04-17T15:41:24.859707+0000","last_active":"2024-04-17T15:41:24.859648+0000","last_peered":"2024-04-17T15:41:24.859648+0000","last_clean":"2024-04-17T15:41:24.859648+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:41:24.859648+0000","last_undegraded":"2024-04-17T15:41:24.859648+0000","last_fullsized":"2024-04-17T15:41:24.859648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'14","last_scrub_stamp":"2024-04-17T15:41:24.859436+0000","last_deep_scrub":"90'14","last_deep_scrub_stamp":"2024-04-17T15:41:24.859436+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.859436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:24:28.370533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"130'46","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.142205+0000","last_change":"2024-04-17T15:36:54.192172+0000","last_active":"2024-04-17T15:41:11.142205+0000","last_peered":"2024-04-17T15:41:11.142205+0000","last_clean":"2024-04-17T15:41:11.142205+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:41:11.142205+0000","last_undegraded":"2024-04-17T15:41:11.142205+0000","last_fullsized":"2024-04-17T15:41:11.142205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.790436+0000","last_change":"2024-04-17T15:41:27.790501+0000","last_active":"2024-04-17T15:41:27.790436+0000","last_peered":"2024-04-17T15:41:27.790436+0000","last_clean":"2024-04-17T15:41:27.790436+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:41:27.790436+0000","last_undegraded":"2024-04-17T15:41:27.790436+0000","last_fullsized":"2024-04-17T15:41:27.790436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-17T15:41:27.790233+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-17T15:41:27.790233+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.790233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:19:14.364970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"130'40","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.176159+0000","last_change":"2024-04-17T15:36:54.188786+0000","last_active":"2024-04-17T15:41:11.176159+0000","last_peered":"2024-04-17T15:41:11.176159+0000","last_clean":"2024-04-17T15:41:11.176159+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:41:11.176159+0000","last_undegraded":"2024-04-17T15:41:11.176159+0000","last_fullsized":"2024-04-17T15:41:11.176159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.056111+0000","last_change":"2024-04-17T15:41:35.056174+0000","last_active":"2024-04-17T15:41:35.056111+0000","last_peered":"2024-04-17T15:41:35.056111+0000","last_clean":"2024-04-17T15:41:35.056111+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:41:35.056111+0000","last_undegraded":"2024-04-17T15:41:35.056111+0000","last_fullsized":"2024-04-17T15:41:35.056111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'6","last_scrub_stamp":"2024-04-17T15:41:35.055896+0000","last_deep_scrub":"112'6","last_deep_scrub_stamp":"2024-04-17T15:41:35.055896+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.055896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:37.223590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"130'48","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.289519+0000","last_change":"2024-04-17T15:36:54.181519+0000","last_active":"2024-04-17T15:41:14.289519+0000","last_peered":"2024-04-17T15:41:14.289519+0000","last_clean":"2024-04-17T15:41:14.289519+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:41:14.289519+0000","last_undegraded":"2024-04-17T15:41:14.289519+0000","last_fullsized":"2024-04-17T15:41:14.289519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206230+0000","last_change":"2024-04-17T15:37:04.298452+0000","last_active":"2024-04-17T15:40:58.206230+0000","last_peered":"2024-04-17T15:40:58.206230+0000","last_clean":"2024-04-17T15:40:58.206230+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:40:58.206230+0000","last_undegraded":"2024-04-17T15:40:58.206230+0000","last_fullsized":"2024-04-17T15:40:58.206230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.726673+0000","last_change":"2024-04-17T15:36:56.178530+0000","last_active":"2024-04-17T15:41:15.726673+0000","last_peered":"2024-04-17T15:41:15.726673+0000","last_clean":"2024-04-17T15:41:15.726673+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:41:15.726673+0000","last_undegraded":"2024-04-17T15:41:15.726673+0000","last_fullsized":"2024-04-17T15:41:15.726673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"130'52","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.531281+0000","last_change":"2024-04-17T15:41:32.531281+0000","last_active":"2024-04-17T15:41:32.531281+0000","last_peered":"2024-04-17T15:41:32.531281+0000","last_clean":"2024-04-17T15:41:32.531281+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:41:32.531281+0000","last_undegraded":"2024-04-17T15:41:32.531281+0000","last_fullsized":"2024-04-17T15:41:32.531281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'52","last_scrub_stamp":"2024-04-17T15:41:32.531024+0000","last_deep_scrub":"130'52","last_deep_scrub_stamp":"2024-04-17T15:41:32.531024+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.531024+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.293496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.857504+0000","last_change":"2024-04-17T15:41:28.857605+0000","last_active":"2024-04-17T15:41:28.857504+0000","last_peered":"2024-04-17T15:41:28.857504+0000","last_clean":"2024-04-17T15:41:28.857504+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:41:28.857504+0000","last_undegraded":"2024-04-17T15:41:28.857504+0000","last_fullsized":"2024-04-17T15:41:28.857504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.857277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.857277+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.857277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:01.056340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"130'23","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.600662+0000","last_change":"2024-04-17T15:41:19.600731+0000","last_active":"2024-04-17T15:41:19.600662+0000","last_peered":"2024-04-17T15:41:19.600662+0000","last_clean":"2024-04-17T15:41:19.600662+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:41:19.600662+0000","last_undegraded":"2024-04-17T15:41:19.600662+0000","last_fullsized":"2024-04-17T15:41:19.600662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'23","last_scrub_stamp":"2024-04-17T15:41:19.600479+0000","last_deep_scrub":"130'23","last_deep_scrub_stamp":"2024-04-17T15:41:19.600479+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.600479+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:20:27.832350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513530+0000","last_change":"2024-04-17T15:37:02.274415+0000","last_active":"2024-04-17T15:40:58.513530+0000","last_peered":"2024-04-17T15:40:58.513530+0000","last_clean":"2024-04-17T15:40:58.513530+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:40:58.513530+0000","last_undegraded":"2024-04-17T15:40:58.513530+0000","last_fullsized":"2024-04-17T15:40:58.513530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"112'52","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205250+0000","last_change":"2024-04-17T15:37:04.293577+0000","last_active":"2024-04-17T15:40:58.205250+0000","last_peered":"2024-04-17T15:40:58.205250+0000","last_clean":"2024-04-17T15:40:58.205250+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:40:58.205250+0000","last_undegraded":"2024-04-17T15:40:58.205250+0000","last_fullsized":"2024-04-17T15:40:58.205250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.784375+0000","last_change":"2024-04-17T15:41:24.784439+0000","last_active":"2024-04-17T15:41:24.784375+0000","last_peered":"2024-04-17T15:41:24.784375+0000","last_clean":"2024-04-17T15:41:24.784375+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:41:24.784375+0000","last_undegraded":"2024-04-17T15:41:24.784375+0000","last_fullsized":"2024-04-17T15:41:24.784375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-17T15:41:24.784150+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-17T15:41:24.784150+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.784150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:54.779594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"130'36","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.657345+0000","last_change":"2024-04-17T15:41:35.657345+0000","last_active":"2024-04-17T15:41:35.657345+0000","last_peered":"2024-04-17T15:41:35.657345+0000","last_clean":"2024-04-17T15:41:35.657345+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:41:35.657345+0000","last_undegraded":"2024-04-17T15:41:35.657345+0000","last_fullsized":"2024-04-17T15:41:35.657345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'36","last_scrub_stamp":"2024-04-17T15:41:35.657082+0000","last_deep_scrub":"130'36","last_deep_scrub_stamp":"2024-04-17T15:41:35.657082+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.657082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:30.666682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546220+0000","last_change":"2024-04-17T15:36:58.236433+0000","last_active":"2024-04-17T15:40:58.546220+0000","last_peered":"2024-04-17T15:40:58.546220+0000","last_clean":"2024-04-17T15:40:58.546220+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:40:58.546220+0000","last_undegraded":"2024-04-17T15:40:58.546220+0000","last_fullsized":"2024-04-17T15:40:58.546220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"130'9","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.964504+0000","last_change":"2024-04-17T15:41:20.964582+0000","last_active":"2024-04-17T15:41:20.964504+0000","last_peered":"2024-04-17T15:41:20.964504+0000","last_clean":"2024-04-17T15:41:20.964504+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:41:20.964504+0000","last_undegraded":"2024-04-17T15:41:20.964504+0000","last_fullsized":"2024-04-17T15:41:20.964504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'9","last_scrub_stamp":"2024-04-17T15:41:20.964292+0000","last_deep_scrub":"130'9","last_deep_scrub_stamp":"2024-04-17T15:41:20.964292+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.964292+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:40.604526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.210012+0000","last_change":"2024-04-17T15:37:02.277159+0000","last_active":"2024-04-17T15:40:58.210012+0000","last_peered":"2024-04-17T15:40:58.210012+0000","last_clean":"2024-04-17T15:40:58.210012+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:40:58.210012+0000","last_undegraded":"2024-04-17T15:40:58.210012+0000","last_fullsized":"2024-04-17T15:40:58.210012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869463+0000","last_change":"2024-04-17T15:37:04.285783+0000","last_active":"2024-04-17T15:40:58.869463+0000","last_peered":"2024-04-17T15:40:58.869463+0000","last_clean":"2024-04-17T15:40:58.869463+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:40:58.869463+0000","last_undegraded":"2024-04-17T15:40:58.869463+0000","last_fullsized":"2024-04-17T15:40:58.869463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.618215+0000","last_change":"2024-04-17T15:41:29.618274+0000","last_active":"2024-04-17T15:41:29.618215+0000","last_peered":"2024-04-17T15:41:29.618215+0000","last_clean":"2024-04-17T15:41:29.618215+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:41:29.618215+0000","last_undegraded":"2024-04-17T15:41:29.618215+0000","last_fullsized":"2024-04-17T15:41:29.618215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:29.618029+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:29.618029+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.618029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:31.723480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"130'64","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.655896+0000","last_change":"2024-04-17T15:36:54.208597+0000","last_active":"2024-04-17T15:41:17.655896+0000","last_peered":"2024-04-17T15:41:17.655896+0000","last_clean":"2024-04-17T15:41:17.655896+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:41:17.655896+0000","last_undegraded":"2024-04-17T15:41:17.655896+0000","last_fullsized":"2024-04-17T15:41:17.655896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.629264+0000","last_change":"2024-04-17T15:41:31.629316+0000","last_active":"2024-04-17T15:41:31.629264+0000","last_peered":"2024-04-17T15:41:31.629264+0000","last_clean":"2024-04-17T15:41:31.629264+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:41:31.629264+0000","last_undegraded":"2024-04-17T15:41:31.629264+0000","last_fullsized":"2024-04-17T15:41:31.629264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.629060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.629060+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.629060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:44.224061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"130'16","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.792689+0000","last_change":"2024-04-17T15:41:28.792764+0000","last_active":"2024-04-17T15:41:28.792689+0000","last_peered":"2024-04-17T15:41:28.792689+0000","last_clean":"2024-04-17T15:41:28.792689+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:41:28.792689+0000","last_undegraded":"2024-04-17T15:41:28.792689+0000","last_fullsized":"2024-04-17T15:41:28.792689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-17T15:41:28.792469+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-17T15:41:28.792469+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.792469+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:00:34.058105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'138","reported_seq":402,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.218278+0000","last_change":"2024-04-17T15:37:02.271416+0000","last_active":"2024-04-17T15:41:11.218278+0000","last_peered":"2024-04-17T15:41:11.218278+0000","last_clean":"2024-04-17T15:41:11.218278+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:41:11.218278+0000","last_undegraded":"2024-04-17T15:41:11.218278+0000","last_fullsized":"2024-04-17T15:41:11.218278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207240+0000","last_change":"2024-04-17T15:37:04.264387+0000","last_active":"2024-04-17T15:40:58.207240+0000","last_peered":"2024-04-17T15:40:58.207240+0000","last_clean":"2024-04-17T15:40:58.207240+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:40:58.207240+0000","last_undegraded":"2024-04-17T15:40:58.207240+0000","last_fullsized":"2024-04-17T15:40:58.207240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.612912+0000","last_change":"2024-04-17T15:41:27.613037+0000","last_active":"2024-04-17T15:41:27.612912+0000","last_peered":"2024-04-17T15:41:27.612912+0000","last_clean":"2024-04-17T15:41:27.612912+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:41:27.612912+0000","last_undegraded":"2024-04-17T15:41:27.612912+0000","last_fullsized":"2024-04-17T15:41:27.612912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'12","last_scrub_stamp":"2024-04-17T15:41:27.612626+0000","last_deep_scrub":"98'12","last_deep_scrub_stamp":"2024-04-17T15:41:27.612626+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.612626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:39:17.082170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"130'64","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.410912+0000","last_change":"2024-04-17T15:41:27.410912+0000","last_active":"2024-04-17T15:41:27.410912+0000","last_peered":"2024-04-17T15:41:27.410912+0000","last_clean":"2024-04-17T15:41:27.410912+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:41:27.410912+0000","last_undegraded":"2024-04-17T15:41:27.410912+0000","last_fullsized":"2024-04-17T15:41:27.410912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'64","last_scrub_stamp":"2024-04-17T15:41:27.410662+0000","last_deep_scrub":"130'64","last_deep_scrub_stamp":"2024-04-17T15:41:27.410662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.410662+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:04.407705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.940346+0000","last_change":"2024-04-17T15:41:32.940497+0000","last_active":"2024-04-17T15:41:32.940346+0000","last_peered":"2024-04-17T15:41:32.940346+0000","last_clean":"2024-04-17T15:41:32.940346+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:41:32.940346+0000","last_undegraded":"2024-04-17T15:41:32.940346+0000","last_fullsized":"2024-04-17T15:41:32.940346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:32.940096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:32.940096+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.940096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:02.485981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"130'23","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.544410+0000","last_change":"2024-04-17T15:41:18.544489+0000","last_active":"2024-04-17T15:41:18.544410+0000","last_peered":"2024-04-17T15:41:18.544410+0000","last_clean":"2024-04-17T15:41:18.544410+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:41:18.544410+0000","last_undegraded":"2024-04-17T15:41:18.544410+0000","last_fullsized":"2024-04-17T15:41:18.544410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'23","last_scrub_stamp":"2024-04-17T15:41:18.544178+0000","last_deep_scrub":"130'23","last_deep_scrub_stamp":"2024-04-17T15:41:18.544178+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.544178+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:38:14.896230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'138","reported_seq":490,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.671477+0000","last_change":"2024-04-17T15:41:19.671540+0000","last_active":"2024-04-17T15:41:19.671477+0000","last_peered":"2024-04-17T15:41:19.671477+0000","last_clean":"2024-04-17T15:41:19.671477+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:41:19.671477+0000","last_undegraded":"2024-04-17T15:41:19.671477+0000","last_fullsized":"2024-04-17T15:41:19.671477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:19.671263+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:19.671263+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.671263+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:55.652499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.838593+0000","last_change":"2024-04-17T15:41:26.838726+0000","last_active":"2024-04-17T15:41:26.838593+0000","last_peered":"2024-04-17T15:41:26.838593+0000","last_clean":"2024-04-17T15:41:26.838593+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:41:26.838593+0000","last_undegraded":"2024-04-17T15:41:26.838593+0000","last_fullsized":"2024-04-17T15:41:26.838593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'6","last_scrub_stamp":"2024-04-17T15:41:26.838284+0000","last_deep_scrub":"112'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.838284+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.838284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:58.541347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"130'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.553846+0000","last_change":"2024-04-17T15:41:28.553916+0000","last_active":"2024-04-17T15:41:28.553846+0000","last_peered":"2024-04-17T15:41:28.553846+0000","last_clean":"2024-04-17T15:41:28.553846+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:41:28.553846+0000","last_undegraded":"2024-04-17T15:41:28.553846+0000","last_fullsized":"2024-04-17T15:41:28.553846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:28.553599+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:28.553599+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.553599+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.212311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.548510+0000","last_change":"2024-04-17T15:41:25.548695+0000","last_active":"2024-04-17T15:41:25.548510+0000","last_peered":"2024-04-17T15:41:25.548510+0000","last_clean":"2024-04-17T15:41:25.548510+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:41:25.548510+0000","last_undegraded":"2024-04-17T15:41:25.548510+0000","last_fullsized":"2024-04-17T15:41:25.548510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:25.548222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:25.548222+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.548222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:26.109015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"130'38","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.708552+0000","last_change":"2024-04-17T15:41:18.708552+0000","last_active":"2024-04-17T15:41:18.708552+0000","last_peered":"2024-04-17T15:41:18.708552+0000","last_clean":"2024-04-17T15:41:18.708552+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:41:18.708552+0000","last_undegraded":"2024-04-17T15:41:18.708552+0000","last_fullsized":"2024-04-17T15:41:18.708552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:18.708164+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:18.708164+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.708164+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:16.944227+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.755124+0000","last_change":"2024-04-17T15:37:02.272904+0000","last_active":"2024-04-17T15:41:14.755124+0000","last_peered":"2024-04-17T15:41:14.755124+0000","last_clean":"2024-04-17T15:41:14.755124+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:41:14.755124+0000","last_undegraded":"2024-04-17T15:41:14.755124+0000","last_fullsized":"2024-04-17T15:41:14.755124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.328041+0000","last_change":"2024-04-17T15:37:04.293523+0000","last_active":"2024-04-17T15:41:16.328041+0000","last_peered":"2024-04-17T15:41:16.328041+0000","last_clean":"2024-04-17T15:41:16.328041+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:41:16.328041+0000","last_undegraded":"2024-04-17T15:41:16.328041+0000","last_fullsized":"2024-04-17T15:41:16.328041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.202042+0000","last_change":"2024-04-17T15:36:56.181274+0000","last_active":"2024-04-17T15:41:16.202042+0000","last_peered":"2024-04-17T15:41:16.202042+0000","last_clean":"2024-04-17T15:41:16.202042+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:41:16.202042+0000","last_undegraded":"2024-04-17T15:41:16.202042+0000","last_fullsized":"2024-04-17T15:41:16.202042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"130'22","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.511631+0000","last_change":"2024-04-17T15:41:30.511692+0000","last_active":"2024-04-17T15:41:30.511631+0000","last_peered":"2024-04-17T15:41:30.511631+0000","last_clean":"2024-04-17T15:41:30.511631+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:41:30.511631+0000","last_undegraded":"2024-04-17T15:41:30.511631+0000","last_fullsized":"2024-04-17T15:41:30.511631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'22","last_scrub_stamp":"2024-04-17T15:41:30.511439+0000","last_deep_scrub":"130'22","last_deep_scrub_stamp":"2024-04-17T15:41:30.511439+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.511439+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:07.923890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.882775+0000","last_change":"2024-04-17T15:41:15.882775+0000","last_active":"2024-04-17T15:41:15.882775+0000","last_peered":"2024-04-17T15:41:15.882775+0000","last_clean":"2024-04-17T15:41:15.882775+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:41:15.882775+0000","last_undegraded":"2024-04-17T15:41:15.882775+0000","last_fullsized":"2024-04-17T15:41:15.882775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.882598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.882598+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.882598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:40:28.164354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"130'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.726905+0000","last_change":"2024-04-17T15:37:00.258688+0000","last_active":"2024-04-17T15:41:15.726905+0000","last_peered":"2024-04-17T15:41:15.726905+0000","last_clean":"2024-04-17T15:41:15.726905+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:41:15.726905+0000","last_undegraded":"2024-04-17T15:41:15.726905+0000","last_fullsized":"2024-04-17T15:41:15.726905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.664017+0000","last_change":"2024-04-17T15:41:23.664075+0000","last_active":"2024-04-17T15:41:23.664017+0000","last_peered":"2024-04-17T15:41:23.664017+0000","last_clean":"2024-04-17T15:41:23.664017+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:41:23.664017+0000","last_undegraded":"2024-04-17T15:41:23.664017+0000","last_fullsized":"2024-04-17T15:41:23.664017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.663756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.663756+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.663756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:56:55.726756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.317595+0000","last_change":"2024-04-17T15:37:04.280579+0000","last_active":"2024-04-17T15:41:16.317595+0000","last_peered":"2024-04-17T15:41:16.317595+0000","last_clean":"2024-04-17T15:41:16.317595+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:41:16.317595+0000","last_undegraded":"2024-04-17T15:41:16.317595+0000","last_fullsized":"2024-04-17T15:41:16.317595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.324344+0000","last_change":"2024-04-17T15:41:21.324413+0000","last_active":"2024-04-17T15:41:21.324344+0000","last_peered":"2024-04-17T15:41:21.324344+0000","last_clean":"2024-04-17T15:41:21.324344+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:41:21.324344+0000","last_undegraded":"2024-04-17T15:41:21.324344+0000","last_fullsized":"2024-04-17T15:41:21.324344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'8","last_scrub_stamp":"2024-04-17T15:41:21.324137+0000","last_deep_scrub":"112'8","last_deep_scrub_stamp":"2024-04-17T15:41:21.324137+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.324137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:47:21.947173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"130'40","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.655834+0000","last_change":"2024-04-17T15:36:54.206287+0000","last_active":"2024-04-17T15:41:17.655834+0000","last_peered":"2024-04-17T15:41:17.655834+0000","last_clean":"2024-04-17T15:41:17.655834+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:41:17.655834+0000","last_undegraded":"2024-04-17T15:41:17.655834+0000","last_fullsized":"2024-04-17T15:41:17.655834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.920383+0000","last_change":"2024-04-17T15:41:16.920383+0000","last_active":"2024-04-17T15:41:16.920383+0000","last_peered":"2024-04-17T15:41:16.920383+0000","last_clean":"2024-04-17T15:41:16.920383+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:41:16.920383+0000","last_undegraded":"2024-04-17T15:41:16.920383+0000","last_fullsized":"2024-04-17T15:41:16.920383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.920269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.920269+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.920269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:30.123465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"130'35","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.494452+0000","last_change":"2024-04-17T15:41:31.494534+0000","last_active":"2024-04-17T15:41:31.494452+0000","last_peered":"2024-04-17T15:41:31.494452+0000","last_clean":"2024-04-17T15:41:31.494452+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:41:31.494452+0000","last_undegraded":"2024-04-17T15:41:31.494452+0000","last_fullsized":"2024-04-17T15:41:31.494452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'35","last_scrub_stamp":"2024-04-17T15:41:31.494253+0000","last_deep_scrub":"130'35","last_deep_scrub_stamp":"2024-04-17T15:41:31.494253+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.494253+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:03.693316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":151,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"130'138","reported_seq":406,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.290131+0000","last_change":"2024-04-17T15:37:02.287756+0000","last_active":"2024-04-17T15:41:14.290131+0000","last_peered":"2024-04-17T15:41:14.290131+0000","last_clean":"2024-04-17T15:41:14.290131+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:41:14.290131+0000","last_undegraded":"2024-04-17T15:41:14.290131+0000","last_fullsized":"2024-04-17T15:41:14.290131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.290309+0000","last_change":"2024-04-17T15:37:04.285612+0000","last_active":"2024-04-17T15:41:14.290309+0000","last_peered":"2024-04-17T15:41:14.290309+0000","last_clean":"2024-04-17T15:41:14.290309+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:41:14.290309+0000","last_undegraded":"2024-04-17T15:41:14.290309+0000","last_fullsized":"2024-04-17T15:41:14.290309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.674154+0000","last_change":"2024-04-17T15:41:31.674211+0000","last_active":"2024-04-17T15:41:31.674154+0000","last_peered":"2024-04-17T15:41:31.674154+0000","last_clean":"2024-04-17T15:41:31.674154+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:41:31.674154+0000","last_undegraded":"2024-04-17T15:41:31.674154+0000","last_fullsized":"2024-04-17T15:41:31.674154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.673958+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:31.641587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"130'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.671421+0000","last_change":"2024-04-17T15:36:54.180748+0000","last_active":"2024-04-17T15:41:16.671421+0000","last_peered":"2024-04-17T15:41:16.671421+0000","last_clean":"2024-04-17T15:41:16.671421+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:41:16.671421+0000","last_undegraded":"2024-04-17T15:41:16.671421+0000","last_fullsized":"2024-04-17T15:41:16.671421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.974163+0000","last_change":"2024-04-17T15:41:19.974163+0000","last_active":"2024-04-17T15:41:19.974163+0000","last_peered":"2024-04-17T15:41:19.974163+0000","last_clean":"2024-04-17T15:41:19.974163+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:41:19.974163+0000","last_undegraded":"2024-04-17T15:41:19.974163+0000","last_fullsized":"2024-04-17T15:41:19.974163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.973921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.973921+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.973921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:46.132982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"130'39","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.676347+0000","last_change":"2024-04-17T15:41:34.676425+0000","last_active":"2024-04-17T15:41:34.676347+0000","last_peered":"2024-04-17T15:41:34.676347+0000","last_clean":"2024-04-17T15:41:34.676347+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:41:34.676347+0000","last_undegraded":"2024-04-17T15:41:34.676347+0000","last_fullsized":"2024-04-17T15:41:34.676347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'39","last_scrub_stamp":"2024-04-17T15:41:34.676154+0000","last_deep_scrub":"130'39","last_deep_scrub_stamp":"2024-04-17T15:41:34.676154+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.676154+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:37:52.273303+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.747022+0000","last_change":"2024-04-17T15:41:30.747076+0000","last_active":"2024-04-17T15:41:30.747022+0000","last_peered":"2024-04-17T15:41:30.747022+0000","last_clean":"2024-04-17T15:41:30.747022+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:41:30.747022+0000","last_undegraded":"2024-04-17T15:41:30.747022+0000","last_fullsized":"2024-04-17T15:41:30.747022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:30.746811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:30.746811+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.746811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:07:17.390374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":243,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.755283+0000","last_change":"2024-04-17T15:37:04.297172+0000","last_active":"2024-04-17T15:41:14.755283+0000","last_peered":"2024-04-17T15:41:14.755283+0000","last_clean":"2024-04-17T15:41:14.755283+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:41:14.755283+0000","last_undegraded":"2024-04-17T15:41:14.755283+0000","last_fullsized":"2024-04-17T15:41:14.755283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.202084+0000","last_change":"2024-04-17T15:36:56.186614+0000","last_active":"2024-04-17T15:41:16.202084+0000","last_peered":"2024-04-17T15:41:16.202084+0000","last_clean":"2024-04-17T15:41:16.202084+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:41:16.202084+0000","last_undegraded":"2024-04-17T15:41:16.202084+0000","last_fullsized":"2024-04-17T15:41:16.202084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"130'42","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.726398+0000","last_change":"2024-04-17T15:36:54.177780+0000","last_active":"2024-04-17T15:41:15.726398+0000","last_peered":"2024-04-17T15:41:15.726398+0000","last_clean":"2024-04-17T15:41:15.726398+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:41:15.726398+0000","last_undegraded":"2024-04-17T15:41:15.726398+0000","last_fullsized":"2024-04-17T15:41:15.726398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.003296+0000","last_change":"2024-04-17T15:41:19.003296+0000","last_active":"2024-04-17T15:41:19.003296+0000","last_peered":"2024-04-17T15:41:19.003296+0000","last_clean":"2024-04-17T15:41:19.003296+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:41:19.003296+0000","last_undegraded":"2024-04-17T15:41:19.003296+0000","last_fullsized":"2024-04-17T15:41:19.003296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.003037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.003037+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.003037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:36:30.103992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"130'26","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.859010+0000","last_change":"2024-04-17T15:41:17.859010+0000","last_active":"2024-04-17T15:41:17.859010+0000","last_peered":"2024-04-17T15:41:17.859010+0000","last_clean":"2024-04-17T15:41:17.859010+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:41:17.859010+0000","last_undegraded":"2024-04-17T15:41:17.859010+0000","last_fullsized":"2024-04-17T15:41:17.859010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:17.858698+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:17.858698+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.858698+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:49.387644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.573820+0000","last_change":"2024-04-17T15:41:20.573820+0000","last_active":"2024-04-17T15:41:20.573820+0000","last_peered":"2024-04-17T15:41:20.573820+0000","last_clean":"2024-04-17T15:41:20.573820+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:41:20.573820+0000","last_undegraded":"2024-04-17T15:41:20.573820+0000","last_fullsized":"2024-04-17T15:41:20.573820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.573596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.573596+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.573596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:08.232307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"71'1","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.447557+0000","last_change":"2024-04-17T15:37:04.297110+0000","last_active":"2024-04-17T15:41:06.447557+0000","last_peered":"2024-04-17T15:41:06.447557+0000","last_clean":"2024-04-17T15:41:06.447557+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:41:06.447557+0000","last_undegraded":"2024-04-17T15:41:06.447557+0000","last_fullsized":"2024-04-17T15:41:06.447557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.931854+0000","last_change":"2024-04-17T15:41:23.931854+0000","last_active":"2024-04-17T15:41:23.931854+0000","last_peered":"2024-04-17T15:41:23.931854+0000","last_clean":"2024-04-17T15:41:23.931854+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:41:23.931854+0000","last_undegraded":"2024-04-17T15:41:23.931854+0000","last_fullsized":"2024-04-17T15:41:23.931854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.931597+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.931597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:26:48.545570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"130'54","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.418665+0000","last_change":"2024-04-17T15:41:28.418733+0000","last_active":"2024-04-17T15:41:28.418665+0000","last_peered":"2024-04-17T15:41:28.418665+0000","last_clean":"2024-04-17T15:41:28.418665+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:41:28.418665+0000","last_undegraded":"2024-04-17T15:41:28.418665+0000","last_fullsized":"2024-04-17T15:41:28.418665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'54","last_scrub_stamp":"2024-04-17T15:41:28.418456+0000","last_deep_scrub":"130'54","last_deep_scrub_stamp":"2024-04-17T15:41:28.418456+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.418456+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:14.332579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.410798+0000","last_change":"2024-04-17T15:41:16.410798+0000","last_active":"2024-04-17T15:41:16.410798+0000","last_peered":"2024-04-17T15:41:16.410798+0000","last_clean":"2024-04-17T15:41:16.410798+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:41:16.410798+0000","last_undegraded":"2024-04-17T15:41:16.410798+0000","last_fullsized":"2024-04-17T15:41:16.410798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.410708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.410708+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.410708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:20:21.792199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"130'32","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.797272+0000","last_change":"2024-04-17T15:41:29.797272+0000","last_active":"2024-04-17T15:41:29.797272+0000","last_peered":"2024-04-17T15:41:29.797272+0000","last_clean":"2024-04-17T15:41:29.797272+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:41:29.797272+0000","last_undegraded":"2024-04-17T15:41:29.797272+0000","last_fullsized":"2024-04-17T15:41:29.797272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:29.797005+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:29.797005+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.797005+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:19:47.460252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"130'138","reported_seq":457,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.763214+0000","last_change":"2024-04-17T15:41:31.763280+0000","last_active":"2024-04-17T15:41:31.763214+0000","last_peered":"2024-04-17T15:41:31.763214+0000","last_clean":"2024-04-17T15:41:31.763214+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:41:31.763214+0000","last_undegraded":"2024-04-17T15:41:31.763214+0000","last_fullsized":"2024-04-17T15:41:31.763214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:31.762996+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:31.762996+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.762996+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:11.486658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.755164+0000","last_change":"2024-04-17T15:37:04.277768+0000","last_active":"2024-04-17T15:41:14.755164+0000","last_peered":"2024-04-17T15:41:14.755164+0000","last_clean":"2024-04-17T15:41:14.755164+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:41:14.755164+0000","last_undegraded":"2024-04-17T15:41:14.755164+0000","last_fullsized":"2024-04-17T15:41:14.755164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.988205+0000","last_change":"2024-04-17T15:41:21.988205+0000","last_active":"2024-04-17T15:41:21.988205+0000","last_peered":"2024-04-17T15:41:21.988205+0000","last_clean":"2024-04-17T15:41:21.988205+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:41:21.988205+0000","last_undegraded":"2024-04-17T15:41:21.988205+0000","last_fullsized":"2024-04-17T15:41:21.988205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-17T15:41:21.987932+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-17T15:41:21.987932+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.987932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:37:21.925709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"130'48","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.201760+0000","last_change":"2024-04-17T15:36:54.184531+0000","last_active":"2024-04-17T15:41:16.201760+0000","last_peered":"2024-04-17T15:41:16.201760+0000","last_clean":"2024-04-17T15:41:16.201760+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:41:16.201760+0000","last_undegraded":"2024-04-17T15:41:16.201760+0000","last_fullsized":"2024-04-17T15:41:16.201760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"130'4","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.974117+0000","last_change":"2024-04-17T15:41:34.974187+0000","last_active":"2024-04-17T15:41:34.974117+0000","last_peered":"2024-04-17T15:41:34.974117+0000","last_clean":"2024-04-17T15:41:34.974117+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:41:34.974117+0000","last_undegraded":"2024-04-17T15:41:34.974117+0000","last_fullsized":"2024-04-17T15:41:34.974117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'4","last_scrub_stamp":"2024-04-17T15:41:34.973920+0000","last_deep_scrub":"130'4","last_deep_scrub_stamp":"2024-04-17T15:41:34.973920+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.973920+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:37.079372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"130'15","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.716392+0000","last_change":"2024-04-17T15:41:20.716392+0000","last_active":"2024-04-17T15:41:20.716392+0000","last_peered":"2024-04-17T15:41:20.716392+0000","last_clean":"2024-04-17T15:41:20.716392+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:41:20.716392+0000","last_undegraded":"2024-04-17T15:41:20.716392+0000","last_fullsized":"2024-04-17T15:41:20.716392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'15","last_scrub_stamp":"2024-04-17T15:41:20.715961+0000","last_deep_scrub":"130'15","last_deep_scrub_stamp":"2024-04-17T15:41:20.715961+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.715961+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:31.497504+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"130'138","reported_seq":464,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.386431+0000","last_change":"2024-04-17T15:41:34.386500+0000","last_active":"2024-04-17T15:41:34.386431+0000","last_peered":"2024-04-17T15:41:34.386431+0000","last_clean":"2024-04-17T15:41:34.386431+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:41:34.386431+0000","last_undegraded":"2024-04-17T15:41:34.386431+0000","last_fullsized":"2024-04-17T15:41:34.386431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:34.386200+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:34.386200+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.386200+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:34.946993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.203168+0000","last_change":"2024-04-17T15:37:04.278694+0000","last_active":"2024-04-17T15:41:16.203168+0000","last_peered":"2024-04-17T15:41:16.203168+0000","last_clean":"2024-04-17T15:41:16.203168+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:41:16.203168+0000","last_undegraded":"2024-04-17T15:41:16.203168+0000","last_fullsized":"2024-04-17T15:41:16.203168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.539306+0000","last_change":"2024-04-17T15:41:27.539373+0000","last_active":"2024-04-17T15:41:27.539306+0000","last_peered":"2024-04-17T15:41:27.539306+0000","last_clean":"2024-04-17T15:41:27.539306+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:41:27.539306+0000","last_undegraded":"2024-04-17T15:41:27.539306+0000","last_fullsized":"2024-04-17T15:41:27.539306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:27.539086+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:27.539086+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.539086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:03.547611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"130'58","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.726384+0000","last_change":"2024-04-17T15:36:54.173330+0000","last_active":"2024-04-17T15:41:15.726384+0000","last_peered":"2024-04-17T15:41:15.726384+0000","last_clean":"2024-04-17T15:41:15.726384+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:41:15.726384+0000","last_undegraded":"2024-04-17T15:41:15.726384+0000","last_fullsized":"2024-04-17T15:41:15.726384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.103273+0000","last_change":"2024-04-17T15:41:36.103328+0000","last_active":"2024-04-17T15:41:36.103273+0000","last_peered":"2024-04-17T15:41:36.103273+0000","last_clean":"2024-04-17T15:41:36.103273+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:41:36.103273+0000","last_undegraded":"2024-04-17T15:41:36.103273+0000","last_fullsized":"2024-04-17T15:41:36.103273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:36.103079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:36.103079+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.103079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:38.208530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"130'28","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.672228+0000","last_change":"2024-04-17T15:37:00.249705+0000","last_active":"2024-04-17T15:41:16.672228+0000","last_peered":"2024-04-17T15:41:16.672228+0000","last_clean":"2024-04-17T15:41:16.672228+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:41:16.672228+0000","last_undegraded":"2024-04-17T15:41:16.672228+0000","last_fullsized":"2024-04-17T15:41:16.672228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.162989+0000","last_change":"2024-04-17T15:37:02.284173+0000","last_active":"2024-04-17T15:41:17.162989+0000","last_peered":"2024-04-17T15:41:17.162989+0000","last_clean":"2024-04-17T15:41:17.162989+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:41:17.162989+0000","last_undegraded":"2024-04-17T15:41:17.162989+0000","last_fullsized":"2024-04-17T15:41:17.162989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.755325+0000","last_change":"2024-04-17T15:37:04.282188+0000","last_active":"2024-04-17T15:41:14.755325+0000","last_peered":"2024-04-17T15:41:14.755325+0000","last_clean":"2024-04-17T15:41:14.755325+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:41:14.755325+0000","last_undegraded":"2024-04-17T15:41:14.755325+0000","last_fullsized":"2024-04-17T15:41:14.755325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.399852+0000","last_change":"2024-04-17T15:41:19.400009+0000","last_active":"2024-04-17T15:41:19.399852+0000","last_peered":"2024-04-17T15:41:19.399852+0000","last_clean":"2024-04-17T15:41:19.399852+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:41:19.399852+0000","last_undegraded":"2024-04-17T15:41:19.399852+0000","last_fullsized":"2024-04-17T15:41:19.399852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:19.399591+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:19.399591+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.399591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:24:22.910688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":388,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512501+0000","last_change":"2024-04-17T15:36:48.283790+0000","last_active":"2024-04-17T15:40:58.512501+0000","last_peered":"2024-04-17T15:40:58.512501+0000","last_clean":"2024-04-17T15:40:58.512501+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:40:58.512501+0000","last_undegraded":"2024-04-17T15:40:58.512501+0000","last_fullsized":"2024-04-17T15:40:58.512501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:01.325156+0000","last_change":"2024-04-17T15:36:48.075224+0000","last_active":"2024-04-17T15:41:01.325156+0000","last_peered":"2024-04-17T15:41:01.325156+0000","last_clean":"2024-04-17T15:41:01.325156+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:41:01.325156+0000","last_undegraded":"2024-04-17T15:41:01.325156+0000","last_fullsized":"2024-04-17T15:41:01.325156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"130'40","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.111231+0000","last_change":"2024-04-17T15:36:54.177036+0000","last_active":"2024-04-17T15:41:11.111231+0000","last_peered":"2024-04-17T15:41:11.111231+0000","last_clean":"2024-04-17T15:41:11.111231+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:41:11.111231+0000","last_undegraded":"2024-04-17T15:41:11.111231+0000","last_fullsized":"2024-04-17T15:41:11.111231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.505160+0000","last_change":"2024-04-17T15:41:27.505218+0000","last_active":"2024-04-17T15:41:27.505160+0000","last_peered":"2024-04-17T15:41:27.505160+0000","last_clean":"2024-04-17T15:41:27.505160+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:41:27.505160+0000","last_undegraded":"2024-04-17T15:41:27.505160+0000","last_fullsized":"2024-04-17T15:41:27.505160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:27.504920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:27.504920+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.504920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:57.500364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"130'48","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.723889+0000","last_change":"2024-04-17T15:41:19.723889+0000","last_active":"2024-04-17T15:41:19.723889+0000","last_peered":"2024-04-17T15:41:19.723889+0000","last_clean":"2024-04-17T15:41:19.723889+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:41:19.723889+0000","last_undegraded":"2024-04-17T15:41:19.723889+0000","last_fullsized":"2024-04-17T15:41:19.723889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:19.723620+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:19.723620+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.723620+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:39.363853+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.633668+0000","last_change":"2024-04-17T15:41:17.633668+0000","last_active":"2024-04-17T15:41:17.633668+0000","last_peered":"2024-04-17T15:41:17.633668+0000","last_clean":"2024-04-17T15:41:17.633668+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:41:17.633668+0000","last_undegraded":"2024-04-17T15:41:17.633668+0000","last_fullsized":"2024-04-17T15:41:17.633668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.633428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.633428+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.633428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:26:42.247400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.163153+0000","last_change":"2024-04-17T15:37:04.283246+0000","last_active":"2024-04-17T15:41:17.163153+0000","last_peered":"2024-04-17T15:41:17.163153+0000","last_clean":"2024-04-17T15:41:17.163153+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:41:17.163153+0000","last_undegraded":"2024-04-17T15:41:17.163153+0000","last_fullsized":"2024-04-17T15:41:17.163153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.578723+0000","last_change":"2024-04-17T15:41:25.578792+0000","last_active":"2024-04-17T15:41:25.578723+0000","last_peered":"2024-04-17T15:41:25.578723+0000","last_clean":"2024-04-17T15:41:25.578723+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:41:25.578723+0000","last_undegraded":"2024-04-17T15:41:25.578723+0000","last_fullsized":"2024-04-17T15:41:25.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'16","last_scrub_stamp":"2024-04-17T15:41:25.578500+0000","last_deep_scrub":"112'16","last_deep_scrub_stamp":"2024-04-17T15:41:25.578500+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.578500+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:10.771333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.512014+0000","last_change":"2024-04-17T15:36:48.074808+0000","last_active":"2024-04-17T15:40:58.512014+0000","last_peered":"2024-04-17T15:40:58.512014+0000","last_clean":"2024-04-17T15:40:58.512014+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:40:58.512014+0000","last_undegraded":"2024-04-17T15:40:58.512014+0000","last_fullsized":"2024-04-17T15:40:58.512014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"130'56","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.162753+0000","last_change":"2024-04-17T15:36:54.200177+0000","last_active":"2024-04-17T15:41:11.162753+0000","last_peered":"2024-04-17T15:41:11.162753+0000","last_clean":"2024-04-17T15:41:11.162753+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:41:11.162753+0000","last_undegraded":"2024-04-17T15:41:11.162753+0000","last_fullsized":"2024-04-17T15:41:11.162753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"130'2","reported_seq":327,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.883480+0000","last_change":"2024-04-17T15:41:30.883549+0000","last_active":"2024-04-17T15:41:30.883480+0000","last_peered":"2024-04-17T15:41:30.883480+0000","last_clean":"2024-04-17T15:41:30.883480+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:41:30.883480+0000","last_undegraded":"2024-04-17T15:41:30.883480+0000","last_fullsized":"2024-04-17T15:41:30.883480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:30.883291+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:30.883291+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.883291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:16.076124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"130'156","reported_seq":511,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.485445+0000","last_change":"2024-04-17T15:41:24.485530+0000","last_active":"2024-04-17T15:41:24.485445+0000","last_peered":"2024-04-17T15:41:24.485445+0000","last_clean":"2024-04-17T15:41:24.485445+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:41:24.485445+0000","last_undegraded":"2024-04-17T15:41:24.485445+0000","last_fullsized":"2024-04-17T15:41:24.485445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'156","last_scrub_stamp":"2024-04-17T15:41:24.485255+0000","last_deep_scrub":"130'156","last_deep_scrub_stamp":"2024-04-17T15:41:24.485255+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.485255+0000","objects_scrubbed":10,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:22.721318+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.520694+0000","last_change":"2024-04-17T15:41:19.520750+0000","last_active":"2024-04-17T15:41:19.520694+0000","last_peered":"2024-04-17T15:41:19.520694+0000","last_clean":"2024-04-17T15:41:19.520694+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:41:19.520694+0000","last_undegraded":"2024-04-17T15:41:19.520694+0000","last_fullsized":"2024-04-17T15:41:19.520694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.520254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.520254+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.520254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:02.719737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.755314+0000","last_change":"2024-04-17T15:37:04.265746+0000","last_active":"2024-04-17T15:41:14.755314+0000","last_peered":"2024-04-17T15:41:14.755314+0000","last_clean":"2024-04-17T15:41:14.755314+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:41:14.755314+0000","last_undegraded":"2024-04-17T15:41:14.755314+0000","last_fullsized":"2024-04-17T15:41:14.755314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.371151+0000","last_change":"2024-04-17T15:41:15.371151+0000","last_active":"2024-04-17T15:41:15.371151+0000","last_peered":"2024-04-17T15:41:15.371151+0000","last_clean":"2024-04-17T15:41:15.371151+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:41:15.371151+0000","last_undegraded":"2024-04-17T15:41:15.371151+0000","last_fullsized":"2024-04-17T15:41:15.371151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.371032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.371032+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.371032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:03.976479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.958911+0000","last_change":"2024-04-17T15:41:20.958967+0000","last_active":"2024-04-17T15:41:20.958911+0000","last_peered":"2024-04-17T15:41:20.958911+0000","last_clean":"2024-04-17T15:41:20.958911+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:41:20.958911+0000","last_undegraded":"2024-04-17T15:41:20.958911+0000","last_fullsized":"2024-04-17T15:41:20.958911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.958694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.958694+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.958694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:17:27.161135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"130'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.538296+0000","last_change":"2024-04-17T15:41:31.538435+0000","last_active":"2024-04-17T15:41:31.538296+0000","last_peered":"2024-04-17T15:41:31.538296+0000","last_clean":"2024-04-17T15:41:31.538296+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:41:31.538296+0000","last_undegraded":"2024-04-17T15:41:31.538296+0000","last_fullsized":"2024-04-17T15:41:31.538296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:31.537911+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:31.537911+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.537911+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:19.196623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"130'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.973550+0000","last_change":"2024-04-17T15:41:17.973550+0000","last_active":"2024-04-17T15:41:17.973550+0000","last_peered":"2024-04-17T15:41:17.973550+0000","last_clean":"2024-04-17T15:41:17.973550+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:41:17.973550+0000","last_undegraded":"2024-04-17T15:41:17.973550+0000","last_fullsized":"2024-04-17T15:41:17.973550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:17.973240+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:17.973240+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.973240+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:52:50.450436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'24","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.483241+0000","last_change":"2024-04-17T15:41:20.483333+0000","last_active":"2024-04-17T15:41:20.483241+0000","last_peered":"2024-04-17T15:41:20.483241+0000","last_clean":"2024-04-17T15:41:20.483241+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:41:20.483241+0000","last_undegraded":"2024-04-17T15:41:20.483241+0000","last_fullsized":"2024-04-17T15:41:20.483241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:20.483050+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:20.483050+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.483050+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:37:49.043173+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.593731+0000","last_change":"2024-04-17T15:41:16.593786+0000","last_active":"2024-04-17T15:41:16.593731+0000","last_peered":"2024-04-17T15:41:16.593731+0000","last_clean":"2024-04-17T15:41:16.593731+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:41:16.593731+0000","last_undegraded":"2024-04-17T15:41:16.593731+0000","last_fullsized":"2024-04-17T15:41:16.593731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.593549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.593549+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.593549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:32:36.369768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.727122+0000","last_change":"2024-04-17T15:37:04.297675+0000","last_active":"2024-04-17T15:41:15.727122+0000","last_peered":"2024-04-17T15:41:15.727122+0000","last_clean":"2024-04-17T15:41:15.727122+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:41:15.727122+0000","last_undegraded":"2024-04-17T15:41:15.727122+0000","last_fullsized":"2024-04-17T15:41:15.727122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.474447+0000","last_change":"2024-04-17T15:41:23.474580+0000","last_active":"2024-04-17T15:41:23.474447+0000","last_peered":"2024-04-17T15:41:23.474447+0000","last_clean":"2024-04-17T15:41:23.474447+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:41:23.474447+0000","last_undegraded":"2024-04-17T15:41:23.474447+0000","last_fullsized":"2024-04-17T15:41:23.474447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-17T15:41:23.474143+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.474143+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.474143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:37:52.034266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:59.126569+0000","last_change":"2024-04-17T15:36:48.075476+0000","last_active":"2024-04-17T15:40:59.126569+0000","last_peered":"2024-04-17T15:40:59.126569+0000","last_clean":"2024-04-17T15:40:59.126569+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:40:59.126569+0000","last_undegraded":"2024-04-17T15:40:59.126569+0000","last_fullsized":"2024-04-17T15:40:59.126569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"130'48","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.199611+0000","last_change":"2024-04-17T15:36:54.179879+0000","last_active":"2024-04-17T15:41:11.199611+0000","last_peered":"2024-04-17T15:41:11.199611+0000","last_clean":"2024-04-17T15:41:11.199611+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:41:11.199611+0000","last_undegraded":"2024-04-17T15:41:11.199611+0000","last_fullsized":"2024-04-17T15:41:11.199611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.587358+0000","last_change":"2024-04-17T15:41:28.587481+0000","last_active":"2024-04-17T15:41:28.587358+0000","last_peered":"2024-04-17T15:41:28.587358+0000","last_clean":"2024-04-17T15:41:28.587358+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:41:28.587358+0000","last_undegraded":"2024-04-17T15:41:28.587358+0000","last_fullsized":"2024-04-17T15:41:28.587358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.587010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.587010+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.587010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:30.754705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"77'13","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.727237+0000","last_change":"2024-04-17T15:37:00.257384+0000","last_active":"2024-04-17T15:41:15.727237+0000","last_peered":"2024-04-17T15:41:15.727237+0000","last_clean":"2024-04-17T15:41:15.727237+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:41:15.727237+0000","last_undegraded":"2024-04-17T15:41:15.727237+0000","last_fullsized":"2024-04-17T15:41:15.727237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.163121+0000","last_change":"2024-04-17T15:37:02.271483+0000","last_active":"2024-04-17T15:41:17.163121+0000","last_peered":"2024-04-17T15:41:17.163121+0000","last_clean":"2024-04-17T15:41:17.163121+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:41:17.163121+0000","last_undegraded":"2024-04-17T15:41:17.163121+0000","last_fullsized":"2024-04-17T15:41:17.163121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.672337+0000","last_change":"2024-04-17T15:37:04.304044+0000","last_active":"2024-04-17T15:41:16.672337+0000","last_peered":"2024-04-17T15:41:16.672337+0000","last_clean":"2024-04-17T15:41:16.672337+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:41:16.672337+0000","last_undegraded":"2024-04-17T15:41:16.672337+0000","last_fullsized":"2024-04-17T15:41:16.672337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.435512+0000","last_change":"2024-04-17T15:41:19.435573+0000","last_active":"2024-04-17T15:41:19.435512+0000","last_peered":"2024-04-17T15:41:19.435512+0000","last_clean":"2024-04-17T15:41:19.435512+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:41:19.435512+0000","last_undegraded":"2024-04-17T15:41:19.435512+0000","last_fullsized":"2024-04-17T15:41:19.435512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-17T15:41:19.435287+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-17T15:41:19.435287+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.435287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:03.479658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.975846+0000","last_change":"2024-04-17T15:41:35.975908+0000","last_active":"2024-04-17T15:41:35.975846+0000","last_peered":"2024-04-17T15:41:35.975846+0000","last_clean":"2024-04-17T15:41:35.975846+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:41:35.975846+0000","last_undegraded":"2024-04-17T15:41:35.975846+0000","last_fullsized":"2024-04-17T15:41:35.975846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:35.975645+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:35.975645+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.975645+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:57:32.977017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.560233+0000","last_change":"2024-04-17T15:41:29.560287+0000","last_active":"2024-04-17T15:41:29.560233+0000","last_peered":"2024-04-17T15:41:29.560233+0000","last_clean":"2024-04-17T15:41:29.560233+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:41:29.560233+0000","last_undegraded":"2024-04-17T15:41:29.560233+0000","last_fullsized":"2024-04-17T15:41:29.560233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:29.560033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:29.560033+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.560033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:32.526290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.651601+0000","last_change":"2024-04-17T15:41:30.651711+0000","last_active":"2024-04-17T15:41:30.651601+0000","last_peered":"2024-04-17T15:41:30.651601+0000","last_clean":"2024-04-17T15:41:30.651601+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:41:30.651601+0000","last_undegraded":"2024-04-17T15:41:30.651601+0000","last_fullsized":"2024-04-17T15:41:30.651601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:30.651296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:30.651296+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.651296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:57:27.652669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'46","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.613727+0000","last_change":"2024-04-17T15:41:21.613816+0000","last_active":"2024-04-17T15:41:21.613727+0000","last_peered":"2024-04-17T15:41:21.613727+0000","last_clean":"2024-04-17T15:41:21.613727+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:41:21.613727+0000","last_undegraded":"2024-04-17T15:41:21.613727+0000","last_fullsized":"2024-04-17T15:41:21.613727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:21.613527+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:21.613527+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.613527+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:53.316589+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.315360+0000","last_change":"2024-04-17T15:37:02.280780+0000","last_active":"2024-04-17T15:41:11.315360+0000","last_peered":"2024-04-17T15:41:11.315360+0000","last_clean":"2024-04-17T15:41:11.315360+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:41:11.315360+0000","last_undegraded":"2024-04-17T15:41:11.315360+0000","last_fullsized":"2024-04-17T15:41:11.315360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.290367+0000","last_change":"2024-04-17T15:37:04.284656+0000","last_active":"2024-04-17T15:41:14.290367+0000","last_peered":"2024-04-17T15:41:14.290367+0000","last_clean":"2024-04-17T15:41:14.290367+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:41:14.290367+0000","last_undegraded":"2024-04-17T15:41:14.290367+0000","last_fullsized":"2024-04-17T15:41:14.290367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.565847+0000","last_change":"2024-04-17T15:41:24.565913+0000","last_active":"2024-04-17T15:41:24.565847+0000","last_peered":"2024-04-17T15:41:24.565847+0000","last_clean":"2024-04-17T15:41:24.565847+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:41:24.565847+0000","last_undegraded":"2024-04-17T15:41:24.565847+0000","last_fullsized":"2024-04-17T15:41:24.565847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:24.565634+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:24.565634+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.565634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:37.328106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"130'42","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.476800+0000","last_change":"2024-04-17T15:41:33.476859+0000","last_active":"2024-04-17T15:41:33.476800+0000","last_peered":"2024-04-17T15:41:33.476800+0000","last_clean":"2024-04-17T15:41:33.476800+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:41:33.476800+0000","last_undegraded":"2024-04-17T15:41:33.476800+0000","last_fullsized":"2024-04-17T15:41:33.476800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:33.476604+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:33.476604+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.476604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:10.889055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:01.330038+0000","last_change":"2024-04-17T15:36:48.281947+0000","last_active":"2024-04-17T15:41:01.330038+0000","last_peered":"2024-04-17T15:41:01.330038+0000","last_clean":"2024-04-17T15:41:01.330038+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:41:01.330038+0000","last_undegraded":"2024-04-17T15:41:01.330038+0000","last_fullsized":"2024-04-17T15:41:01.330038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:47.052792+0000","last_clean_scrub_stamp":"2024-04-17T15:36:47.052792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.354296+0000","last_change":"2024-04-17T15:41:22.354371+0000","last_active":"2024-04-17T15:41:22.354296+0000","last_peered":"2024-04-17T15:41:22.354296+0000","last_clean":"2024-04-17T15:41:22.354296+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:41:22.354296+0000","last_undegraded":"2024-04-17T15:41:22.354296+0000","last_fullsized":"2024-04-17T15:41:22.354296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:22.354099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:22.354099+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.354099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:10:05.544157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"71'15","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.295908+0000","last_change":"2024-04-17T15:37:00.455519+0000","last_active":"2024-04-17T15:41:11.295908+0000","last_peered":"2024-04-17T15:41:11.295908+0000","last_clean":"2024-04-17T15:41:11.295908+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:41:11.295908+0000","last_undegraded":"2024-04-17T15:41:11.295908+0000","last_fullsized":"2024-04-17T15:41:11.295908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"130'138","reported_seq":413,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.654818+0000","last_change":"2024-04-17T15:41:17.654886+0000","last_active":"2024-04-17T15:41:17.654818+0000","last_peered":"2024-04-17T15:41:17.654818+0000","last_clean":"2024-04-17T15:41:17.654818+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:41:17.654818+0000","last_undegraded":"2024-04-17T15:41:17.654818+0000","last_fullsized":"2024-04-17T15:41:17.654818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:17.654603+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:17.654603+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.654603+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:49.183549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.727265+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:41:15.727265+0000","last_peered":"2024-04-17T15:41:15.727265+0000","last_clean":"2024-04-17T15:41:15.727265+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:41:15.727265+0000","last_undegraded":"2024-04-17T15:41:15.727265+0000","last_fullsized":"2024-04-17T15:41:15.727265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.657495+0000","last_change":"2024-04-17T15:41:30.657565+0000","last_active":"2024-04-17T15:41:30.657495+0000","last_peered":"2024-04-17T15:41:30.657495+0000","last_clean":"2024-04-17T15:41:30.657495+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:41:30.657495+0000","last_undegraded":"2024-04-17T15:41:30.657495+0000","last_fullsized":"2024-04-17T15:41:30.657495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-17T15:41:30.656952+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-17T15:41:30.656952+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.656952+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:13:38.069792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"130'38","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.726461+0000","last_change":"2024-04-17T15:36:54.203536+0000","last_active":"2024-04-17T15:41:15.726461+0000","last_peered":"2024-04-17T15:41:15.726461+0000","last_clean":"2024-04-17T15:41:15.726461+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:41:15.726461+0000","last_undegraded":"2024-04-17T15:41:15.726461+0000","last_fullsized":"2024-04-17T15:41:15.726461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.552965+0000","last_change":"2024-04-17T15:41:28.553023+0000","last_active":"2024-04-17T15:41:28.552965+0000","last_peered":"2024-04-17T15:41:28.552965+0000","last_clean":"2024-04-17T15:41:28.552965+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:41:28.552965+0000","last_undegraded":"2024-04-17T15:41:28.552965+0000","last_fullsized":"2024-04-17T15:41:28.552965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.552768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.552768+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.552768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:29.113561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.011972+0000","last_change":"2024-04-17T15:41:34.012036+0000","last_active":"2024-04-17T15:41:34.011972+0000","last_peered":"2024-04-17T15:41:34.011972+0000","last_clean":"2024-04-17T15:41:34.011972+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:41:34.011972+0000","last_undegraded":"2024-04-17T15:41:34.011972+0000","last_fullsized":"2024-04-17T15:41:34.011972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:34.011770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:34.011770+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.011770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:09.076736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'15","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.898748+0000","last_change":"2024-04-17T15:41:18.898829+0000","last_active":"2024-04-17T15:41:18.898748+0000","last_peered":"2024-04-17T15:41:18.898748+0000","last_clean":"2024-04-17T15:41:18.898748+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:41:18.898748+0000","last_undegraded":"2024-04-17T15:41:18.898748+0000","last_fullsized":"2024-04-17T15:41:18.898748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'15","last_scrub_stamp":"2024-04-17T15:41:18.898561+0000","last_deep_scrub":"130'15","last_deep_scrub_stamp":"2024-04-17T15:41:18.898561+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.898561+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:40:59.083402+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'138","reported_seq":405,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.448765+0000","last_change":"2024-04-17T15:37:02.285830+0000","last_active":"2024-04-17T15:41:11.448765+0000","last_peered":"2024-04-17T15:41:11.448765+0000","last_clean":"2024-04-17T15:41:11.448765+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:41:11.448765+0000","last_undegraded":"2024-04-17T15:41:11.448765+0000","last_fullsized":"2024-04-17T15:41:11.448765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.290182+0000","last_change":"2024-04-17T15:37:04.290828+0000","last_active":"2024-04-17T15:41:14.290182+0000","last_peered":"2024-04-17T15:41:14.290182+0000","last_clean":"2024-04-17T15:41:14.290182+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:41:14.290182+0000","last_undegraded":"2024-04-17T15:41:14.290182+0000","last_fullsized":"2024-04-17T15:41:14.290182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.986901+0000","last_change":"2024-04-17T15:41:27.986964+0000","last_active":"2024-04-17T15:41:27.986901+0000","last_peered":"2024-04-17T15:41:27.986901+0000","last_clean":"2024-04-17T15:41:27.986901+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:41:27.986901+0000","last_undegraded":"2024-04-17T15:41:27.986901+0000","last_fullsized":"2024-04-17T15:41:27.986901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:27.986679+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:27.986679+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.986679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:59.689742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"130'56","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.289080+0000","last_change":"2024-04-17T15:36:54.176752+0000","last_active":"2024-04-17T15:41:14.289080+0000","last_peered":"2024-04-17T15:41:14.289080+0000","last_clean":"2024-04-17T15:41:14.289080+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:41:14.289080+0000","last_undegraded":"2024-04-17T15:41:14.289080+0000","last_fullsized":"2024-04-17T15:41:14.289080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.373410+0000","last_change":"2024-04-17T15:41:26.373472+0000","last_active":"2024-04-17T15:41:26.373410+0000","last_peered":"2024-04-17T15:41:26.373410+0000","last_clean":"2024-04-17T15:41:26.373410+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:41:26.373410+0000","last_undegraded":"2024-04-17T15:41:26.373410+0000","last_fullsized":"2024-04-17T15:41:26.373410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:26.373211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:26.373211+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.373211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:50:56.566202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.575551+0000","last_change":"2024-04-17T15:41:33.575608+0000","last_active":"2024-04-17T15:41:33.575551+0000","last_peered":"2024-04-17T15:41:33.575551+0000","last_clean":"2024-04-17T15:41:33.575551+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:41:33.575551+0000","last_undegraded":"2024-04-17T15:41:33.575551+0000","last_fullsized":"2024-04-17T15:41:33.575551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:33.575347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:33.575347+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.575347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:54.599783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"130'57","reported_seq":306,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.331842+0000","last_change":"2024-04-17T15:37:00.455229+0000","last_active":"2024-04-17T15:41:11.331842+0000","last_peered":"2024-04-17T15:41:11.331842+0000","last_clean":"2024-04-17T15:41:11.331842+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:41:11.331842+0000","last_undegraded":"2024-04-17T15:41:11.331842+0000","last_fullsized":"2024-04-17T15:41:11.331842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":410,"num_write":38,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.616056+0000","last_change":"2024-04-17T15:41:17.616109+0000","last_active":"2024-04-17T15:41:17.616056+0000","last_peered":"2024-04-17T15:41:17.616056+0000","last_clean":"2024-04-17T15:41:17.616056+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:41:17.616056+0000","last_undegraded":"2024-04-17T15:41:17.616056+0000","last_fullsized":"2024-04-17T15:41:17.616056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.615825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.615825+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.615825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:40.729641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.672530+0000","last_change":"2024-04-17T15:37:04.288567+0000","last_active":"2024-04-17T15:41:16.672530+0000","last_peered":"2024-04-17T15:41:16.672530+0000","last_clean":"2024-04-17T15:41:16.672530+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:41:16.672530+0000","last_undegraded":"2024-04-17T15:41:16.672530+0000","last_fullsized":"2024-04-17T15:41:16.672530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.290287+0000","last_change":"2024-04-17T15:37:04.280641+0000","last_active":"2024-04-17T15:41:14.290287+0000","last_peered":"2024-04-17T15:41:14.290287+0000","last_clean":"2024-04-17T15:41:14.290287+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:41:14.290287+0000","last_undegraded":"2024-04-17T15:41:14.290287+0000","last_fullsized":"2024-04-17T15:41:14.290287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.956906+0000","last_change":"2024-04-17T15:41:24.956906+0000","last_active":"2024-04-17T15:41:24.956906+0000","last_peered":"2024-04-17T15:41:24.956906+0000","last_clean":"2024-04-17T15:41:24.956906+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:41:24.956906+0000","last_undegraded":"2024-04-17T15:41:24.956906+0000","last_fullsized":"2024-04-17T15:41:24.956906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:24.956622+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:24.956622+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.956622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:12.092172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"130'54","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.201780+0000","last_change":"2024-04-17T15:36:54.202020+0000","last_active":"2024-04-17T15:41:16.201780+0000","last_peered":"2024-04-17T15:41:16.201780+0000","last_clean":"2024-04-17T15:41:16.201780+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:41:16.201780+0000","last_undegraded":"2024-04-17T15:41:16.201780+0000","last_fullsized":"2024-04-17T15:41:16.201780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.413410+0000","last_change":"2024-04-17T15:41:18.413463+0000","last_active":"2024-04-17T15:41:18.413410+0000","last_peered":"2024-04-17T15:41:18.413410+0000","last_clean":"2024-04-17T15:41:18.413410+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:41:18.413410+0000","last_undegraded":"2024-04-17T15:41:18.413410+0000","last_fullsized":"2024-04-17T15:41:18.413410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.413210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.413210+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.413210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:44:25.659696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"130'26","reported_seq":267,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.692457+0000","last_change":"2024-04-17T15:41:22.692690+0000","last_active":"2024-04-17T15:41:22.692457+0000","last_peered":"2024-04-17T15:41:22.692457+0000","last_clean":"2024-04-17T15:41:22.692457+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:41:22.692457+0000","last_undegraded":"2024-04-17T15:41:22.692457+0000","last_fullsized":"2024-04-17T15:41:22.692457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:22.692221+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:22.692221+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.692221+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:31:39.418145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.588184+0000","last_change":"2024-04-17T15:41:16.588234+0000","last_active":"2024-04-17T15:41:16.588184+0000","last_peered":"2024-04-17T15:41:16.588184+0000","last_clean":"2024-04-17T15:41:16.588184+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:41:16.588184+0000","last_undegraded":"2024-04-17T15:41:16.588184+0000","last_fullsized":"2024-04-17T15:41:16.588184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.587982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.587982+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.587982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:58.647298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:06.447773+0000","last_change":"2024-04-17T15:37:04.301823+0000","last_active":"2024-04-17T15:41:06.447773+0000","last_peered":"2024-04-17T15:41:06.447773+0000","last_clean":"2024-04-17T15:41:06.447773+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:41:06.447773+0000","last_undegraded":"2024-04-17T15:41:06.447773+0000","last_fullsized":"2024-04-17T15:41:06.447773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":196,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205216+0000","last_change":"2024-04-17T15:37:41.434156+0000","last_active":"2024-04-17T15:40:58.205216+0000","last_peered":"2024-04-17T15:40:58.205216+0000","last_clean":"2024-04-17T15:40:58.205216+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:40:58.205216+0000","last_undegraded":"2024-04-17T15:40:58.205216+0000","last_fullsized":"2024-04-17T15:40:58.205216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"130'48","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.151243+0000","last_change":"2024-04-17T15:36:54.206828+0000","last_active":"2024-04-17T15:41:11.151243+0000","last_peered":"2024-04-17T15:41:11.151243+0000","last_clean":"2024-04-17T15:41:11.151243+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:41:11.151243+0000","last_undegraded":"2024-04-17T15:41:11.151243+0000","last_fullsized":"2024-04-17T15:41:11.151243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"130'2","reported_seq":326,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.594166+0000","last_change":"2024-04-17T15:41:35.594234+0000","last_active":"2024-04-17T15:41:35.594166+0000","last_peered":"2024-04-17T15:41:35.594166+0000","last_clean":"2024-04-17T15:41:35.594166+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:41:35.594166+0000","last_undegraded":"2024-04-17T15:41:35.594166+0000","last_fullsized":"2024-04-17T15:41:35.594166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:35.593954+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:35.593954+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.593954+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:24.960351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'9","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.869076+0000","last_change":"2024-04-17T15:37:00.261559+0000","last_active":"2024-04-17T15:40:58.869076+0000","last_peered":"2024-04-17T15:40:58.869076+0000","last_clean":"2024-04-17T15:40:58.869076+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:40:58.869076+0000","last_undegraded":"2024-04-17T15:40:58.869076+0000","last_fullsized":"2024-04-17T15:40:58.869076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511808+0000","last_change":"2024-04-17T15:37:02.272091+0000","last_active":"2024-04-17T15:40:58.511808+0000","last_peered":"2024-04-17T15:40:58.511808+0000","last_clean":"2024-04-17T15:40:58.511808+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:40:58.511808+0000","last_undegraded":"2024-04-17T15:40:58.511808+0000","last_fullsized":"2024-04-17T15:40:58.511808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.870546+0000","last_change":"2024-04-17T15:37:04.275451+0000","last_active":"2024-04-17T15:40:58.870546+0000","last_peered":"2024-04-17T15:40:58.870546+0000","last_clean":"2024-04-17T15:40:58.870546+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:40:58.870546+0000","last_undegraded":"2024-04-17T15:40:58.870546+0000","last_fullsized":"2024-04-17T15:40:58.870546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.612791+0000","last_change":"2024-04-17T15:41:29.612791+0000","last_active":"2024-04-17T15:41:29.612791+0000","last_peered":"2024-04-17T15:41:29.612791+0000","last_clean":"2024-04-17T15:41:29.612791+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:41:29.612791+0000","last_undegraded":"2024-04-17T15:41:29.612791+0000","last_fullsized":"2024-04-17T15:41:29.612791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:29.612509+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:29.612509+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.612509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:48:26.850872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"130'62","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.838432+0000","last_change":"2024-04-17T15:41:34.838496+0000","last_active":"2024-04-17T15:41:34.838432+0000","last_peered":"2024-04-17T15:41:34.838432+0000","last_clean":"2024-04-17T15:41:34.838432+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:41:34.838432+0000","last_undegraded":"2024-04-17T15:41:34.838432+0000","last_fullsized":"2024-04-17T15:41:34.838432+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'62","last_scrub_stamp":"2024-04-17T15:41:34.838245+0000","last_deep_scrub":"130'62","last_deep_scrub_stamp":"2024-04-17T15:41:34.838245+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.838245+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:46.266575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.493415+0000","last_change":"2024-04-17T15:41:23.493472+0000","last_active":"2024-04-17T15:41:23.493415+0000","last_peered":"2024-04-17T15:41:23.493415+0000","last_clean":"2024-04-17T15:41:23.493415+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:41:23.493415+0000","last_undegraded":"2024-04-17T15:41:23.493415+0000","last_fullsized":"2024-04-17T15:41:23.493415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.493211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.493211+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.493211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:31.172500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"130'26","reported_seq":267,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.718153+0000","last_change":"2024-04-17T15:41:21.718224+0000","last_active":"2024-04-17T15:41:21.718153+0000","last_peered":"2024-04-17T15:41:21.718153+0000","last_clean":"2024-04-17T15:41:21.718153+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:41:21.718153+0000","last_undegraded":"2024-04-17T15:41:21.718153+0000","last_fullsized":"2024-04-17T15:41:21.718153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:21.717955+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:21.717955+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.717955+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:52.277915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.418403+0000","last_change":"2024-04-17T15:41:35.418466+0000","last_active":"2024-04-17T15:41:35.418403+0000","last_peered":"2024-04-17T15:41:35.418403+0000","last_clean":"2024-04-17T15:41:35.418403+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:41:35.418403+0000","last_undegraded":"2024-04-17T15:41:35.418403+0000","last_fullsized":"2024-04-17T15:41:35.418403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:35.418155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:35.418155+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.418155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:38.384411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.206047+0000","last_change":"2024-04-17T15:37:04.288812+0000","last_active":"2024-04-17T15:40:58.206047+0000","last_peered":"2024-04-17T15:40:58.206047+0000","last_clean":"2024-04-17T15:40:58.206047+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:40:58.206047+0000","last_undegraded":"2024-04-17T15:40:58.206047+0000","last_fullsized":"2024-04-17T15:40:58.206047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.622129+0000","last_change":"2024-04-17T15:41:34.622129+0000","last_active":"2024-04-17T15:41:34.622129+0000","last_peered":"2024-04-17T15:41:34.622129+0000","last_clean":"2024-04-17T15:41:34.622129+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:41:34.622129+0000","last_undegraded":"2024-04-17T15:41:34.622129+0000","last_fullsized":"2024-04-17T15:41:34.622129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-17T15:41:34.621741+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-17T15:41:34.621741+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.621741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:49.137359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"130'56","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.172358+0000","last_change":"2024-04-17T15:36:54.181570+0000","last_active":"2024-04-17T15:41:11.172358+0000","last_peered":"2024-04-17T15:41:11.172358+0000","last_clean":"2024-04-17T15:41:11.172358+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:41:11.172358+0000","last_undegraded":"2024-04-17T15:41:11.172358+0000","last_fullsized":"2024-04-17T15:41:11.172358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.369559+0000","last_change":"2024-04-17T15:41:20.369623+0000","last_active":"2024-04-17T15:41:20.369559+0000","last_peered":"2024-04-17T15:41:20.369559+0000","last_clean":"2024-04-17T15:41:20.369559+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:41:20.369559+0000","last_undegraded":"2024-04-17T15:41:20.369559+0000","last_fullsized":"2024-04-17T15:41:20.369559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.369359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.369359+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.369359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:36:34.772497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"130'24","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.583138+0000","last_change":"2024-04-17T15:41:33.583225+0000","last_active":"2024-04-17T15:41:33.583138+0000","last_peered":"2024-04-17T15:41:33.583138+0000","last_clean":"2024-04-17T15:41:33.583138+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:41:33.583138+0000","last_undegraded":"2024-04-17T15:41:33.583138+0000","last_fullsized":"2024-04-17T15:41:33.583138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:33.582912+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:33.582912+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.582912+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:18.775745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.642331+0000","last_change":"2024-04-17T15:41:15.642389+0000","last_active":"2024-04-17T15:41:15.642331+0000","last_peered":"2024-04-17T15:41:15.642331+0000","last_clean":"2024-04-17T15:41:15.642331+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:41:15.642331+0000","last_undegraded":"2024-04-17T15:41:15.642331+0000","last_fullsized":"2024-04-17T15:41:15.642331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.642137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.642137+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.642137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:23.321426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.357866+0000","last_change":"2024-04-17T15:41:17.357933+0000","last_active":"2024-04-17T15:41:17.357866+0000","last_peered":"2024-04-17T15:41:17.357866+0000","last_clean":"2024-04-17T15:41:17.357866+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:41:17.357866+0000","last_undegraded":"2024-04-17T15:41:17.357866+0000","last_fullsized":"2024-04-17T15:41:17.357866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'10","last_scrub_stamp":"2024-04-17T15:41:17.357662+0000","last_deep_scrub":"112'10","last_deep_scrub_stamp":"2024-04-17T15:41:17.357662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.357662+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:00:44.064799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"130'50","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.156914+0000","last_change":"2024-04-17T15:36:54.174176+0000","last_active":"2024-04-17T15:41:11.156914+0000","last_peered":"2024-04-17T15:41:11.156914+0000","last_clean":"2024-04-17T15:41:11.156914+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:41:11.156914+0000","last_undegraded":"2024-04-17T15:41:11.156914+0000","last_fullsized":"2024-04-17T15:41:11.156914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.698570+0000","last_change":"2024-04-17T15:41:32.698625+0000","last_active":"2024-04-17T15:41:32.698570+0000","last_peered":"2024-04-17T15:41:32.698570+0000","last_clean":"2024-04-17T15:41:32.698570+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:41:32.698570+0000","last_undegraded":"2024-04-17T15:41:32.698570+0000","last_fullsized":"2024-04-17T15:41:32.698570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:32.698372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:32.698372+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.698372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:59.986646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"130'37","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.536385+0000","last_change":"2024-04-17T15:41:26.536460+0000","last_active":"2024-04-17T15:41:26.536385+0000","last_peered":"2024-04-17T15:41:26.536385+0000","last_clean":"2024-04-17T15:41:26.536385+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:41:26.536385+0000","last_undegraded":"2024-04-17T15:41:26.536385+0000","last_fullsized":"2024-04-17T15:41:26.536385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'37","last_scrub_stamp":"2024-04-17T15:41:26.536186+0000","last_deep_scrub":"130'37","last_deep_scrub_stamp":"2024-04-17T15:41:26.536186+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.536186+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:34.215475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.737865+0000","last_change":"2024-04-17T15:41:20.737920+0000","last_active":"2024-04-17T15:41:20.737865+0000","last_peered":"2024-04-17T15:41:20.737865+0000","last_clean":"2024-04-17T15:41:20.737865+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:41:20.737865+0000","last_undegraded":"2024-04-17T15:41:20.737865+0000","last_fullsized":"2024-04-17T15:41:20.737865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.737664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.737664+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.737664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:28.416953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.545250+0000","last_change":"2024-04-17T15:37:04.301784+0000","last_active":"2024-04-17T15:40:58.545250+0000","last_peered":"2024-04-17T15:40:58.545250+0000","last_clean":"2024-04-17T15:40:58.545250+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:40:58.545250+0000","last_undegraded":"2024-04-17T15:40:58.545250+0000","last_fullsized":"2024-04-17T15:40:58.545250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.565309+0000","last_change":"2024-04-17T15:41:26.565461+0000","last_active":"2024-04-17T15:41:26.565309+0000","last_peered":"2024-04-17T15:41:26.565309+0000","last_clean":"2024-04-17T15:41:26.565309+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:41:26.565309+0000","last_undegraded":"2024-04-17T15:41:26.565309+0000","last_fullsized":"2024-04-17T15:41:26.565309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:26.565064+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.565064+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.565064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:34:10.523713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"130'48","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.517777+0000","last_change":"2024-04-17T15:41:32.517842+0000","last_active":"2024-04-17T15:41:32.517777+0000","last_peered":"2024-04-17T15:41:32.517777+0000","last_clean":"2024-04-17T15:41:32.517777+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:41:32.517777+0000","last_undegraded":"2024-04-17T15:41:32.517777+0000","last_fullsized":"2024-04-17T15:41:32.517777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:32.517588+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:32.517588+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.517588+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:04.220651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.364512+0000","last_change":"2024-04-17T15:41:18.364569+0000","last_active":"2024-04-17T15:41:18.364512+0000","last_peered":"2024-04-17T15:41:18.364512+0000","last_clean":"2024-04-17T15:41:18.364512+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:41:18.364512+0000","last_undegraded":"2024-04-17T15:41:18.364512+0000","last_fullsized":"2024-04-17T15:41:18.364512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.364298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.364298+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.364298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:57:42.347669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"130'32","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.655785+0000","last_change":"2024-04-17T15:41:35.655882+0000","last_active":"2024-04-17T15:41:35.655785+0000","last_peered":"2024-04-17T15:41:35.655785+0000","last_clean":"2024-04-17T15:41:35.655785+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:41:35.655785+0000","last_undegraded":"2024-04-17T15:41:35.655785+0000","last_fullsized":"2024-04-17T15:41:35.655785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:35.655589+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:35.655589+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.655589+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:05.201474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":218,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207348+0000","last_change":"2024-04-17T15:37:02.269053+0000","last_active":"2024-04-17T15:40:58.207348+0000","last_peered":"2024-04-17T15:40:58.207348+0000","last_clean":"2024-04-17T15:40:58.207348+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:40:58.207348+0000","last_undegraded":"2024-04-17T15:40:58.207348+0000","last_fullsized":"2024-04-17T15:40:58.207348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.551001+0000","last_change":"2024-04-17T15:37:04.284740+0000","last_active":"2024-04-17T15:40:58.551001+0000","last_peered":"2024-04-17T15:40:58.551001+0000","last_clean":"2024-04-17T15:40:58.551001+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:40:58.551001+0000","last_undegraded":"2024-04-17T15:40:58.551001+0000","last_fullsized":"2024-04-17T15:40:58.551001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.623297+0000","last_change":"2024-04-17T15:41:32.623363+0000","last_active":"2024-04-17T15:41:32.623297+0000","last_peered":"2024-04-17T15:41:32.623297+0000","last_clean":"2024-04-17T15:41:32.623297+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:41:32.623297+0000","last_undegraded":"2024-04-17T15:41:32.623297+0000","last_fullsized":"2024-04-17T15:41:32.623297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'2","last_scrub_stamp":"2024-04-17T15:41:32.622791+0000","last_deep_scrub":"73'2","last_deep_scrub_stamp":"2024-04-17T15:41:32.622791+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.622791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:08:11.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"130'56","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.104087+0000","last_change":"2024-04-17T15:36:54.165051+0000","last_active":"2024-04-17T15:41:11.104087+0000","last_peered":"2024-04-17T15:41:11.104087+0000","last_clean":"2024-04-17T15:41:11.104087+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:41:11.104087+0000","last_undegraded":"2024-04-17T15:41:11.104087+0000","last_fullsized":"2024-04-17T15:41:11.104087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209645+0000","last_change":"2024-04-17T15:36:58.222214+0000","last_active":"2024-04-17T15:40:58.209645+0000","last_peered":"2024-04-17T15:40:58.209645+0000","last_clean":"2024-04-17T15:40:58.209645+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:40:58.209645+0000","last_undegraded":"2024-04-17T15:40:58.209645+0000","last_fullsized":"2024-04-17T15:40:58.209645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.654691+0000","last_change":"2024-04-17T15:41:18.654793+0000","last_active":"2024-04-17T15:41:18.654691+0000","last_peered":"2024-04-17T15:41:18.654691+0000","last_clean":"2024-04-17T15:41:18.654691+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:41:18.654691+0000","last_undegraded":"2024-04-17T15:41:18.654691+0000","last_fullsized":"2024-04-17T15:41:18.654691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-17T15:41:18.654502+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-17T15:41:18.654502+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.654502+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:42:37.262801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":219,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:01.294383+0000","last_change":"2024-04-17T15:37:02.284324+0000","last_active":"2024-04-17T15:41:01.294383+0000","last_peered":"2024-04-17T15:41:01.294383+0000","last_clean":"2024-04-17T15:41:01.294383+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:41:01.294383+0000","last_undegraded":"2024-04-17T15:41:01.294383+0000","last_fullsized":"2024-04-17T15:41:01.294383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":213,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205515+0000","last_change":"2024-04-17T15:37:04.289283+0000","last_active":"2024-04-17T15:40:58.205515+0000","last_peered":"2024-04-17T15:40:58.205515+0000","last_clean":"2024-04-17T15:40:58.205515+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:40:58.205515+0000","last_undegraded":"2024-04-17T15:40:58.205515+0000","last_fullsized":"2024-04-17T15:40:58.205515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.873264+0000","last_change":"2024-04-17T15:41:23.873386+0000","last_active":"2024-04-17T15:41:23.873264+0000","last_peered":"2024-04-17T15:41:23.873264+0000","last_clean":"2024-04-17T15:41:23.873264+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:41:23.873264+0000","last_undegraded":"2024-04-17T15:41:23.873264+0000","last_fullsized":"2024-04-17T15:41:23.873264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:23.873020+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.873020+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.873020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:45.277191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"130'54","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.179808+0000","last_change":"2024-04-17T15:36:54.200156+0000","last_active":"2024-04-17T15:41:11.179808+0000","last_peered":"2024-04-17T15:41:11.179808+0000","last_clean":"2024-04-17T15:41:11.179808+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:41:11.179808+0000","last_undegraded":"2024-04-17T15:41:11.179808+0000","last_fullsized":"2024-04-17T15:41:11.179808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.443969+0000","last_change":"2024-04-17T15:41:22.444024+0000","last_active":"2024-04-17T15:41:22.443969+0000","last_peered":"2024-04-17T15:41:22.443969+0000","last_clean":"2024-04-17T15:41:22.443969+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:41:22.443969+0000","last_undegraded":"2024-04-17T15:41:22.443969+0000","last_fullsized":"2024-04-17T15:41:22.443969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:22.443742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:22.443742+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.443742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:05.643225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"130'17","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.942474+0000","last_change":"2024-04-17T15:41:19.942554+0000","last_active":"2024-04-17T15:41:19.942474+0000","last_peered":"2024-04-17T15:41:19.942474+0000","last_clean":"2024-04-17T15:41:19.942474+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:41:19.942474+0000","last_undegraded":"2024-04-17T15:41:19.942474+0000","last_fullsized":"2024-04-17T15:41:19.942474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'17","last_scrub_stamp":"2024-04-17T15:41:19.942239+0000","last_deep_scrub":"130'17","last_deep_scrub_stamp":"2024-04-17T15:41:19.942239+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.942239+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:27:11.048555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"130'138","reported_seq":405,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.316687+0000","last_change":"2024-04-17T15:37:02.270774+0000","last_active":"2024-04-17T15:41:11.316687+0000","last_peered":"2024-04-17T15:41:11.316687+0000","last_clean":"2024-04-17T15:41:11.316687+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:41:11.316687+0000","last_undegraded":"2024-04-17T15:41:11.316687+0000","last_fullsized":"2024-04-17T15:41:11.316687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":211,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.511260+0000","last_change":"2024-04-17T15:37:04.285558+0000","last_active":"2024-04-17T15:40:58.511260+0000","last_peered":"2024-04-17T15:40:58.511260+0000","last_clean":"2024-04-17T15:40:58.511260+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:40:58.511260+0000","last_undegraded":"2024-04-17T15:40:58.511260+0000","last_fullsized":"2024-04-17T15:40:58.511260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207533+0000","last_change":"2024-04-17T15:36:56.181446+0000","last_active":"2024-04-17T15:40:58.207533+0000","last_peered":"2024-04-17T15:40:58.207533+0000","last_clean":"2024-04-17T15:40:58.207533+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:40:58.207533+0000","last_undegraded":"2024-04-17T15:40:58.207533+0000","last_fullsized":"2024-04-17T15:40:58.207533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"130'42","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.184216+0000","last_change":"2024-04-17T15:36:54.168120+0000","last_active":"2024-04-17T15:41:11.184216+0000","last_peered":"2024-04-17T15:41:11.184216+0000","last_clean":"2024-04-17T15:41:11.184216+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:41:11.184216+0000","last_undegraded":"2024-04-17T15:41:11.184216+0000","last_fullsized":"2024-04-17T15:41:11.184216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.534461+0000","last_change":"2024-04-17T15:41:29.534535+0000","last_active":"2024-04-17T15:41:29.534461+0000","last_peered":"2024-04-17T15:41:29.534461+0000","last_clean":"2024-04-17T15:41:29.534461+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:41:29.534461+0000","last_undegraded":"2024-04-17T15:41:29.534461+0000","last_fullsized":"2024-04-17T15:41:29.534461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:29.534228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:29.534228+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.534228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:01.237291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"130'32","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.740905+0000","last_change":"2024-04-17T15:41:21.740980+0000","last_active":"2024-04-17T15:41:21.740905+0000","last_peered":"2024-04-17T15:41:21.740905+0000","last_clean":"2024-04-17T15:41:21.740905+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:41:21.740905+0000","last_undegraded":"2024-04-17T15:41:21.740905+0000","last_fullsized":"2024-04-17T15:41:21.740905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:21.740710+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:21.740710+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.740710+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:34:57.749235+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.614167+0000","last_change":"2024-04-17T15:41:18.614223+0000","last_active":"2024-04-17T15:41:18.614167+0000","last_peered":"2024-04-17T15:41:18.614167+0000","last_clean":"2024-04-17T15:41:18.614167+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:41:18.614167+0000","last_undegraded":"2024-04-17T15:41:18.614167+0000","last_fullsized":"2024-04-17T15:41:18.614167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.613953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.613953+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.613953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:05.749502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.514104+0000","last_change":"2024-04-17T15:37:04.296823+0000","last_active":"2024-04-17T15:40:58.514104+0000","last_peered":"2024-04-17T15:40:58.514104+0000","last_clean":"2024-04-17T15:40:58.514104+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:40:58.514104+0000","last_undegraded":"2024-04-17T15:40:58.514104+0000","last_fullsized":"2024-04-17T15:40:58.514104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209004+0000","last_change":"2024-04-17T15:36:56.180544+0000","last_active":"2024-04-17T15:40:58.209004+0000","last_peered":"2024-04-17T15:40:58.209004+0000","last_clean":"2024-04-17T15:40:58.209004+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:40:58.209004+0000","last_undegraded":"2024-04-17T15:40:58.209004+0000","last_fullsized":"2024-04-17T15:40:58.209004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:55.149626+0000","last_clean_scrub_stamp":"2024-04-17T15:36:55.149626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"130'50","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.155583+0000","last_change":"2024-04-17T15:36:54.165989+0000","last_active":"2024-04-17T15:41:11.155583+0000","last_peered":"2024-04-17T15:41:11.155583+0000","last_clean":"2024-04-17T15:41:11.155583+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:41:11.155583+0000","last_undegraded":"2024-04-17T15:41:11.155583+0000","last_fullsized":"2024-04-17T15:41:11.155583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.205804+0000","last_change":"2024-04-17T15:36:58.230289+0000","last_active":"2024-04-17T15:40:58.205804+0000","last_peered":"2024-04-17T15:40:58.205804+0000","last_clean":"2024-04-17T15:40:58.205804+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:40:58.205804+0000","last_undegraded":"2024-04-17T15:40:58.205804+0000","last_fullsized":"2024-04-17T15:40:58.205804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:57.177898+0000","last_clean_scrub_stamp":"2024-04-17T15:36:57.177898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"130'21","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:10.395059+0000","last_change":"2024-04-17T15:37:00.262205+0000","last_active":"2024-04-17T15:41:10.395059+0000","last_peered":"2024-04-17T15:41:10.395059+0000","last_clean":"2024-04-17T15:41:10.395059+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:41:10.395059+0000","last_undegraded":"2024-04-17T15:41:10.395059+0000","last_fullsized":"2024-04-17T15:41:10.395059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:59.207440+0000","last_clean_scrub_stamp":"2024-04-17T15:36:59.207440+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.357411+0000","last_change":"2024-04-17T15:41:24.357478+0000","last_active":"2024-04-17T15:41:24.357411+0000","last_peered":"2024-04-17T15:41:24.357411+0000","last_clean":"2024-04-17T15:41:24.357411+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:41:24.357411+0000","last_undegraded":"2024-04-17T15:41:24.357411+0000","last_fullsized":"2024-04-17T15:41:24.357411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:24.357216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:24.357216+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.357216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:19:42.020463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.546935+0000","last_change":"2024-04-17T15:37:04.296709+0000","last_active":"2024-04-17T15:40:58.546935+0000","last_peered":"2024-04-17T15:40:58.546935+0000","last_clean":"2024-04-17T15:40:58.546935+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:40:58.546935+0000","last_undegraded":"2024-04-17T15:40:58.546935+0000","last_fullsized":"2024-04-17T15:40:58.546935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.682671+0000","last_change":"2024-04-17T15:41:25.682834+0000","last_active":"2024-04-17T15:41:25.682671+0000","last_peered":"2024-04-17T15:41:25.682671+0000","last_clean":"2024-04-17T15:41:25.682671+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:41:25.682671+0000","last_undegraded":"2024-04-17T15:41:25.682671+0000","last_fullsized":"2024-04-17T15:41:25.682671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:25.682410+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:25.682410+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.682410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:14.881844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"130'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.182496+0000","last_change":"2024-04-17T15:36:54.188705+0000","last_active":"2024-04-17T15:41:11.182496+0000","last_peered":"2024-04-17T15:41:11.182496+0000","last_clean":"2024-04-17T15:41:11.182496+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:41:11.182496+0000","last_undegraded":"2024-04-17T15:41:11.182496+0000","last_fullsized":"2024-04-17T15:41:11.182496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.983364+0000","last_change":"2024-04-17T15:41:31.983417+0000","last_active":"2024-04-17T15:41:31.983364+0000","last_peered":"2024-04-17T15:41:31.983364+0000","last_clean":"2024-04-17T15:41:31.983364+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:41:31.983364+0000","last_undegraded":"2024-04-17T15:41:31.983364+0000","last_fullsized":"2024-04-17T15:41:31.983364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.983157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.983157+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.983157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:17.175990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"130'17","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.715510+0000","last_change":"2024-04-17T15:41:24.715584+0000","last_active":"2024-04-17T15:41:24.715510+0000","last_peered":"2024-04-17T15:41:24.715510+0000","last_clean":"2024-04-17T15:41:24.715510+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:41:24.715510+0000","last_undegraded":"2024-04-17T15:41:24.715510+0000","last_fullsized":"2024-04-17T15:41:24.715510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'17","last_scrub_stamp":"2024-04-17T15:41:24.715319+0000","last_deep_scrub":"130'17","last_deep_scrub_stamp":"2024-04-17T15:41:24.715319+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.715319+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:41.283821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":215,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.207238+0000","last_change":"2024-04-17T15:37:02.266126+0000","last_active":"2024-04-17T15:40:58.207238+0000","last_peered":"2024-04-17T15:40:58.207238+0000","last_clean":"2024-04-17T15:40:58.207238+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:40:58.207238+0000","last_undegraded":"2024-04-17T15:40:58.207238+0000","last_fullsized":"2024-04-17T15:40:58.207238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:01.232227+0000","last_clean_scrub_stamp":"2024-04-17T15:37:01.232227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":211,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.513474+0000","last_change":"2024-04-17T15:37:04.292104+0000","last_active":"2024-04-17T15:40:58.513474+0000","last_peered":"2024-04-17T15:40:58.513474+0000","last_clean":"2024-04-17T15:40:58.513474+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:40:58.513474+0000","last_undegraded":"2024-04-17T15:40:58.513474+0000","last_fullsized":"2024-04-17T15:40:58.513474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.940903+0000","last_change":"2024-04-17T15:41:22.940965+0000","last_active":"2024-04-17T15:41:22.940903+0000","last_peered":"2024-04-17T15:41:22.940903+0000","last_clean":"2024-04-17T15:41:22.940903+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:41:22.940903+0000","last_undegraded":"2024-04-17T15:41:22.940903+0000","last_fullsized":"2024-04-17T15:41:22.940903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:22.940691+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:22.940691+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.940691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:32:42.716910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"130'44","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.146638+0000","last_change":"2024-04-17T15:36:54.174738+0000","last_active":"2024-04-17T15:41:11.146638+0000","last_peered":"2024-04-17T15:41:11.146638+0000","last_clean":"2024-04-17T15:41:11.146638+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:41:11.146638+0000","last_undegraded":"2024-04-17T15:41:11.146638+0000","last_fullsized":"2024-04-17T15:41:11.146638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"130'2","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.438603+0000","last_change":"2024-04-17T15:41:20.438667+0000","last_active":"2024-04-17T15:41:20.438603+0000","last_peered":"2024-04-17T15:41:20.438603+0000","last_clean":"2024-04-17T15:41:20.438603+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:41:20.438603+0000","last_undegraded":"2024-04-17T15:41:20.438603+0000","last_fullsized":"2024-04-17T15:41:20.438603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:20.438401+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:20.438401+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.438401+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:50:50.631393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"130'24","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.893624+0000","last_change":"2024-04-17T15:41:16.893715+0000","last_active":"2024-04-17T15:41:16.893624+0000","last_peered":"2024-04-17T15:41:16.893624+0000","last_clean":"2024-04-17T15:41:16.893624+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:41:16.893624+0000","last_undegraded":"2024-04-17T15:41:16.893624+0000","last_fullsized":"2024-04-17T15:41:16.893624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:16.893413+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:16.893413+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.893413+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:00.092896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.683265+0000","last_change":"2024-04-17T15:41:14.683319+0000","last_active":"2024-04-17T15:41:14.683265+0000","last_peered":"2024-04-17T15:41:14.683265+0000","last_clean":"2024-04-17T15:41:14.683265+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:41:14.683265+0000","last_undegraded":"2024-04-17T15:41:14.683265+0000","last_fullsized":"2024-04-17T15:41:14.683265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:14.683062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:14.683062+0000","last_clean_scrub_stamp":"2024-04-17T15:41:14.683062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:57:18.851274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":211,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:40:58.209797+0000","last_change":"2024-04-17T15:37:04.285349+0000","last_active":"2024-04-17T15:40:58.209797+0000","last_peered":"2024-04-17T15:40:58.209797+0000","last_clean":"2024-04-17T15:40:58.209797+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:40:58.209797+0000","last_undegraded":"2024-04-17T15:40:58.209797+0000","last_fullsized":"2024-04-17T15:40:58.209797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.441031+0000","last_change":"2024-04-17T15:41:21.441094+0000","last_active":"2024-04-17T15:41:21.441031+0000","last_peered":"2024-04-17T15:41:21.441031+0000","last_clean":"2024-04-17T15:41:21.441031+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:41:21.441031+0000","last_undegraded":"2024-04-17T15:41:21.441031+0000","last_fullsized":"2024-04-17T15:41:21.441031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:21.440828+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:21.440828+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.440828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:38:17.792880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'56","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.375213+0000","last_change":"2024-04-17T15:41:29.375275+0000","last_active":"2024-04-17T15:41:29.375213+0000","last_peered":"2024-04-17T15:41:29.375213+0000","last_clean":"2024-04-17T15:41:29.375213+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:41:29.375213+0000","last_undegraded":"2024-04-17T15:41:29.375213+0000","last_fullsized":"2024-04-17T15:41:29.375213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:29.374989+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:29.374989+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.374989+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:40.803319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.526174+0000","last_change":"2024-04-17T15:41:25.526241+0000","last_active":"2024-04-17T15:41:25.526174+0000","last_peered":"2024-04-17T15:41:25.526174+0000","last_clean":"2024-04-17T15:41:25.526174+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:41:25.526174+0000","last_undegraded":"2024-04-17T15:41:25.526174+0000","last_fullsized":"2024-04-17T15:41:25.526174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-17T15:41:25.525964+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-17T15:41:25.525964+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.525964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:45.166198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"130'44","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.930689+0000","last_change":"2024-04-17T15:41:21.930755+0000","last_active":"2024-04-17T15:41:21.930689+0000","last_peered":"2024-04-17T15:41:21.930689+0000","last_clean":"2024-04-17T15:41:21.930689+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:41:21.930689+0000","last_undegraded":"2024-04-17T15:41:21.930689+0000","last_fullsized":"2024-04-17T15:41:21.930689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:21.930494+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:21.930494+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.930494+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:07.291135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.781887+0000","last_change":"2024-04-17T15:41:22.781960+0000","last_active":"2024-04-17T15:41:22.781887+0000","last_peered":"2024-04-17T15:41:22.781887+0000","last_clean":"2024-04-17T15:41:22.781887+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:41:22.781887+0000","last_undegraded":"2024-04-17T15:41:22.781887+0000","last_fullsized":"2024-04-17T15:41:22.781887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:22.781678+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:22.781678+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.781678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:23.342470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"130'42","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.164480+0000","last_change":"2024-04-17T15:36:54.180979+0000","last_active":"2024-04-17T15:41:11.164480+0000","last_peered":"2024-04-17T15:41:11.164480+0000","last_clean":"2024-04-17T15:41:11.164480+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:41:11.164480+0000","last_undegraded":"2024-04-17T15:41:11.164480+0000","last_fullsized":"2024-04-17T15:41:11.164480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.409238+0000","last_change":"2024-04-17T15:41:17.409259+0000","last_active":"2024-04-17T15:41:17.409238+0000","last_peered":"2024-04-17T15:41:17.409238+0000","last_clean":"2024-04-17T15:41:17.409238+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:41:17.409238+0000","last_undegraded":"2024-04-17T15:41:17.409238+0000","last_fullsized":"2024-04-17T15:41:17.409238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.409156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.409156+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.409156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:50.849523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"130'42","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:11.188894+0000","last_change":"2024-04-17T15:36:54.179255+0000","last_active":"2024-04-17T15:41:11.188894+0000","last_peered":"2024-04-17T15:41:11.188894+0000","last_clean":"2024-04-17T15:41:11.188894+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:41:11.188894+0000","last_undegraded":"2024-04-17T15:41:11.188894+0000","last_fullsized":"2024-04-17T15:41:11.188894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.645917+0000","last_change":"2024-04-17T15:41:26.645981+0000","last_active":"2024-04-17T15:41:26.645917+0000","last_peered":"2024-04-17T15:41:26.645917+0000","last_clean":"2024-04-17T15:41:26.645917+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:41:26.645917+0000","last_undegraded":"2024-04-17T15:41:26.645917+0000","last_fullsized":"2024-04-17T15:41:26.645917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:26.645717+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.645717+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.645717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:28:00.142871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"130'50","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.790380+0000","last_change":"2024-04-17T15:41:32.790441+0000","last_active":"2024-04-17T15:41:32.790380+0000","last_peered":"2024-04-17T15:41:32.790380+0000","last_clean":"2024-04-17T15:41:32.790380+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:41:32.790380+0000","last_undegraded":"2024-04-17T15:41:32.790380+0000","last_fullsized":"2024-04-17T15:41:32.790380+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:32.790174+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:32.790174+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.790174+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:31:27.935480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.993934+0000","last_change":"2024-04-17T15:41:29.993997+0000","last_active":"2024-04-17T15:41:29.993934+0000","last_peered":"2024-04-17T15:41:29.993934+0000","last_clean":"2024-04-17T15:41:29.993934+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:41:29.993934+0000","last_undegraded":"2024-04-17T15:41:29.993934+0000","last_fullsized":"2024-04-17T15:41:29.993934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-17T15:41:29.993733+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-17T15:41:29.993733+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.993733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:02.192795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"130'64","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.519997+0000","last_change":"2024-04-17T15:41:35.520062+0000","last_active":"2024-04-17T15:41:35.519997+0000","last_peered":"2024-04-17T15:41:35.519997+0000","last_clean":"2024-04-17T15:41:35.519997+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:41:35.519997+0000","last_undegraded":"2024-04-17T15:41:35.519997+0000","last_fullsized":"2024-04-17T15:41:35.519997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'64","last_scrub_stamp":"2024-04-17T15:41:35.519801+0000","last_deep_scrub":"130'64","last_deep_scrub_stamp":"2024-04-17T15:41:35.519801+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.519801+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:48.282272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.587736+0000","last_change":"2024-04-17T15:41:28.587804+0000","last_active":"2024-04-17T15:41:28.587736+0000","last_peered":"2024-04-17T15:41:28.587736+0000","last_clean":"2024-04-17T15:41:28.587736+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:41:28.587736+0000","last_undegraded":"2024-04-17T15:41:28.587736+0000","last_fullsized":"2024-04-17T15:41:28.587736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.587204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.587204+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.587204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:23.366632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"130'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.370927+0000","last_change":"2024-04-17T15:41:30.371062+0000","last_active":"2024-04-17T15:41:30.370927+0000","last_peered":"2024-04-17T15:41:30.370927+0000","last_clean":"2024-04-17T15:41:30.370927+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:41:30.370927+0000","last_undegraded":"2024-04-17T15:41:30.370927+0000","last_fullsized":"2024-04-17T15:41:30.370927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:30.370687+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:30.370687+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.370687+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:41:10.555528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.387185+0000","last_change":"2024-04-17T15:41:23.387250+0000","last_active":"2024-04-17T15:41:23.387185+0000","last_peered":"2024-04-17T15:41:23.387185+0000","last_clean":"2024-04-17T15:41:23.387185+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:41:23.387185+0000","last_undegraded":"2024-04-17T15:41:23.387185+0000","last_fullsized":"2024-04-17T15:41:23.387185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:23.386978+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.386978+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.386978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:00:28.652613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"130'42","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.726671+0000","last_change":"2024-04-17T15:36:54.181432+0000","last_active":"2024-04-17T15:41:15.726671+0000","last_peered":"2024-04-17T15:41:15.726671+0000","last_clean":"2024-04-17T15:41:15.726671+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:41:15.726671+0000","last_undegraded":"2024-04-17T15:41:15.726671+0000","last_fullsized":"2024-04-17T15:41:15.726671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.601066+0000","last_change":"2024-04-17T15:41:23.601066+0000","last_active":"2024-04-17T15:41:23.601066+0000","last_peered":"2024-04-17T15:41:23.601066+0000","last_clean":"2024-04-17T15:41:23.601066+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:41:23.601066+0000","last_undegraded":"2024-04-17T15:41:23.601066+0000","last_fullsized":"2024-04-17T15:41:23.601066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-17T15:41:23.600781+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.600781+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.600781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:49:55.799844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"130'50","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.327963+0000","last_change":"2024-04-17T15:36:54.174338+0000","last_active":"2024-04-17T15:41:16.327963+0000","last_peered":"2024-04-17T15:41:16.327963+0000","last_clean":"2024-04-17T15:41:16.327963+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:41:16.327963+0000","last_undegraded":"2024-04-17T15:41:16.327963+0000","last_fullsized":"2024-04-17T15:41:16.327963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.979375+0000","last_change":"2024-04-17T15:41:32.979375+0000","last_active":"2024-04-17T15:41:32.979375+0000","last_peered":"2024-04-17T15:41:32.979375+0000","last_clean":"2024-04-17T15:41:32.979375+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:41:32.979375+0000","last_undegraded":"2024-04-17T15:41:32.979375+0000","last_fullsized":"2024-04-17T15:41:32.979375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'16","last_scrub_stamp":"2024-04-17T15:41:32.979109+0000","last_deep_scrub":"90'16","last_deep_scrub_stamp":"2024-04-17T15:41:32.979109+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.979109+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:34:16.937759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"130'44","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.726508+0000","last_change":"2024-04-17T15:36:54.186156+0000","last_active":"2024-04-17T15:41:15.726508+0000","last_peered":"2024-04-17T15:41:15.726508+0000","last_clean":"2024-04-17T15:41:15.726508+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:41:15.726508+0000","last_undegraded":"2024-04-17T15:41:15.726508+0000","last_fullsized":"2024-04-17T15:41:15.726508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.852878+0000","last_change":"2024-04-17T15:41:25.852878+0000","last_active":"2024-04-17T15:41:25.852878+0000","last_peered":"2024-04-17T15:41:25.852878+0000","last_clean":"2024-04-17T15:41:25.852878+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:41:25.852878+0000","last_undegraded":"2024-04-17T15:41:25.852878+0000","last_fullsized":"2024-04-17T15:41:25.852878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:25.852499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:25.852499+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.852499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:36:40.255637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"130'48","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.892041+0000","last_change":"2024-04-17T15:41:31.892222+0000","last_active":"2024-04-17T15:41:31.892041+0000","last_peered":"2024-04-17T15:41:31.892041+0000","last_clean":"2024-04-17T15:41:31.892041+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:41:31.892041+0000","last_undegraded":"2024-04-17T15:41:31.892041+0000","last_fullsized":"2024-04-17T15:41:31.892041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:31.891738+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:31.891738+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.891738+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:50:57.269411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.005508+0000","last_change":"2024-04-17T15:41:27.005573+0000","last_active":"2024-04-17T15:41:27.005508+0000","last_peered":"2024-04-17T15:41:27.005508+0000","last_clean":"2024-04-17T15:41:27.005508+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:41:27.005508+0000","last_undegraded":"2024-04-17T15:41:27.005508+0000","last_fullsized":"2024-04-17T15:41:27.005508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:27.005304+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:27.005304+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.005304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:14.664016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"130'52","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.289486+0000","last_change":"2024-04-17T15:36:54.194015+0000","last_active":"2024-04-17T15:41:14.289486+0000","last_peered":"2024-04-17T15:41:14.289486+0000","last_clean":"2024-04-17T15:41:14.289486+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:41:14.289486+0000","last_undegraded":"2024-04-17T15:41:14.289486+0000","last_fullsized":"2024-04-17T15:41:14.289486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.541354+0000","last_change":"2024-04-17T15:41:26.541416+0000","last_active":"2024-04-17T15:41:26.541354+0000","last_peered":"2024-04-17T15:41:26.541354+0000","last_clean":"2024-04-17T15:41:26.541354+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:41:26.541354+0000","last_undegraded":"2024-04-17T15:41:26.541354+0000","last_fullsized":"2024-04-17T15:41:26.541354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:26.541147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:26.541147+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.541147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:29.507403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"130'58","reported_seq":300,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.384677+0000","last_change":"2024-04-17T15:41:33.384740+0000","last_active":"2024-04-17T15:41:33.384677+0000","last_peered":"2024-04-17T15:41:33.384677+0000","last_clean":"2024-04-17T15:41:33.384677+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:41:33.384677+0000","last_undegraded":"2024-04-17T15:41:33.384677+0000","last_fullsized":"2024-04-17T15:41:33.384677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'58","last_scrub_stamp":"2024-04-17T15:41:33.384469+0000","last_deep_scrub":"130'58","last_deep_scrub_stamp":"2024-04-17T15:41:33.384469+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.384469+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:09.392994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.691041+0000","last_change":"2024-04-17T15:41:33.691101+0000","last_active":"2024-04-17T15:41:33.691041+0000","last_peered":"2024-04-17T15:41:33.691041+0000","last_clean":"2024-04-17T15:41:33.691041+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:41:33.691041+0000","last_undegraded":"2024-04-17T15:41:33.691041+0000","last_fullsized":"2024-04-17T15:41:33.691041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:33.690823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:33.690823+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.690823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:48.637788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"130'40","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.656206+0000","last_change":"2024-04-17T15:36:54.206859+0000","last_active":"2024-04-17T15:41:17.656206+0000","last_peered":"2024-04-17T15:41:17.656206+0000","last_clean":"2024-04-17T15:41:17.656206+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:41:17.656206+0000","last_undegraded":"2024-04-17T15:41:17.656206+0000","last_fullsized":"2024-04-17T15:41:17.656206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":196,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.876977+0000","last_change":"2024-04-17T15:41:35.877036+0000","last_active":"2024-04-17T15:41:35.876977+0000","last_peered":"2024-04-17T15:41:35.876977+0000","last_clean":"2024-04-17T15:41:35.876977+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:41:35.876977+0000","last_undegraded":"2024-04-17T15:41:35.876977+0000","last_fullsized":"2024-04-17T15:41:35.876977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:35.876770+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:35.876770+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.876770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:04.436894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"130'32","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.890286+0000","last_change":"2024-04-17T15:41:22.890286+0000","last_active":"2024-04-17T15:41:22.890286+0000","last_peered":"2024-04-17T15:41:22.890286+0000","last_clean":"2024-04-17T15:41:22.890286+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:41:22.890286+0000","last_undegraded":"2024-04-17T15:41:22.890286+0000","last_fullsized":"2024-04-17T15:41:22.890286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:22.890024+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:22.890024+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.890024+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:00:49.597161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.502757+0000","last_change":"2024-04-17T15:41:24.502823+0000","last_active":"2024-04-17T15:41:24.502757+0000","last_peered":"2024-04-17T15:41:24.502757+0000","last_clean":"2024-04-17T15:41:24.502757+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:41:24.502757+0000","last_undegraded":"2024-04-17T15:41:24.502757+0000","last_fullsized":"2024-04-17T15:41:24.502757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-17T15:41:24.502560+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-17T15:41:24.502560+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.502560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:00.511085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"130'46","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.837117+0000","last_change":"2024-04-17T15:41:33.837182+0000","last_active":"2024-04-17T15:41:33.837117+0000","last_peered":"2024-04-17T15:41:33.837117+0000","last_clean":"2024-04-17T15:41:33.837117+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:41:33.837117+0000","last_undegraded":"2024-04-17T15:41:33.837117+0000","last_fullsized":"2024-04-17T15:41:33.837117+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:33.836927+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:33.836927+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.836927+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:19.751050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"130'66","reported_seq":300,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.671399+0000","last_change":"2024-04-17T15:36:54.177822+0000","last_active":"2024-04-17T15:41:16.671399+0000","last_peered":"2024-04-17T15:41:16.671399+0000","last_clean":"2024-04-17T15:41:16.671399+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:41:16.671399+0000","last_undegraded":"2024-04-17T15:41:16.671399+0000","last_fullsized":"2024-04-17T15:41:16.671399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:36:53.127887+0000","last_clean_scrub_stamp":"2024-04-17T15:36:53.127887+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.601632+0000","last_change":"2024-04-17T15:41:22.601697+0000","last_active":"2024-04-17T15:41:22.601632+0000","last_peered":"2024-04-17T15:41:22.601632+0000","last_clean":"2024-04-17T15:41:22.601632+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:41:22.601632+0000","last_undegraded":"2024-04-17T15:41:22.601632+0000","last_fullsized":"2024-04-17T15:41:22.601632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:22.601419+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:22.601419+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.601419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:00.013870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"130'28","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.529620+0000","last_change":"2024-04-17T15:41:30.529620+0000","last_active":"2024-04-17T15:41:30.529620+0000","last_peered":"2024-04-17T15:41:30.529620+0000","last_clean":"2024-04-17T15:41:30.529620+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:41:30.529620+0000","last_undegraded":"2024-04-17T15:41:30.529620+0000","last_fullsized":"2024-04-17T15:41:30.529620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-17T15:41:30.529343+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-17T15:41:30.529343+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.529343+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:06:00.524787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.858324+0000","last_change":"2024-04-17T15:41:27.858404+0000","last_active":"2024-04-17T15:41:27.858324+0000","last_peered":"2024-04-17T15:41:27.858324+0000","last_clean":"2024-04-17T15:41:27.858324+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:41:27.858324+0000","last_undegraded":"2024-04-17T15:41:27.858324+0000","last_fullsized":"2024-04-17T15:41:27.858324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-17T15:41:27.858121+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-17T15:41:27.858121+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.858121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:05.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1104,"ondisk_log_size":1104,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1539,"num_write":537,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":972,"ondisk_log_size":972,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542208,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37484,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334356,"statfs":{"total":96636764160,"available":96598380544,"internally_reserved":0,"allocated":2199552,"data_stored":1519562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542207,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1581056,"data_stored":928534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542207,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":929809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542207,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1568768,"data_stored":928032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36908,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334932,"statfs":{"total":96636764160,"available":96598970368,"internally_reserved":0,"allocated":1609728,"data_stored":930326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542207,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1568768,"data_stored":928096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36904,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334936,"statfs":{"total":96636764160,"available":96598974464,"internally_reserved":0,"allocated":1605632,"data_stored":929612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542206,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1519961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:41:38.427 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.427 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.427 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.427 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.427 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.427 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.428 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.428 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.428 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.428 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.429 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.429 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.429 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.429 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.429 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.429 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.429 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.430 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.430 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.430 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.430 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.430 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.430 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.430 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.430 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.431 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.431 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.431 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.431 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.431 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.432 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.432 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.432 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.433 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.433 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.433 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.433 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.434 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.434 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.434 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.434 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.435 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.435 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.435 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.435 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.436 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.436 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.436 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.436 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.436 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.436 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.436 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.436 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.437 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.437 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-17T15:36:47.052792+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.437 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.437 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.437 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.437 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.437 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.437 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.438 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.438 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.438 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.438 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.438 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.438 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.438 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.439 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.439 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.439 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.440 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.440 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.440 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.440 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.441 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.441 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.441 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.441 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.442 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.442 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.442 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.443 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.443 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.443 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.443 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.444 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.444 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-17T15:36:55.149626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.444 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.445 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-17T15:36:57.177898+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=57, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.445 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-17T15:36:59.207440+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=59, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.445 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.445 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.446 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-17T15:37:01.232227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.446 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.446 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.446 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.447 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.447 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.448 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.448 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.448 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.449 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.449 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.449 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-17T15:36:53.127887+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=36, tm_sec=53, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:38.450 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T15:41:58.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:41:58.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:41:58.821 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:41:58.840 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-04-17T15:41:58.354754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616016,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5028,"num_read_kb":3926,"num_write":4421,"num_write_kb":6187915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5695,"ondisk_log_size":5695,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":292152,"kb_used_data":13624,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754682568,"statfs":{"total":773094113280,"available":772794949632,"internally_reserved":0,"allocated":13950976,"data_stored":8613932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":285134386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007114"},"pg_stats":[{"pgid":"3.3f","version":"130'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.617314+0000","last_change":"2024-04-17T15:41:34.617374+0000","last_active":"2024-04-17T15:41:34.617314+0000","last_peered":"2024-04-17T15:41:34.617314+0000","last_clean":"2024-04-17T15:41:34.617314+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:41:34.617314+0000","last_undegraded":"2024-04-17T15:41:34.617314+0000","last_fullsized":"2024-04-17T15:41:34.617314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:34.617105+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:34.617105+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.617105+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:50:59.994778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.797545+0000","last_change":"2024-04-17T15:41:23.797545+0000","last_active":"2024-04-17T15:41:23.797545+0000","last_peered":"2024-04-17T15:41:23.797545+0000","last_clean":"2024-04-17T15:41:23.797545+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:41:23.797545+0000","last_undegraded":"2024-04-17T15:41:23.797545+0000","last_fullsized":"2024-04-17T15:41:23.797545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.797290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.797290+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.797290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:26.763546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"130'52","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.493816+0000","last_change":"2024-04-17T15:41:34.493879+0000","last_active":"2024-04-17T15:41:34.493816+0000","last_peered":"2024-04-17T15:41:34.493816+0000","last_clean":"2024-04-17T15:41:34.493816+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:41:34.493816+0000","last_undegraded":"2024-04-17T15:41:34.493816+0000","last_fullsized":"2024-04-17T15:41:34.493816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'52","last_scrub_stamp":"2024-04-17T15:41:34.493584+0000","last_deep_scrub":"130'52","last_deep_scrub_stamp":"2024-04-17T15:41:34.493584+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.493584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:06.692647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.516308+0000","last_change":"2024-04-17T15:41:22.516308+0000","last_active":"2024-04-17T15:41:22.516308+0000","last_peered":"2024-04-17T15:41:22.516308+0000","last_clean":"2024-04-17T15:41:22.516308+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:41:22.516308+0000","last_undegraded":"2024-04-17T15:41:22.516308+0000","last_fullsized":"2024-04-17T15:41:22.516308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:22.516050+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:22.516050+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.516050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:42.156284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"130'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.693604+0000","last_change":"2024-04-17T15:41:38.693672+0000","last_active":"2024-04-17T15:41:38.693604+0000","last_peered":"2024-04-17T15:41:38.693604+0000","last_clean":"2024-04-17T15:41:38.693604+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:41:38.693604+0000","last_undegraded":"2024-04-17T15:41:38.693604+0000","last_fullsized":"2024-04-17T15:41:38.693604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:38.693372+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:38.693372+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.693372+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:52.660308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.995193+0000","last_change":"2024-04-17T15:41:28.995193+0000","last_active":"2024-04-17T15:41:28.995193+0000","last_peered":"2024-04-17T15:41:28.995193+0000","last_clean":"2024-04-17T15:41:28.995193+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:41:28.995193+0000","last_undegraded":"2024-04-17T15:41:28.995193+0000","last_fullsized":"2024-04-17T15:41:28.995193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'8","last_scrub_stamp":"2024-04-17T15:41:28.994794+0000","last_deep_scrub":"77'8","last_deep_scrub_stamp":"2024-04-17T15:41:28.994794+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.994794+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:06.407245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"130'38","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.979316+0000","last_change":"2024-04-17T15:41:33.979447+0000","last_active":"2024-04-17T15:41:33.979316+0000","last_peered":"2024-04-17T15:41:33.979316+0000","last_clean":"2024-04-17T15:41:33.979316+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:41:33.979316+0000","last_undegraded":"2024-04-17T15:41:33.979316+0000","last_fullsized":"2024-04-17T15:41:33.979316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:33.979064+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:33.979064+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.979064+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:18:30.649416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.615086+0000","last_change":"2024-04-17T15:41:27.615086+0000","last_active":"2024-04-17T15:41:27.615086+0000","last_peered":"2024-04-17T15:41:27.615086+0000","last_clean":"2024-04-17T15:41:27.615086+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:41:27.615086+0000","last_undegraded":"2024-04-17T15:41:27.615086+0000","last_fullsized":"2024-04-17T15:41:27.615086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-17T15:41:27.614662+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-17T15:41:27.614662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.614662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:02.679627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"130'62","reported_seq":302,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.564666+0000","last_change":"2024-04-17T15:41:42.564666+0000","last_active":"2024-04-17T15:41:42.564666+0000","last_peered":"2024-04-17T15:41:42.564666+0000","last_clean":"2024-04-17T15:41:42.564666+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:41:42.564666+0000","last_undegraded":"2024-04-17T15:41:42.564666+0000","last_fullsized":"2024-04-17T15:41:42.564666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'62","last_scrub_stamp":"2024-04-17T15:41:42.564409+0000","last_deep_scrub":"130'62","last_deep_scrub_stamp":"2024-04-17T15:41:42.564409+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.564409+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:06.242267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.338879+0000","last_change":"2024-04-17T15:41:25.338942+0000","last_active":"2024-04-17T15:41:25.338879+0000","last_peered":"2024-04-17T15:41:25.338879+0000","last_clean":"2024-04-17T15:41:25.338879+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:41:25.338879+0000","last_undegraded":"2024-04-17T15:41:25.338879+0000","last_fullsized":"2024-04-17T15:41:25.338879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:25.338660+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:25.338660+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.338660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:09.383031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"130'38","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.120465+0000","last_change":"2024-04-17T15:41:44.120465+0000","last_active":"2024-04-17T15:41:44.120465+0000","last_peered":"2024-04-17T15:41:44.120465+0000","last_clean":"2024-04-17T15:41:44.120465+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:41:44.120465+0000","last_undegraded":"2024-04-17T15:41:44.120465+0000","last_fullsized":"2024-04-17T15:41:44.120465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:44.120208+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:44.120208+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.120208+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:50.597675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.969227+0000","last_change":"2024-04-17T15:41:25.969291+0000","last_active":"2024-04-17T15:41:25.969227+0000","last_peered":"2024-04-17T15:41:25.969227+0000","last_clean":"2024-04-17T15:41:25.969227+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:41:25.969227+0000","last_undegraded":"2024-04-17T15:41:25.969227+0000","last_fullsized":"2024-04-17T15:41:25.969227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:25.969023+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:25.969023+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.969023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:20:34.200894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"130'48","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.572326+0000","last_change":"2024-04-17T15:41:40.572326+0000","last_active":"2024-04-17T15:41:40.572326+0000","last_peered":"2024-04-17T15:41:40.572326+0000","last_clean":"2024-04-17T15:41:40.572326+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:41:40.572326+0000","last_undegraded":"2024-04-17T15:41:40.572326+0000","last_fullsized":"2024-04-17T15:41:40.572326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:40.572070+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:40.572070+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.572070+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:17:30.373864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.787979+0000","last_change":"2024-04-17T15:41:25.788128+0000","last_active":"2024-04-17T15:41:25.787979+0000","last_peered":"2024-04-17T15:41:25.787979+0000","last_clean":"2024-04-17T15:41:25.787979+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:41:25.787979+0000","last_undegraded":"2024-04-17T15:41:25.787979+0000","last_fullsized":"2024-04-17T15:41:25.787979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-17T15:41:25.787631+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-17T15:41:25.787631+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.787631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:13.446342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"130'58","reported_seq":300,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.731477+0000","last_change":"2024-04-17T15:41:47.731477+0000","last_active":"2024-04-17T15:41:47.731477+0000","last_peered":"2024-04-17T15:41:47.731477+0000","last_clean":"2024-04-17T15:41:47.731477+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:41:47.731477+0000","last_undegraded":"2024-04-17T15:41:47.731477+0000","last_fullsized":"2024-04-17T15:41:47.731477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'58","last_scrub_stamp":"2024-04-17T15:41:47.731042+0000","last_deep_scrub":"130'58","last_deep_scrub_stamp":"2024-04-17T15:41:47.731042+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.731042+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:30.372812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.804128+0000","last_change":"2024-04-17T15:41:26.804250+0000","last_active":"2024-04-17T15:41:26.804128+0000","last_peered":"2024-04-17T15:41:26.804128+0000","last_clean":"2024-04-17T15:41:26.804128+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:41:26.804128+0000","last_undegraded":"2024-04-17T15:41:26.804128+0000","last_fullsized":"2024-04-17T15:41:26.804128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:26.803898+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:26.803898+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.803898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:47:27.426934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.964726+0000","last_change":"2024-04-17T15:41:30.964726+0000","last_active":"2024-04-17T15:41:30.964726+0000","last_peered":"2024-04-17T15:41:30.964726+0000","last_clean":"2024-04-17T15:41:30.964726+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:41:30.964726+0000","last_undegraded":"2024-04-17T15:41:30.964726+0000","last_fullsized":"2024-04-17T15:41:30.964726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:30.964462+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:30.964462+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.964462+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:43.726934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"130'30","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.677642+0000","last_change":"2024-04-17T15:41:52.677702+0000","last_active":"2024-04-17T15:41:52.677642+0000","last_peered":"2024-04-17T15:41:52.677642+0000","last_clean":"2024-04-17T15:41:52.677642+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:41:52.677642+0000","last_undegraded":"2024-04-17T15:41:52.677642+0000","last_fullsized":"2024-04-17T15:41:52.677642+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'30","last_scrub_stamp":"2024-04-17T15:41:52.677443+0000","last_deep_scrub":"130'30","last_deep_scrub_stamp":"2024-04-17T15:41:52.677443+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.677443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:35.794425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.518571+0000","last_change":"2024-04-17T15:41:21.518571+0000","last_active":"2024-04-17T15:41:21.518571+0000","last_peered":"2024-04-17T15:41:21.518571+0000","last_clean":"2024-04-17T15:41:21.518571+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:41:21.518571+0000","last_undegraded":"2024-04-17T15:41:21.518571+0000","last_fullsized":"2024-04-17T15:41:21.518571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:21.518229+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:21.518229+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.518229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:19.754292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"130'38","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.352217+0000","last_change":"2024-04-17T15:41:32.352217+0000","last_active":"2024-04-17T15:41:32.352217+0000","last_peered":"2024-04-17T15:41:32.352217+0000","last_clean":"2024-04-17T15:41:32.352217+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:41:32.352217+0000","last_undegraded":"2024-04-17T15:41:32.352217+0000","last_fullsized":"2024-04-17T15:41:32.352217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:32.351945+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:32.351945+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.351945+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:53.957332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.894223+0000","last_change":"2024-04-17T15:41:29.894223+0000","last_active":"2024-04-17T15:41:29.894223+0000","last_peered":"2024-04-17T15:41:29.894223+0000","last_clean":"2024-04-17T15:41:29.894223+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:41:29.894223+0000","last_undegraded":"2024-04-17T15:41:29.894223+0000","last_fullsized":"2024-04-17T15:41:29.894223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:29.893844+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:29.893844+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.893844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:42.656316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.338947+0000","last_change":"2024-04-17T15:41:31.338947+0000","last_active":"2024-04-17T15:41:31.338947+0000","last_peered":"2024-04-17T15:41:31.338947+0000","last_clean":"2024-04-17T15:41:31.338947+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:41:31.338947+0000","last_undegraded":"2024-04-17T15:41:31.338947+0000","last_fullsized":"2024-04-17T15:41:31.338947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:31.338675+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:31.338675+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.338675+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:57:35.506887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.859707+0000","last_change":"2024-04-17T15:41:24.859707+0000","last_active":"2024-04-17T15:41:24.859707+0000","last_peered":"2024-04-17T15:41:24.859707+0000","last_clean":"2024-04-17T15:41:24.859707+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:41:24.859707+0000","last_undegraded":"2024-04-17T15:41:24.859707+0000","last_fullsized":"2024-04-17T15:41:24.859707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'14","last_scrub_stamp":"2024-04-17T15:41:24.859436+0000","last_deep_scrub":"90'14","last_deep_scrub_stamp":"2024-04-17T15:41:24.859436+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.859436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:24:28.370533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"130'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.180166+0000","last_change":"2024-04-17T15:41:41.180166+0000","last_active":"2024-04-17T15:41:41.180166+0000","last_peered":"2024-04-17T15:41:41.180166+0000","last_clean":"2024-04-17T15:41:41.180166+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:41:41.180166+0000","last_undegraded":"2024-04-17T15:41:41.180166+0000","last_fullsized":"2024-04-17T15:41:41.180166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:41.179912+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:41.179912+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.179912+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:37:58.777061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.790501+0000","last_change":"2024-04-17T15:41:27.790501+0000","last_active":"2024-04-17T15:41:27.790501+0000","last_peered":"2024-04-17T15:41:27.790501+0000","last_clean":"2024-04-17T15:41:27.790501+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:41:27.790501+0000","last_undegraded":"2024-04-17T15:41:27.790501+0000","last_fullsized":"2024-04-17T15:41:27.790501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-17T15:41:27.790233+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-17T15:41:27.790233+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.790233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:19:14.364970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"130'40","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.674475+0000","last_change":"2024-04-17T15:41:40.674475+0000","last_active":"2024-04-17T15:41:40.674475+0000","last_peered":"2024-04-17T15:41:40.674475+0000","last_clean":"2024-04-17T15:41:40.674475+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:41:40.674475+0000","last_undegraded":"2024-04-17T15:41:40.674475+0000","last_fullsized":"2024-04-17T15:41:40.674475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'40","last_scrub_stamp":"2024-04-17T15:41:40.674221+0000","last_deep_scrub":"130'40","last_deep_scrub_stamp":"2024-04-17T15:41:40.674221+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.674221+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:23:54.146356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.056174+0000","last_change":"2024-04-17T15:41:35.056174+0000","last_active":"2024-04-17T15:41:35.056174+0000","last_peered":"2024-04-17T15:41:35.056174+0000","last_clean":"2024-04-17T15:41:35.056174+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:41:35.056174+0000","last_undegraded":"2024-04-17T15:41:35.056174+0000","last_fullsized":"2024-04-17T15:41:35.056174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'6","last_scrub_stamp":"2024-04-17T15:41:35.055896+0000","last_deep_scrub":"112'6","last_deep_scrub_stamp":"2024-04-17T15:41:35.055896+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.055896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:37.223590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"130'48","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.567580+0000","last_change":"2024-04-17T15:41:42.567651+0000","last_active":"2024-04-17T15:41:42.567580+0000","last_peered":"2024-04-17T15:41:42.567580+0000","last_clean":"2024-04-17T15:41:42.567580+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:41:42.567580+0000","last_undegraded":"2024-04-17T15:41:42.567580+0000","last_fullsized":"2024-04-17T15:41:42.567580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:42.567359+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:42.567359+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.567359+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:28.682988+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:53.380195+0000","last_change":"2024-04-17T15:41:53.380195+0000","last_active":"2024-04-17T15:41:53.380195+0000","last_peered":"2024-04-17T15:41:53.380195+0000","last_clean":"2024-04-17T15:41:53.380195+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:41:53.380195+0000","last_undegraded":"2024-04-17T15:41:53.380195+0000","last_fullsized":"2024-04-17T15:41:53.380195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-17T15:41:53.379919+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-17T15:41:53.379919+0000","last_clean_scrub_stamp":"2024-04-17T15:41:53.379919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:59:27.758278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.590969+0000","last_change":"2024-04-17T15:41:36.591060+0000","last_active":"2024-04-17T15:41:36.590969+0000","last_peered":"2024-04-17T15:41:36.590969+0000","last_clean":"2024-04-17T15:41:36.590969+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:41:36.590969+0000","last_undegraded":"2024-04-17T15:41:36.590969+0000","last_fullsized":"2024-04-17T15:41:36.590969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:36.590741+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:36.590741+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.590741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:57:33.412196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"130'52","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.531281+0000","last_change":"2024-04-17T15:41:32.531281+0000","last_active":"2024-04-17T15:41:32.531281+0000","last_peered":"2024-04-17T15:41:32.531281+0000","last_clean":"2024-04-17T15:41:32.531281+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:41:32.531281+0000","last_undegraded":"2024-04-17T15:41:32.531281+0000","last_fullsized":"2024-04-17T15:41:32.531281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'52","last_scrub_stamp":"2024-04-17T15:41:32.531024+0000","last_deep_scrub":"130'52","last_deep_scrub_stamp":"2024-04-17T15:41:32.531024+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.531024+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.293496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.857605+0000","last_change":"2024-04-17T15:41:28.857605+0000","last_active":"2024-04-17T15:41:28.857605+0000","last_peered":"2024-04-17T15:41:28.857605+0000","last_clean":"2024-04-17T15:41:28.857605+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:41:28.857605+0000","last_undegraded":"2024-04-17T15:41:28.857605+0000","last_fullsized":"2024-04-17T15:41:28.857605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.857277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.857277+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.857277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:01.056340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"130'23","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.600731+0000","last_change":"2024-04-17T15:41:19.600731+0000","last_active":"2024-04-17T15:41:19.600731+0000","last_peered":"2024-04-17T15:41:19.600731+0000","last_clean":"2024-04-17T15:41:19.600731+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:41:19.600731+0000","last_undegraded":"2024-04-17T15:41:19.600731+0000","last_fullsized":"2024-04-17T15:41:19.600731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'23","last_scrub_stamp":"2024-04-17T15:41:19.600479+0000","last_deep_scrub":"130'23","last_deep_scrub_stamp":"2024-04-17T15:41:19.600479+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.600479+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:20:27.832350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.643073+0000","last_change":"2024-04-17T15:41:48.643073+0000","last_active":"2024-04-17T15:41:48.643073+0000","last_peered":"2024-04-17T15:41:48.643073+0000","last_clean":"2024-04-17T15:41:48.643073+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:41:48.643073+0000","last_undegraded":"2024-04-17T15:41:48.643073+0000","last_fullsized":"2024-04-17T15:41:48.643073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:48.642765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:48.642765+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.642765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:27.987375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"130'53","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.194531+0000","last_change":"2024-04-17T15:41:52.194531+0000","last_active":"2024-04-17T15:41:52.194531+0000","last_peered":"2024-04-17T15:41:52.194531+0000","last_clean":"2024-04-17T15:41:52.194531+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:41:52.194531+0000","last_undegraded":"2024-04-17T15:41:52.194531+0000","last_fullsized":"2024-04-17T15:41:52.194531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'53","last_scrub_stamp":"2024-04-17T15:41:52.194193+0000","last_deep_scrub":"130'53","last_deep_scrub_stamp":"2024-04-17T15:41:52.194193+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.194193+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:13:42.015063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.784439+0000","last_change":"2024-04-17T15:41:24.784439+0000","last_active":"2024-04-17T15:41:24.784439+0000","last_peered":"2024-04-17T15:41:24.784439+0000","last_clean":"2024-04-17T15:41:24.784439+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:41:24.784439+0000","last_undegraded":"2024-04-17T15:41:24.784439+0000","last_fullsized":"2024-04-17T15:41:24.784439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-17T15:41:24.784150+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-17T15:41:24.784150+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.784150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:54.779594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"130'36","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.657345+0000","last_change":"2024-04-17T15:41:35.657345+0000","last_active":"2024-04-17T15:41:35.657345+0000","last_peered":"2024-04-17T15:41:35.657345+0000","last_clean":"2024-04-17T15:41:35.657345+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:41:35.657345+0000","last_undegraded":"2024-04-17T15:41:35.657345+0000","last_fullsized":"2024-04-17T15:41:35.657345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'36","last_scrub_stamp":"2024-04-17T15:41:35.657082+0000","last_deep_scrub":"130'36","last_deep_scrub_stamp":"2024-04-17T15:41:35.657082+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.657082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:30.666682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.638165+0000","last_change":"2024-04-17T15:41:37.638165+0000","last_active":"2024-04-17T15:41:37.638165+0000","last_peered":"2024-04-17T15:41:37.638165+0000","last_clean":"2024-04-17T15:41:37.638165+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:41:37.638165+0000","last_undegraded":"2024-04-17T15:41:37.638165+0000","last_fullsized":"2024-04-17T15:41:37.638165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.637910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.637910+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.637910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:50:36.988918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"130'9","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.964582+0000","last_change":"2024-04-17T15:41:20.964582+0000","last_active":"2024-04-17T15:41:20.964582+0000","last_peered":"2024-04-17T15:41:20.964582+0000","last_clean":"2024-04-17T15:41:20.964582+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:41:20.964582+0000","last_undegraded":"2024-04-17T15:41:20.964582+0000","last_fullsized":"2024-04-17T15:41:20.964582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'9","last_scrub_stamp":"2024-04-17T15:41:20.964292+0000","last_deep_scrub":"130'9","last_deep_scrub_stamp":"2024-04-17T15:41:20.964292+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.964292+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:40.604526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.276078+0000","last_change":"2024-04-17T15:41:48.276078+0000","last_active":"2024-04-17T15:41:48.276078+0000","last_peered":"2024-04-17T15:41:48.276078+0000","last_clean":"2024-04-17T15:41:48.276078+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:41:48.276078+0000","last_undegraded":"2024-04-17T15:41:48.276078+0000","last_fullsized":"2024-04-17T15:41:48.276078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:48.275702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:48.275702+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.275702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:47:43.523103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.631016+0000","last_change":"2024-04-17T15:41:52.631079+0000","last_active":"2024-04-17T15:41:52.631016+0000","last_peered":"2024-04-17T15:41:52.631016+0000","last_clean":"2024-04-17T15:41:52.631016+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:41:52.631016+0000","last_undegraded":"2024-04-17T15:41:52.631016+0000","last_fullsized":"2024-04-17T15:41:52.631016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:52.630798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:52.630798+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.630798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:36:27.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.618274+0000","last_change":"2024-04-17T15:41:29.618274+0000","last_active":"2024-04-17T15:41:29.618274+0000","last_peered":"2024-04-17T15:41:29.618274+0000","last_clean":"2024-04-17T15:41:29.618274+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:41:29.618274+0000","last_undegraded":"2024-04-17T15:41:29.618274+0000","last_fullsized":"2024-04-17T15:41:29.618274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:29.618029+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:29.618029+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.618029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:31.723480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"130'64","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.640152+0000","last_change":"2024-04-17T15:41:36.640212+0000","last_active":"2024-04-17T15:41:36.640152+0000","last_peered":"2024-04-17T15:41:36.640152+0000","last_clean":"2024-04-17T15:41:36.640152+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:41:36.640152+0000","last_undegraded":"2024-04-17T15:41:36.640152+0000","last_fullsized":"2024-04-17T15:41:36.640152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'64","last_scrub_stamp":"2024-04-17T15:41:36.639951+0000","last_deep_scrub":"130'64","last_deep_scrub_stamp":"2024-04-17T15:41:36.639951+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.639951+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:18:33.310304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.629316+0000","last_change":"2024-04-17T15:41:31.629316+0000","last_active":"2024-04-17T15:41:31.629316+0000","last_peered":"2024-04-17T15:41:31.629316+0000","last_clean":"2024-04-17T15:41:31.629316+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:41:31.629316+0000","last_undegraded":"2024-04-17T15:41:31.629316+0000","last_fullsized":"2024-04-17T15:41:31.629316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.629060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.629060+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.629060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:44.224061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"130'16","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.792764+0000","last_change":"2024-04-17T15:41:28.792764+0000","last_active":"2024-04-17T15:41:28.792764+0000","last_peered":"2024-04-17T15:41:28.792764+0000","last_clean":"2024-04-17T15:41:28.792764+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:41:28.792764+0000","last_undegraded":"2024-04-17T15:41:28.792764+0000","last_fullsized":"2024-04-17T15:41:28.792764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-17T15:41:28.792469+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-17T15:41:28.792469+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.792469+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:00:34.058105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'139","reported_seq":412,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.625401+0000","last_change":"2024-04-17T15:41:46.625401+0000","last_active":"2024-04-17T15:41:46.625401+0000","last_peered":"2024-04-17T15:41:46.625401+0000","last_clean":"2024-04-17T15:41:46.625401+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:41:46.625401+0000","last_undegraded":"2024-04-17T15:41:46.625401+0000","last_fullsized":"2024-04-17T15:41:46.625401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'139","last_scrub_stamp":"2024-04-17T15:41:46.625140+0000","last_deep_scrub":"130'139","last_deep_scrub_stamp":"2024-04-17T15:41:46.625140+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.625140+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:53.102607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.260125+0000","last_change":"2024-04-17T15:41:50.260192+0000","last_active":"2024-04-17T15:41:50.260125+0000","last_peered":"2024-04-17T15:41:50.260125+0000","last_clean":"2024-04-17T15:41:50.260125+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:41:50.260125+0000","last_undegraded":"2024-04-17T15:41:50.260125+0000","last_fullsized":"2024-04-17T15:41:50.260125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:50.259923+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:50.259923+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.259923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:19:45.110213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.613037+0000","last_change":"2024-04-17T15:41:27.613037+0000","last_active":"2024-04-17T15:41:27.613037+0000","last_peered":"2024-04-17T15:41:27.613037+0000","last_clean":"2024-04-17T15:41:27.613037+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:41:27.613037+0000","last_undegraded":"2024-04-17T15:41:27.613037+0000","last_fullsized":"2024-04-17T15:41:27.613037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'12","last_scrub_stamp":"2024-04-17T15:41:27.612626+0000","last_deep_scrub":"98'12","last_deep_scrub_stamp":"2024-04-17T15:41:27.612626+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.612626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:39:17.082170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"130'64","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.410912+0000","last_change":"2024-04-17T15:41:27.410912+0000","last_active":"2024-04-17T15:41:27.410912+0000","last_peered":"2024-04-17T15:41:27.410912+0000","last_clean":"2024-04-17T15:41:27.410912+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:41:27.410912+0000","last_undegraded":"2024-04-17T15:41:27.410912+0000","last_fullsized":"2024-04-17T15:41:27.410912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'64","last_scrub_stamp":"2024-04-17T15:41:27.410662+0000","last_deep_scrub":"130'64","last_deep_scrub_stamp":"2024-04-17T15:41:27.410662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.410662+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:04.407705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.940497+0000","last_change":"2024-04-17T15:41:32.940497+0000","last_active":"2024-04-17T15:41:32.940497+0000","last_peered":"2024-04-17T15:41:32.940497+0000","last_clean":"2024-04-17T15:41:32.940497+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:41:32.940497+0000","last_undegraded":"2024-04-17T15:41:32.940497+0000","last_fullsized":"2024-04-17T15:41:32.940497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:32.940096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:32.940096+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.940096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:02.485981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"130'23","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.544489+0000","last_change":"2024-04-17T15:41:18.544489+0000","last_active":"2024-04-17T15:41:18.544489+0000","last_peered":"2024-04-17T15:41:18.544489+0000","last_clean":"2024-04-17T15:41:18.544489+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:41:18.544489+0000","last_undegraded":"2024-04-17T15:41:18.544489+0000","last_fullsized":"2024-04-17T15:41:18.544489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'23","last_scrub_stamp":"2024-04-17T15:41:18.544178+0000","last_deep_scrub":"130'23","last_deep_scrub_stamp":"2024-04-17T15:41:18.544178+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.544178+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:38:14.896230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'138","reported_seq":491,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.671540+0000","last_change":"2024-04-17T15:41:19.671540+0000","last_active":"2024-04-17T15:41:19.671540+0000","last_peered":"2024-04-17T15:41:19.671540+0000","last_clean":"2024-04-17T15:41:19.671540+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:41:19.671540+0000","last_undegraded":"2024-04-17T15:41:19.671540+0000","last_fullsized":"2024-04-17T15:41:19.671540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:19.671263+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:19.671263+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.671263+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:55.652499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.838593+0000","last_change":"2024-04-17T15:41:26.838726+0000","last_active":"2024-04-17T15:41:26.838593+0000","last_peered":"2024-04-17T15:41:26.838593+0000","last_clean":"2024-04-17T15:41:26.838593+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:41:26.838593+0000","last_undegraded":"2024-04-17T15:41:26.838593+0000","last_fullsized":"2024-04-17T15:41:26.838593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'6","last_scrub_stamp":"2024-04-17T15:41:26.838284+0000","last_deep_scrub":"112'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.838284+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.838284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:58.541347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"130'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.553846+0000","last_change":"2024-04-17T15:41:28.553916+0000","last_active":"2024-04-17T15:41:28.553846+0000","last_peered":"2024-04-17T15:41:28.553846+0000","last_clean":"2024-04-17T15:41:28.553846+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:41:28.553846+0000","last_undegraded":"2024-04-17T15:41:28.553846+0000","last_fullsized":"2024-04-17T15:41:28.553846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:28.553599+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:28.553599+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.553599+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.212311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.548510+0000","last_change":"2024-04-17T15:41:25.548695+0000","last_active":"2024-04-17T15:41:25.548510+0000","last_peered":"2024-04-17T15:41:25.548510+0000","last_clean":"2024-04-17T15:41:25.548510+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:41:25.548510+0000","last_undegraded":"2024-04-17T15:41:25.548510+0000","last_fullsized":"2024-04-17T15:41:25.548510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:25.548222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:25.548222+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.548222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:26.109015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"130'38","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.708552+0000","last_change":"2024-04-17T15:41:18.708552+0000","last_active":"2024-04-17T15:41:18.708552+0000","last_peered":"2024-04-17T15:41:18.708552+0000","last_clean":"2024-04-17T15:41:18.708552+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:41:18.708552+0000","last_undegraded":"2024-04-17T15:41:18.708552+0000","last_fullsized":"2024-04-17T15:41:18.708552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:18.708164+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:18.708164+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.708164+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:16.944227+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.513515+0000","last_change":"2024-04-17T15:41:38.513570+0000","last_active":"2024-04-17T15:41:38.513515+0000","last_peered":"2024-04-17T15:41:38.513515+0000","last_clean":"2024-04-17T15:41:38.513515+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:41:38.513515+0000","last_undegraded":"2024-04-17T15:41:38.513515+0000","last_fullsized":"2024-04-17T15:41:38.513515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:38.513298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:38.513298+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.513298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:13.578263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.148509+0000","last_change":"2024-04-17T15:41:51.148570+0000","last_active":"2024-04-17T15:41:51.148509+0000","last_peered":"2024-04-17T15:41:51.148509+0000","last_clean":"2024-04-17T15:41:51.148509+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:41:51.148509+0000","last_undegraded":"2024-04-17T15:41:51.148509+0000","last_fullsized":"2024-04-17T15:41:51.148509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:51.148298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:51.148298+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.148298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:43.291418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.231740+0000","last_change":"2024-04-17T15:41:44.231806+0000","last_active":"2024-04-17T15:41:44.231740+0000","last_peered":"2024-04-17T15:41:44.231740+0000","last_clean":"2024-04-17T15:41:44.231740+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:41:44.231740+0000","last_undegraded":"2024-04-17T15:41:44.231740+0000","last_fullsized":"2024-04-17T15:41:44.231740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'14","last_scrub_stamp":"2024-04-17T15:41:44.231509+0000","last_deep_scrub":"98'14","last_deep_scrub_stamp":"2024-04-17T15:41:44.231509+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.231509+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:10.492377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"130'22","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.511631+0000","last_change":"2024-04-17T15:41:30.511692+0000","last_active":"2024-04-17T15:41:30.511631+0000","last_peered":"2024-04-17T15:41:30.511631+0000","last_clean":"2024-04-17T15:41:30.511631+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:41:30.511631+0000","last_undegraded":"2024-04-17T15:41:30.511631+0000","last_fullsized":"2024-04-17T15:41:30.511631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'22","last_scrub_stamp":"2024-04-17T15:41:30.511439+0000","last_deep_scrub":"130'22","last_deep_scrub_stamp":"2024-04-17T15:41:30.511439+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.511439+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:07.923890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.882775+0000","last_change":"2024-04-17T15:41:15.882775+0000","last_active":"2024-04-17T15:41:15.882775+0000","last_peered":"2024-04-17T15:41:15.882775+0000","last_clean":"2024-04-17T15:41:15.882775+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:41:15.882775+0000","last_undegraded":"2024-04-17T15:41:15.882775+0000","last_fullsized":"2024-04-17T15:41:15.882775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.882598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.882598+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.882598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:40:28.164354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"130'25","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.744933+0000","last_change":"2024-04-17T15:41:49.745014+0000","last_active":"2024-04-17T15:41:49.744933+0000","last_peered":"2024-04-17T15:41:49.744933+0000","last_clean":"2024-04-17T15:41:49.744933+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:41:49.744933+0000","last_undegraded":"2024-04-17T15:41:49.744933+0000","last_fullsized":"2024-04-17T15:41:49.744933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'25","last_scrub_stamp":"2024-04-17T15:41:49.744737+0000","last_deep_scrub":"130'25","last_deep_scrub_stamp":"2024-04-17T15:41:49.744737+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.744737+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:38.480384+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.664017+0000","last_change":"2024-04-17T15:41:23.664075+0000","last_active":"2024-04-17T15:41:23.664017+0000","last_peered":"2024-04-17T15:41:23.664017+0000","last_clean":"2024-04-17T15:41:23.664017+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:41:23.664017+0000","last_undegraded":"2024-04-17T15:41:23.664017+0000","last_fullsized":"2024-04-17T15:41:23.664017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.663756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.663756+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.663756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:56:55.726756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.424301+0000","last_change":"2024-04-17T15:41:39.424360+0000","last_active":"2024-04-17T15:41:39.424301+0000","last_peered":"2024-04-17T15:41:39.424301+0000","last_clean":"2024-04-17T15:41:39.424301+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:41:39.424301+0000","last_undegraded":"2024-04-17T15:41:39.424301+0000","last_fullsized":"2024-04-17T15:41:39.424301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:39.424110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:39.424110+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.424110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:34.626149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.324344+0000","last_change":"2024-04-17T15:41:21.324413+0000","last_active":"2024-04-17T15:41:21.324344+0000","last_peered":"2024-04-17T15:41:21.324344+0000","last_clean":"2024-04-17T15:41:21.324344+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:41:21.324344+0000","last_undegraded":"2024-04-17T15:41:21.324344+0000","last_fullsized":"2024-04-17T15:41:21.324344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'8","last_scrub_stamp":"2024-04-17T15:41:21.324137+0000","last_deep_scrub":"112'8","last_deep_scrub_stamp":"2024-04-17T15:41:21.324137+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.324137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:47:21.947173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"130'40","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.583835+0000","last_change":"2024-04-17T15:41:41.583900+0000","last_active":"2024-04-17T15:41:41.583835+0000","last_peered":"2024-04-17T15:41:41.583835+0000","last_clean":"2024-04-17T15:41:41.583835+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:41:41.583835+0000","last_undegraded":"2024-04-17T15:41:41.583835+0000","last_fullsized":"2024-04-17T15:41:41.583835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'40","last_scrub_stamp":"2024-04-17T15:41:41.583607+0000","last_deep_scrub":"130'40","last_deep_scrub_stamp":"2024-04-17T15:41:41.583607+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.583607+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:51.961297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.920383+0000","last_change":"2024-04-17T15:41:16.920383+0000","last_active":"2024-04-17T15:41:16.920383+0000","last_peered":"2024-04-17T15:41:16.920383+0000","last_clean":"2024-04-17T15:41:16.920383+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:41:16.920383+0000","last_undegraded":"2024-04-17T15:41:16.920383+0000","last_fullsized":"2024-04-17T15:41:16.920383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.920269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.920269+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.920269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:30.123465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"130'35","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.494452+0000","last_change":"2024-04-17T15:41:31.494534+0000","last_active":"2024-04-17T15:41:31.494452+0000","last_peered":"2024-04-17T15:41:31.494452+0000","last_clean":"2024-04-17T15:41:31.494452+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:41:31.494452+0000","last_undegraded":"2024-04-17T15:41:31.494452+0000","last_fullsized":"2024-04-17T15:41:31.494452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'35","last_scrub_stamp":"2024-04-17T15:41:31.494253+0000","last_deep_scrub":"130'35","last_deep_scrub_stamp":"2024-04-17T15:41:31.494253+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.494253+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:03.693316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":151,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"130'139","reported_seq":415,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.623039+0000","last_change":"2024-04-17T15:41:47.623108+0000","last_active":"2024-04-17T15:41:47.623039+0000","last_peered":"2024-04-17T15:41:47.623039+0000","last_clean":"2024-04-17T15:41:47.623039+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:41:47.623039+0000","last_undegraded":"2024-04-17T15:41:47.623039+0000","last_fullsized":"2024-04-17T15:41:47.623039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'139","last_scrub_stamp":"2024-04-17T15:41:47.622786+0000","last_deep_scrub":"130'139","last_deep_scrub_stamp":"2024-04-17T15:41:47.622786+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.622786+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:43:05.418475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.677386+0000","last_change":"2024-04-17T15:41:51.677441+0000","last_active":"2024-04-17T15:41:51.677386+0000","last_peered":"2024-04-17T15:41:51.677386+0000","last_clean":"2024-04-17T15:41:51.677386+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:41:51.677386+0000","last_undegraded":"2024-04-17T15:41:51.677386+0000","last_fullsized":"2024-04-17T15:41:51.677386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:51.677176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:51.677176+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.677176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:40:03.017072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.674154+0000","last_change":"2024-04-17T15:41:31.674211+0000","last_active":"2024-04-17T15:41:31.674154+0000","last_peered":"2024-04-17T15:41:31.674154+0000","last_clean":"2024-04-17T15:41:31.674154+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:41:31.674154+0000","last_undegraded":"2024-04-17T15:41:31.674154+0000","last_fullsized":"2024-04-17T15:41:31.674154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.673958+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:31.641587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.108630+0000","last_change":"2024-04-17T15:41:45.108788+0000","last_active":"2024-04-17T15:41:45.108630+0000","last_peered":"2024-04-17T15:41:45.108630+0000","last_clean":"2024-04-17T15:41:45.108630+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:41:45.108630+0000","last_undegraded":"2024-04-17T15:41:45.108630+0000","last_fullsized":"2024-04-17T15:41:45.108630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:45.108390+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:45.108390+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.108390+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:10:55.660655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.974163+0000","last_change":"2024-04-17T15:41:19.974163+0000","last_active":"2024-04-17T15:41:19.974163+0000","last_peered":"2024-04-17T15:41:19.974163+0000","last_clean":"2024-04-17T15:41:19.974163+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:41:19.974163+0000","last_undegraded":"2024-04-17T15:41:19.974163+0000","last_fullsized":"2024-04-17T15:41:19.974163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.973921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.973921+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.973921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:46.132982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"130'39","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.676347+0000","last_change":"2024-04-17T15:41:34.676425+0000","last_active":"2024-04-17T15:41:34.676347+0000","last_peered":"2024-04-17T15:41:34.676347+0000","last_clean":"2024-04-17T15:41:34.676347+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:41:34.676347+0000","last_undegraded":"2024-04-17T15:41:34.676347+0000","last_fullsized":"2024-04-17T15:41:34.676347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'39","last_scrub_stamp":"2024-04-17T15:41:34.676154+0000","last_deep_scrub":"130'39","last_deep_scrub_stamp":"2024-04-17T15:41:34.676154+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.676154+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:37:52.273303+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.747022+0000","last_change":"2024-04-17T15:41:30.747076+0000","last_active":"2024-04-17T15:41:30.747022+0000","last_peered":"2024-04-17T15:41:30.747022+0000","last_clean":"2024-04-17T15:41:30.747022+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:41:30.747022+0000","last_undegraded":"2024-04-17T15:41:30.747022+0000","last_fullsized":"2024-04-17T15:41:30.747022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:30.746811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:30.746811+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.746811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:07:17.390374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"130'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.499677+0000","last_change":"2024-04-17T15:41:43.499738+0000","last_active":"2024-04-17T15:41:43.499677+0000","last_peered":"2024-04-17T15:41:43.499677+0000","last_clean":"2024-04-17T15:41:43.499677+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:41:43.499677+0000","last_undegraded":"2024-04-17T15:41:43.499677+0000","last_fullsized":"2024-04-17T15:41:43.499677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'6","last_scrub_stamp":"2024-04-17T15:41:43.499488+0000","last_deep_scrub":"130'6","last_deep_scrub_stamp":"2024-04-17T15:41:43.499488+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.499488+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:22:10.787762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.146599+0000","last_change":"2024-04-17T15:41:37.146653+0000","last_active":"2024-04-17T15:41:37.146599+0000","last_peered":"2024-04-17T15:41:37.146599+0000","last_clean":"2024-04-17T15:41:37.146599+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:41:37.146599+0000","last_undegraded":"2024-04-17T15:41:37.146599+0000","last_fullsized":"2024-04-17T15:41:37.146599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.146395+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.146395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:37:39.812659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"130'42","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.716678+0000","last_change":"2024-04-17T15:41:44.716736+0000","last_active":"2024-04-17T15:41:44.716678+0000","last_peered":"2024-04-17T15:41:44.716678+0000","last_clean":"2024-04-17T15:41:44.716678+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:41:44.716678+0000","last_undegraded":"2024-04-17T15:41:44.716678+0000","last_fullsized":"2024-04-17T15:41:44.716678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:44.716489+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:44.716489+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.716489+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:45.580892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.003296+0000","last_change":"2024-04-17T15:41:19.003296+0000","last_active":"2024-04-17T15:41:19.003296+0000","last_peered":"2024-04-17T15:41:19.003296+0000","last_clean":"2024-04-17T15:41:19.003296+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:41:19.003296+0000","last_undegraded":"2024-04-17T15:41:19.003296+0000","last_fullsized":"2024-04-17T15:41:19.003296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.003037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.003037+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.003037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:36:30.103992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"130'26","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.859010+0000","last_change":"2024-04-17T15:41:17.859010+0000","last_active":"2024-04-17T15:41:17.859010+0000","last_peered":"2024-04-17T15:41:17.859010+0000","last_clean":"2024-04-17T15:41:17.859010+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:41:17.859010+0000","last_undegraded":"2024-04-17T15:41:17.859010+0000","last_fullsized":"2024-04-17T15:41:17.859010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:17.858698+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:17.858698+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.858698+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:49.387644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.573820+0000","last_change":"2024-04-17T15:41:20.573820+0000","last_active":"2024-04-17T15:41:20.573820+0000","last_peered":"2024-04-17T15:41:20.573820+0000","last_clean":"2024-04-17T15:41:20.573820+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:41:20.573820+0000","last_undegraded":"2024-04-17T15:41:20.573820+0000","last_fullsized":"2024-04-17T15:41:20.573820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.573596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.573596+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.573596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:08.232307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"130'2","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.726223+0000","last_change":"2024-04-17T15:41:52.726309+0000","last_active":"2024-04-17T15:41:52.726223+0000","last_peered":"2024-04-17T15:41:52.726223+0000","last_clean":"2024-04-17T15:41:52.726223+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:41:52.726223+0000","last_undegraded":"2024-04-17T15:41:52.726223+0000","last_fullsized":"2024-04-17T15:41:52.726223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:52.726030+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:52.726030+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.726030+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:19.207192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.931854+0000","last_change":"2024-04-17T15:41:23.931854+0000","last_active":"2024-04-17T15:41:23.931854+0000","last_peered":"2024-04-17T15:41:23.931854+0000","last_clean":"2024-04-17T15:41:23.931854+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:41:23.931854+0000","last_undegraded":"2024-04-17T15:41:23.931854+0000","last_fullsized":"2024-04-17T15:41:23.931854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.931597+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.931597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:26:48.545570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"130'54","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.418665+0000","last_change":"2024-04-17T15:41:28.418733+0000","last_active":"2024-04-17T15:41:28.418665+0000","last_peered":"2024-04-17T15:41:28.418665+0000","last_clean":"2024-04-17T15:41:28.418665+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:41:28.418665+0000","last_undegraded":"2024-04-17T15:41:28.418665+0000","last_fullsized":"2024-04-17T15:41:28.418665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'54","last_scrub_stamp":"2024-04-17T15:41:28.418456+0000","last_deep_scrub":"130'54","last_deep_scrub_stamp":"2024-04-17T15:41:28.418456+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.418456+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:14.332579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.410798+0000","last_change":"2024-04-17T15:41:16.410798+0000","last_active":"2024-04-17T15:41:16.410798+0000","last_peered":"2024-04-17T15:41:16.410798+0000","last_clean":"2024-04-17T15:41:16.410798+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:41:16.410798+0000","last_undegraded":"2024-04-17T15:41:16.410798+0000","last_fullsized":"2024-04-17T15:41:16.410798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.410708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.410708+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.410708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:20:21.792199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"130'32","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.797272+0000","last_change":"2024-04-17T15:41:29.797272+0000","last_active":"2024-04-17T15:41:29.797272+0000","last_peered":"2024-04-17T15:41:29.797272+0000","last_clean":"2024-04-17T15:41:29.797272+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:41:29.797272+0000","last_undegraded":"2024-04-17T15:41:29.797272+0000","last_fullsized":"2024-04-17T15:41:29.797272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:29.797005+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:29.797005+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.797005+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:19:47.460252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"130'138","reported_seq":457,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.763214+0000","last_change":"2024-04-17T15:41:31.763280+0000","last_active":"2024-04-17T15:41:31.763214+0000","last_peered":"2024-04-17T15:41:31.763214+0000","last_clean":"2024-04-17T15:41:31.763214+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:41:31.763214+0000","last_undegraded":"2024-04-17T15:41:31.763214+0000","last_fullsized":"2024-04-17T15:41:31.763214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:31.762996+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:31.762996+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.762996+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:11.486658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.555054+0000","last_change":"2024-04-17T15:41:41.555120+0000","last_active":"2024-04-17T15:41:41.555054+0000","last_peered":"2024-04-17T15:41:41.555054+0000","last_clean":"2024-04-17T15:41:41.555054+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:41:41.555054+0000","last_undegraded":"2024-04-17T15:41:41.555054+0000","last_fullsized":"2024-04-17T15:41:41.555054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-17T15:41:41.554794+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-17T15:41:41.554794+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.554794+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:37:44.221058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.988205+0000","last_change":"2024-04-17T15:41:21.988205+0000","last_active":"2024-04-17T15:41:21.988205+0000","last_peered":"2024-04-17T15:41:21.988205+0000","last_clean":"2024-04-17T15:41:21.988205+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:41:21.988205+0000","last_undegraded":"2024-04-17T15:41:21.988205+0000","last_fullsized":"2024-04-17T15:41:21.988205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-17T15:41:21.987932+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-17T15:41:21.987932+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.987932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:37:21.925709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"130'48","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.134502+0000","last_change":"2024-04-17T15:41:40.134572+0000","last_active":"2024-04-17T15:41:40.134502+0000","last_peered":"2024-04-17T15:41:40.134502+0000","last_clean":"2024-04-17T15:41:40.134502+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:41:40.134502+0000","last_undegraded":"2024-04-17T15:41:40.134502+0000","last_fullsized":"2024-04-17T15:41:40.134502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:40.134281+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:40.134281+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.134281+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:55.081246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"130'4","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.974117+0000","last_change":"2024-04-17T15:41:34.974187+0000","last_active":"2024-04-17T15:41:34.974117+0000","last_peered":"2024-04-17T15:41:34.974117+0000","last_clean":"2024-04-17T15:41:34.974117+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:41:34.974117+0000","last_undegraded":"2024-04-17T15:41:34.974117+0000","last_fullsized":"2024-04-17T15:41:34.974117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'4","last_scrub_stamp":"2024-04-17T15:41:34.973920+0000","last_deep_scrub":"130'4","last_deep_scrub_stamp":"2024-04-17T15:41:34.973920+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.973920+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:37.079372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"130'15","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.716392+0000","last_change":"2024-04-17T15:41:20.716392+0000","last_active":"2024-04-17T15:41:20.716392+0000","last_peered":"2024-04-17T15:41:20.716392+0000","last_clean":"2024-04-17T15:41:20.716392+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:41:20.716392+0000","last_undegraded":"2024-04-17T15:41:20.716392+0000","last_fullsized":"2024-04-17T15:41:20.716392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'15","last_scrub_stamp":"2024-04-17T15:41:20.715961+0000","last_deep_scrub":"130'15","last_deep_scrub_stamp":"2024-04-17T15:41:20.715961+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.715961+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:31.497504+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"130'138","reported_seq":464,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.386431+0000","last_change":"2024-04-17T15:41:34.386500+0000","last_active":"2024-04-17T15:41:34.386431+0000","last_peered":"2024-04-17T15:41:34.386431+0000","last_clean":"2024-04-17T15:41:34.386431+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:41:34.386431+0000","last_undegraded":"2024-04-17T15:41:34.386431+0000","last_fullsized":"2024-04-17T15:41:34.386431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:34.386200+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:34.386200+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.386200+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:34.946993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.308024+0000","last_change":"2024-04-17T15:41:51.308092+0000","last_active":"2024-04-17T15:41:51.308024+0000","last_peered":"2024-04-17T15:41:51.308024+0000","last_clean":"2024-04-17T15:41:51.308024+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:41:51.308024+0000","last_undegraded":"2024-04-17T15:41:51.308024+0000","last_fullsized":"2024-04-17T15:41:51.308024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-17T15:41:51.307790+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-17T15:41:51.307790+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.307790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:43.450910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.539306+0000","last_change":"2024-04-17T15:41:27.539373+0000","last_active":"2024-04-17T15:41:27.539306+0000","last_peered":"2024-04-17T15:41:27.539306+0000","last_clean":"2024-04-17T15:41:27.539306+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:41:27.539306+0000","last_undegraded":"2024-04-17T15:41:27.539306+0000","last_fullsized":"2024-04-17T15:41:27.539306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:27.539086+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:27.539086+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.539086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:03.547611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"130'58","reported_seq":300,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.697160+0000","last_change":"2024-04-17T15:41:41.697225+0000","last_active":"2024-04-17T15:41:41.697160+0000","last_peered":"2024-04-17T15:41:41.697160+0000","last_clean":"2024-04-17T15:41:41.697160+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:41:41.697160+0000","last_undegraded":"2024-04-17T15:41:41.697160+0000","last_fullsized":"2024-04-17T15:41:41.697160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'58","last_scrub_stamp":"2024-04-17T15:41:41.696954+0000","last_deep_scrub":"130'58","last_deep_scrub_stamp":"2024-04-17T15:41:41.696954+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.696954+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:13:40.832871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.103273+0000","last_change":"2024-04-17T15:41:36.103328+0000","last_active":"2024-04-17T15:41:36.103273+0000","last_peered":"2024-04-17T15:41:36.103273+0000","last_clean":"2024-04-17T15:41:36.103273+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:41:36.103273+0000","last_undegraded":"2024-04-17T15:41:36.103273+0000","last_fullsized":"2024-04-17T15:41:36.103273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:36.103079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:36.103079+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.103079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:38.208530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"130'36","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.132609+0000","last_change":"2024-04-17T15:41:47.132685+0000","last_active":"2024-04-17T15:41:47.132609+0000","last_peered":"2024-04-17T15:41:47.132609+0000","last_clean":"2024-04-17T15:41:47.132609+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:41:47.132609+0000","last_undegraded":"2024-04-17T15:41:47.132609+0000","last_fullsized":"2024-04-17T15:41:47.132609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'36","last_scrub_stamp":"2024-04-17T15:41:47.132426+0000","last_deep_scrub":"130'36","last_deep_scrub_stamp":"2024-04-17T15:41:47.132426+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.132426+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:12.633507+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.409309+0000","last_change":"2024-04-17T15:41:38.409365+0000","last_active":"2024-04-17T15:41:38.409309+0000","last_peered":"2024-04-17T15:41:38.409309+0000","last_clean":"2024-04-17T15:41:38.409309+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:41:38.409309+0000","last_undegraded":"2024-04-17T15:41:38.409309+0000","last_fullsized":"2024-04-17T15:41:38.409309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:38.409103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:38.409103+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.409103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:04:45.628583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.529560+0000","last_change":"2024-04-17T15:41:42.529620+0000","last_active":"2024-04-17T15:41:42.529560+0000","last_peered":"2024-04-17T15:41:42.529560+0000","last_clean":"2024-04-17T15:41:42.529560+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:41:42.529560+0000","last_undegraded":"2024-04-17T15:41:42.529560+0000","last_fullsized":"2024-04-17T15:41:42.529560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:42.529352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:42.529352+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.529352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:42.496981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.399852+0000","last_change":"2024-04-17T15:41:19.400009+0000","last_active":"2024-04-17T15:41:19.399852+0000","last_peered":"2024-04-17T15:41:19.399852+0000","last_clean":"2024-04-17T15:41:19.399852+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:41:19.399852+0000","last_undegraded":"2024-04-17T15:41:19.399852+0000","last_fullsized":"2024-04-17T15:41:19.399852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:19.399591+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:19.399591+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.399591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:24:22.910688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"130'119","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.611248+0000","last_change":"2024-04-17T15:41:39.611324+0000","last_active":"2024-04-17T15:41:39.611248+0000","last_peered":"2024-04-17T15:41:39.611248+0000","last_clean":"2024-04-17T15:41:39.611248+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:41:39.611248+0000","last_undegraded":"2024-04-17T15:41:39.611248+0000","last_fullsized":"2024-04-17T15:41:39.611248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'119","last_scrub_stamp":"2024-04-17T15:41:39.611071+0000","last_deep_scrub":"130'119","last_deep_scrub_stamp":"2024-04-17T15:41:39.611071+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.611071+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:57:36.903900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.066863+0000","last_change":"2024-04-17T15:41:39.066921+0000","last_active":"2024-04-17T15:41:39.066863+0000","last_peered":"2024-04-17T15:41:39.066863+0000","last_clean":"2024-04-17T15:41:39.066863+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:41:39.066863+0000","last_undegraded":"2024-04-17T15:41:39.066863+0000","last_fullsized":"2024-04-17T15:41:39.066863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:39.066661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:39.066661+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.066661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:49.444351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"130'40","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.764442+0000","last_change":"2024-04-17T15:41:43.764505+0000","last_active":"2024-04-17T15:41:43.764442+0000","last_peered":"2024-04-17T15:41:43.764442+0000","last_clean":"2024-04-17T15:41:43.764442+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:41:43.764442+0000","last_undegraded":"2024-04-17T15:41:43.764442+0000","last_fullsized":"2024-04-17T15:41:43.764442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'40","last_scrub_stamp":"2024-04-17T15:41:43.764249+0000","last_deep_scrub":"130'40","last_deep_scrub_stamp":"2024-04-17T15:41:43.764249+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.764249+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:38:37.215832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.505160+0000","last_change":"2024-04-17T15:41:27.505218+0000","last_active":"2024-04-17T15:41:27.505160+0000","last_peered":"2024-04-17T15:41:27.505160+0000","last_clean":"2024-04-17T15:41:27.505160+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:41:27.505160+0000","last_undegraded":"2024-04-17T15:41:27.505160+0000","last_fullsized":"2024-04-17T15:41:27.505160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:27.504920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:27.504920+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.504920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:57.500364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"130'48","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.723889+0000","last_change":"2024-04-17T15:41:19.723889+0000","last_active":"2024-04-17T15:41:19.723889+0000","last_peered":"2024-04-17T15:41:19.723889+0000","last_clean":"2024-04-17T15:41:19.723889+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:41:19.723889+0000","last_undegraded":"2024-04-17T15:41:19.723889+0000","last_fullsized":"2024-04-17T15:41:19.723889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:19.723620+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:19.723620+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.723620+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:39.363853+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.633668+0000","last_change":"2024-04-17T15:41:17.633668+0000","last_active":"2024-04-17T15:41:17.633668+0000","last_peered":"2024-04-17T15:41:17.633668+0000","last_clean":"2024-04-17T15:41:17.633668+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:41:17.633668+0000","last_undegraded":"2024-04-17T15:41:17.633668+0000","last_fullsized":"2024-04-17T15:41:17.633668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.633428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.633428+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.633428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:26:42.247400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.415737+0000","last_change":"2024-04-17T15:41:40.415797+0000","last_active":"2024-04-17T15:41:40.415737+0000","last_peered":"2024-04-17T15:41:40.415737+0000","last_clean":"2024-04-17T15:41:40.415737+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:41:40.415737+0000","last_undegraded":"2024-04-17T15:41:40.415737+0000","last_fullsized":"2024-04-17T15:41:40.415737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:40.415542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:40.415542+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.415542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.263911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.578723+0000","last_change":"2024-04-17T15:41:25.578792+0000","last_active":"2024-04-17T15:41:25.578723+0000","last_peered":"2024-04-17T15:41:25.578723+0000","last_clean":"2024-04-17T15:41:25.578723+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:41:25.578723+0000","last_undegraded":"2024-04-17T15:41:25.578723+0000","last_fullsized":"2024-04-17T15:41:25.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'16","last_scrub_stamp":"2024-04-17T15:41:25.578500+0000","last_deep_scrub":"112'16","last_deep_scrub_stamp":"2024-04-17T15:41:25.578500+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.578500+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:10.771333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.630737+0000","last_change":"2024-04-17T15:41:37.630796+0000","last_active":"2024-04-17T15:41:37.630737+0000","last_peered":"2024-04-17T15:41:37.630737+0000","last_clean":"2024-04-17T15:41:37.630737+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:41:37.630737+0000","last_undegraded":"2024-04-17T15:41:37.630737+0000","last_fullsized":"2024-04-17T15:41:37.630737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.630505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.630505+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.630505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:39.735956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"130'56","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.683184+0000","last_change":"2024-04-17T15:41:37.683257+0000","last_active":"2024-04-17T15:41:37.683184+0000","last_peered":"2024-04-17T15:41:37.683184+0000","last_clean":"2024-04-17T15:41:37.683184+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:41:37.683184+0000","last_undegraded":"2024-04-17T15:41:37.683184+0000","last_fullsized":"2024-04-17T15:41:37.683184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:37.682962+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:37.682962+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.682962+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:03.943830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"130'2","reported_seq":327,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.883480+0000","last_change":"2024-04-17T15:41:30.883549+0000","last_active":"2024-04-17T15:41:30.883480+0000","last_peered":"2024-04-17T15:41:30.883480+0000","last_clean":"2024-04-17T15:41:30.883480+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:41:30.883480+0000","last_undegraded":"2024-04-17T15:41:30.883480+0000","last_fullsized":"2024-04-17T15:41:30.883480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:30.883291+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:30.883291+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.883291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:16.076124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"130'156","reported_seq":511,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.485445+0000","last_change":"2024-04-17T15:41:24.485530+0000","last_active":"2024-04-17T15:41:24.485445+0000","last_peered":"2024-04-17T15:41:24.485445+0000","last_clean":"2024-04-17T15:41:24.485445+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:41:24.485445+0000","last_undegraded":"2024-04-17T15:41:24.485445+0000","last_fullsized":"2024-04-17T15:41:24.485445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'156","last_scrub_stamp":"2024-04-17T15:41:24.485255+0000","last_deep_scrub":"130'156","last_deep_scrub_stamp":"2024-04-17T15:41:24.485255+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.485255+0000","objects_scrubbed":10,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:22.721318+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.520694+0000","last_change":"2024-04-17T15:41:19.520750+0000","last_active":"2024-04-17T15:41:19.520694+0000","last_peered":"2024-04-17T15:41:19.520694+0000","last_clean":"2024-04-17T15:41:19.520694+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:41:19.520694+0000","last_undegraded":"2024-04-17T15:41:19.520694+0000","last_fullsized":"2024-04-17T15:41:19.520694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.520254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.520254+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.520254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:02.719737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.504326+0000","last_change":"2024-04-17T15:41:40.504380+0000","last_active":"2024-04-17T15:41:40.504326+0000","last_peered":"2024-04-17T15:41:40.504326+0000","last_clean":"2024-04-17T15:41:40.504326+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:41:40.504326+0000","last_undegraded":"2024-04-17T15:41:40.504326+0000","last_fullsized":"2024-04-17T15:41:40.504326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:40.504130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:40.504130+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.504130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:42.609581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.371151+0000","last_change":"2024-04-17T15:41:15.371151+0000","last_active":"2024-04-17T15:41:15.371151+0000","last_peered":"2024-04-17T15:41:15.371151+0000","last_clean":"2024-04-17T15:41:15.371151+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:41:15.371151+0000","last_undegraded":"2024-04-17T15:41:15.371151+0000","last_fullsized":"2024-04-17T15:41:15.371151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.371032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.371032+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.371032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:03.976479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.958911+0000","last_change":"2024-04-17T15:41:20.958967+0000","last_active":"2024-04-17T15:41:20.958911+0000","last_peered":"2024-04-17T15:41:20.958911+0000","last_clean":"2024-04-17T15:41:20.958911+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:41:20.958911+0000","last_undegraded":"2024-04-17T15:41:20.958911+0000","last_fullsized":"2024-04-17T15:41:20.958911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.958694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.958694+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.958694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:17:27.161135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"130'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.538296+0000","last_change":"2024-04-17T15:41:31.538435+0000","last_active":"2024-04-17T15:41:31.538296+0000","last_peered":"2024-04-17T15:41:31.538296+0000","last_clean":"2024-04-17T15:41:31.538296+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:41:31.538296+0000","last_undegraded":"2024-04-17T15:41:31.538296+0000","last_fullsized":"2024-04-17T15:41:31.538296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:31.537911+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:31.537911+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.537911+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:19.196623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"130'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.973550+0000","last_change":"2024-04-17T15:41:17.973550+0000","last_active":"2024-04-17T15:41:17.973550+0000","last_peered":"2024-04-17T15:41:17.973550+0000","last_clean":"2024-04-17T15:41:17.973550+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:41:17.973550+0000","last_undegraded":"2024-04-17T15:41:17.973550+0000","last_fullsized":"2024-04-17T15:41:17.973550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:17.973240+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:17.973240+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.973240+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:52:50.450436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'24","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.483241+0000","last_change":"2024-04-17T15:41:20.483333+0000","last_active":"2024-04-17T15:41:20.483241+0000","last_peered":"2024-04-17T15:41:20.483241+0000","last_clean":"2024-04-17T15:41:20.483241+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:41:20.483241+0000","last_undegraded":"2024-04-17T15:41:20.483241+0000","last_fullsized":"2024-04-17T15:41:20.483241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:20.483050+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:20.483050+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.483050+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:37:49.043173+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.593731+0000","last_change":"2024-04-17T15:41:16.593786+0000","last_active":"2024-04-17T15:41:16.593731+0000","last_peered":"2024-04-17T15:41:16.593731+0000","last_clean":"2024-04-17T15:41:16.593731+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:41:16.593731+0000","last_undegraded":"2024-04-17T15:41:16.593731+0000","last_fullsized":"2024-04-17T15:41:16.593731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.593549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.593549+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.593549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:32:36.369768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:53.750568+0000","last_change":"2024-04-17T15:41:53.750727+0000","last_active":"2024-04-17T15:41:53.750568+0000","last_peered":"2024-04-17T15:41:53.750568+0000","last_clean":"2024-04-17T15:41:53.750568+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:41:53.750568+0000","last_undegraded":"2024-04-17T15:41:53.750568+0000","last_fullsized":"2024-04-17T15:41:53.750568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:53.750333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:53.750333+0000","last_clean_scrub_stamp":"2024-04-17T15:41:53.750333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:57.968456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.474447+0000","last_change":"2024-04-17T15:41:23.474580+0000","last_active":"2024-04-17T15:41:23.474447+0000","last_peered":"2024-04-17T15:41:23.474447+0000","last_clean":"2024-04-17T15:41:23.474447+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:41:23.474447+0000","last_undegraded":"2024-04-17T15:41:23.474447+0000","last_fullsized":"2024-04-17T15:41:23.474447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-17T15:41:23.474143+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.474143+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.474143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:37:52.034266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.097439+0000","last_change":"2024-04-17T15:41:40.097493+0000","last_active":"2024-04-17T15:41:40.097439+0000","last_peered":"2024-04-17T15:41:40.097439+0000","last_clean":"2024-04-17T15:41:40.097439+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:41:40.097439+0000","last_undegraded":"2024-04-17T15:41:40.097439+0000","last_fullsized":"2024-04-17T15:41:40.097439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:40.097243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:40.097243+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.097243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:03.775101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"130'48","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.111520+0000","last_change":"2024-04-17T15:41:39.111584+0000","last_active":"2024-04-17T15:41:39.111520+0000","last_peered":"2024-04-17T15:41:39.111520+0000","last_clean":"2024-04-17T15:41:39.111520+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:41:39.111520+0000","last_undegraded":"2024-04-17T15:41:39.111520+0000","last_fullsized":"2024-04-17T15:41:39.111520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:39.111299+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:39.111299+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.111299+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:22:06.399573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.587358+0000","last_change":"2024-04-17T15:41:28.587481+0000","last_active":"2024-04-17T15:41:28.587358+0000","last_peered":"2024-04-17T15:41:28.587358+0000","last_clean":"2024-04-17T15:41:28.587358+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:41:28.587358+0000","last_undegraded":"2024-04-17T15:41:28.587358+0000","last_fullsized":"2024-04-17T15:41:28.587358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.587010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.587010+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.587010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:30.754705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"130'19","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.663734+0000","last_change":"2024-04-17T15:41:39.663907+0000","last_active":"2024-04-17T15:41:39.663734+0000","last_peered":"2024-04-17T15:41:39.663734+0000","last_clean":"2024-04-17T15:41:39.663734+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:41:39.663734+0000","last_undegraded":"2024-04-17T15:41:39.663734+0000","last_fullsized":"2024-04-17T15:41:39.663734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'19","last_scrub_stamp":"2024-04-17T15:41:39.663473+0000","last_deep_scrub":"130'19","last_deep_scrub_stamp":"2024-04-17T15:41:39.663473+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.663473+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:19.638455+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.417231+0000","last_change":"2024-04-17T15:41:37.417287+0000","last_active":"2024-04-17T15:41:37.417231+0000","last_peered":"2024-04-17T15:41:37.417231+0000","last_clean":"2024-04-17T15:41:37.417231+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:41:37.417231+0000","last_undegraded":"2024-04-17T15:41:37.417231+0000","last_fullsized":"2024-04-17T15:41:37.417231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.416998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.416998+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.416998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:38:57.992894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:53.161192+0000","last_change":"2024-04-17T15:41:53.161310+0000","last_active":"2024-04-17T15:41:53.161192+0000","last_peered":"2024-04-17T15:41:53.161192+0000","last_clean":"2024-04-17T15:41:53.161192+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:41:53.161192+0000","last_undegraded":"2024-04-17T15:41:53.161192+0000","last_fullsized":"2024-04-17T15:41:53.161192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:53.160953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:53.160953+0000","last_clean_scrub_stamp":"2024-04-17T15:41:53.160953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:44.445063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.435512+0000","last_change":"2024-04-17T15:41:19.435573+0000","last_active":"2024-04-17T15:41:19.435512+0000","last_peered":"2024-04-17T15:41:19.435512+0000","last_clean":"2024-04-17T15:41:19.435512+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:41:19.435512+0000","last_undegraded":"2024-04-17T15:41:19.435512+0000","last_fullsized":"2024-04-17T15:41:19.435512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-17T15:41:19.435287+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-17T15:41:19.435287+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.435287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:03.479658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.975846+0000","last_change":"2024-04-17T15:41:35.975908+0000","last_active":"2024-04-17T15:41:35.975846+0000","last_peered":"2024-04-17T15:41:35.975846+0000","last_clean":"2024-04-17T15:41:35.975846+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:41:35.975846+0000","last_undegraded":"2024-04-17T15:41:35.975846+0000","last_fullsized":"2024-04-17T15:41:35.975846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:35.975645+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:35.975645+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.975645+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:57:32.977017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.560233+0000","last_change":"2024-04-17T15:41:29.560287+0000","last_active":"2024-04-17T15:41:29.560233+0000","last_peered":"2024-04-17T15:41:29.560233+0000","last_clean":"2024-04-17T15:41:29.560233+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:41:29.560233+0000","last_undegraded":"2024-04-17T15:41:29.560233+0000","last_fullsized":"2024-04-17T15:41:29.560233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:29.560033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:29.560033+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.560033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:32.526290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.651601+0000","last_change":"2024-04-17T15:41:30.651711+0000","last_active":"2024-04-17T15:41:30.651601+0000","last_peered":"2024-04-17T15:41:30.651601+0000","last_clean":"2024-04-17T15:41:30.651601+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:41:30.651601+0000","last_undegraded":"2024-04-17T15:41:30.651601+0000","last_fullsized":"2024-04-17T15:41:30.651601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:30.651296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:30.651296+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.651296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:57:27.652669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'46","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.613727+0000","last_change":"2024-04-17T15:41:21.613816+0000","last_active":"2024-04-17T15:41:21.613727+0000","last_peered":"2024-04-17T15:41:21.613727+0000","last_clean":"2024-04-17T15:41:21.613727+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:41:21.613727+0000","last_undegraded":"2024-04-17T15:41:21.613727+0000","last_fullsized":"2024-04-17T15:41:21.613727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:21.613527+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:21.613527+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.613527+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:53.316589+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.235919+0000","last_change":"2024-04-17T15:41:49.235973+0000","last_active":"2024-04-17T15:41:49.235919+0000","last_peered":"2024-04-17T15:41:49.235919+0000","last_clean":"2024-04-17T15:41:49.235919+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:41:49.235919+0000","last_undegraded":"2024-04-17T15:41:49.235919+0000","last_fullsized":"2024-04-17T15:41:49.235919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:49.235725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:49.235725+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.235725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:35.351354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.672141+0000","last_change":"2024-04-17T15:41:50.672194+0000","last_active":"2024-04-17T15:41:50.672141+0000","last_peered":"2024-04-17T15:41:50.672141+0000","last_clean":"2024-04-17T15:41:50.672141+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:41:50.672141+0000","last_undegraded":"2024-04-17T15:41:50.672141+0000","last_fullsized":"2024-04-17T15:41:50.672141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:50.671939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:50.671939+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.671939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:10:51.459569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.565847+0000","last_change":"2024-04-17T15:41:24.565913+0000","last_active":"2024-04-17T15:41:24.565847+0000","last_peered":"2024-04-17T15:41:24.565847+0000","last_clean":"2024-04-17T15:41:24.565847+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:41:24.565847+0000","last_undegraded":"2024-04-17T15:41:24.565847+0000","last_fullsized":"2024-04-17T15:41:24.565847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:24.565634+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:24.565634+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.565634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:37.328106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"130'42","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.476800+0000","last_change":"2024-04-17T15:41:33.476859+0000","last_active":"2024-04-17T15:41:33.476800+0000","last_peered":"2024-04-17T15:41:33.476800+0000","last_clean":"2024-04-17T15:41:33.476800+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:41:33.476800+0000","last_undegraded":"2024-04-17T15:41:33.476800+0000","last_fullsized":"2024-04-17T15:41:33.476800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:33.476604+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:33.476604+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.476604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:10.889055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.623136+0000","last_change":"2024-04-17T15:41:38.623190+0000","last_active":"2024-04-17T15:41:38.623136+0000","last_peered":"2024-04-17T15:41:38.623136+0000","last_clean":"2024-04-17T15:41:38.623136+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:41:38.623136+0000","last_undegraded":"2024-04-17T15:41:38.623136+0000","last_fullsized":"2024-04-17T15:41:38.623136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:38.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:38.622912+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:57:35.624284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.354296+0000","last_change":"2024-04-17T15:41:22.354371+0000","last_active":"2024-04-17T15:41:22.354296+0000","last_peered":"2024-04-17T15:41:22.354296+0000","last_clean":"2024-04-17T15:41:22.354296+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:41:22.354296+0000","last_undegraded":"2024-04-17T15:41:22.354296+0000","last_fullsized":"2024-04-17T15:41:22.354296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:22.354099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:22.354099+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.354099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:10:05.544157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"130'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.524562+0000","last_change":"2024-04-17T15:41:36.524643+0000","last_active":"2024-04-17T15:41:36.524562+0000","last_peered":"2024-04-17T15:41:36.524562+0000","last_clean":"2024-04-17T15:41:36.524562+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:41:36.524562+0000","last_undegraded":"2024-04-17T15:41:36.524562+0000","last_fullsized":"2024-04-17T15:41:36.524562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'22","last_scrub_stamp":"2024-04-17T15:41:36.524367+0000","last_deep_scrub":"130'22","last_deep_scrub_stamp":"2024-04-17T15:41:36.524367+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.524367+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:21.717200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"130'138","reported_seq":413,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.654818+0000","last_change":"2024-04-17T15:41:17.654886+0000","last_active":"2024-04-17T15:41:17.654818+0000","last_peered":"2024-04-17T15:41:17.654818+0000","last_clean":"2024-04-17T15:41:17.654818+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:41:17.654818+0000","last_undegraded":"2024-04-17T15:41:17.654818+0000","last_fullsized":"2024-04-17T15:41:17.654818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:17.654603+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:17.654603+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.654603+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:49.183549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.727265+0000","last_change":"2024-04-17T15:37:04.302652+0000","last_active":"2024-04-17T15:41:15.727265+0000","last_peered":"2024-04-17T15:41:15.727265+0000","last_clean":"2024-04-17T15:41:15.727265+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:41:15.727265+0000","last_undegraded":"2024-04-17T15:41:15.727265+0000","last_fullsized":"2024-04-17T15:41:15.727265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:37:03.239017+0000","last_clean_scrub_stamp":"2024-04-17T15:37:03.239017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.657495+0000","last_change":"2024-04-17T15:41:30.657565+0000","last_active":"2024-04-17T15:41:30.657495+0000","last_peered":"2024-04-17T15:41:30.657495+0000","last_clean":"2024-04-17T15:41:30.657495+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:41:30.657495+0000","last_undegraded":"2024-04-17T15:41:30.657495+0000","last_fullsized":"2024-04-17T15:41:30.657495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-17T15:41:30.656952+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-17T15:41:30.656952+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.656952+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:13:38.069792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"130'38","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.605523+0000","last_change":"2024-04-17T15:41:38.605586+0000","last_active":"2024-04-17T15:41:38.605523+0000","last_peered":"2024-04-17T15:41:38.605523+0000","last_clean":"2024-04-17T15:41:38.605523+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:41:38.605523+0000","last_undegraded":"2024-04-17T15:41:38.605523+0000","last_fullsized":"2024-04-17T15:41:38.605523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:38.605318+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:38.605318+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.605318+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:02:30.984640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.552965+0000","last_change":"2024-04-17T15:41:28.553023+0000","last_active":"2024-04-17T15:41:28.552965+0000","last_peered":"2024-04-17T15:41:28.552965+0000","last_clean":"2024-04-17T15:41:28.552965+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:41:28.552965+0000","last_undegraded":"2024-04-17T15:41:28.552965+0000","last_fullsized":"2024-04-17T15:41:28.552965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.552768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.552768+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.552768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:29.113561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.011972+0000","last_change":"2024-04-17T15:41:34.012036+0000","last_active":"2024-04-17T15:41:34.011972+0000","last_peered":"2024-04-17T15:41:34.011972+0000","last_clean":"2024-04-17T15:41:34.011972+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:41:34.011972+0000","last_undegraded":"2024-04-17T15:41:34.011972+0000","last_fullsized":"2024-04-17T15:41:34.011972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:34.011770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:34.011770+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.011770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:09.076736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'15","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.898748+0000","last_change":"2024-04-17T15:41:18.898829+0000","last_active":"2024-04-17T15:41:18.898748+0000","last_peered":"2024-04-17T15:41:18.898748+0000","last_clean":"2024-04-17T15:41:18.898748+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:41:18.898748+0000","last_undegraded":"2024-04-17T15:41:18.898748+0000","last_fullsized":"2024-04-17T15:41:18.898748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'15","last_scrub_stamp":"2024-04-17T15:41:18.898561+0000","last_deep_scrub":"130'15","last_deep_scrub_stamp":"2024-04-17T15:41:18.898561+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.898561+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:40:59.083402+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'139","reported_seq":414,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.705530+0000","last_change":"2024-04-17T15:41:50.705597+0000","last_active":"2024-04-17T15:41:50.705530+0000","last_peered":"2024-04-17T15:41:50.705530+0000","last_clean":"2024-04-17T15:41:50.705530+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:41:50.705530+0000","last_undegraded":"2024-04-17T15:41:50.705530+0000","last_fullsized":"2024-04-17T15:41:50.705530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'139","last_scrub_stamp":"2024-04-17T15:41:50.705336+0000","last_deep_scrub":"130'139","last_deep_scrub_stamp":"2024-04-17T15:41:50.705336+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.705336+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:00:23.614143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:53.582897+0000","last_change":"2024-04-17T15:41:53.583000+0000","last_active":"2024-04-17T15:41:53.582897+0000","last_peered":"2024-04-17T15:41:53.582897+0000","last_clean":"2024-04-17T15:41:53.582897+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:41:53.582897+0000","last_undegraded":"2024-04-17T15:41:53.582897+0000","last_fullsized":"2024-04-17T15:41:53.582897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'7","last_scrub_stamp":"2024-04-17T15:41:53.582657+0000","last_deep_scrub":"73'7","last_deep_scrub_stamp":"2024-04-17T15:41:53.582657+0000","last_clean_scrub_stamp":"2024-04-17T15:41:53.582657+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:12:40.918106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.986901+0000","last_change":"2024-04-17T15:41:27.986964+0000","last_active":"2024-04-17T15:41:27.986901+0000","last_peered":"2024-04-17T15:41:27.986901+0000","last_clean":"2024-04-17T15:41:27.986901+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:41:27.986901+0000","last_undegraded":"2024-04-17T15:41:27.986901+0000","last_fullsized":"2024-04-17T15:41:27.986901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:27.986679+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:27.986679+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.986679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:59.689742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"130'56","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.615229+0000","last_change":"2024-04-17T15:41:40.615320+0000","last_active":"2024-04-17T15:41:40.615229+0000","last_peered":"2024-04-17T15:41:40.615229+0000","last_clean":"2024-04-17T15:41:40.615229+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:41:40.615229+0000","last_undegraded":"2024-04-17T15:41:40.615229+0000","last_fullsized":"2024-04-17T15:41:40.615229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:40.614968+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:40.614968+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.614968+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:06.116049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.373410+0000","last_change":"2024-04-17T15:41:26.373472+0000","last_active":"2024-04-17T15:41:26.373410+0000","last_peered":"2024-04-17T15:41:26.373410+0000","last_clean":"2024-04-17T15:41:26.373410+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:41:26.373410+0000","last_undegraded":"2024-04-17T15:41:26.373410+0000","last_fullsized":"2024-04-17T15:41:26.373410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:26.373211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:26.373211+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.373211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:50:56.566202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.575551+0000","last_change":"2024-04-17T15:41:33.575608+0000","last_active":"2024-04-17T15:41:33.575551+0000","last_peered":"2024-04-17T15:41:33.575551+0000","last_clean":"2024-04-17T15:41:33.575551+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:41:33.575551+0000","last_undegraded":"2024-04-17T15:41:33.575551+0000","last_fullsized":"2024-04-17T15:41:33.575551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:33.575347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:33.575347+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.575347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:54.599783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"130'65","reported_seq":322,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.606453+0000","last_change":"2024-04-17T15:41:45.606676+0000","last_active":"2024-04-17T15:41:45.606453+0000","last_peered":"2024-04-17T15:41:45.606453+0000","last_clean":"2024-04-17T15:41:45.606453+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:41:45.606453+0000","last_undegraded":"2024-04-17T15:41:45.606453+0000","last_fullsized":"2024-04-17T15:41:45.606453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'65","last_scrub_stamp":"2024-04-17T15:41:45.606155+0000","last_deep_scrub":"130'65","last_deep_scrub_stamp":"2024-04-17T15:41:45.606155+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.606155+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:44:36.685095+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":410,"num_write":38,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.616056+0000","last_change":"2024-04-17T15:41:17.616109+0000","last_active":"2024-04-17T15:41:17.616056+0000","last_peered":"2024-04-17T15:41:17.616056+0000","last_clean":"2024-04-17T15:41:17.616056+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:41:17.616056+0000","last_undegraded":"2024-04-17T15:41:17.616056+0000","last_fullsized":"2024-04-17T15:41:17.616056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.615825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.615825+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.615825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:40.729641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.169787+0000","last_change":"2024-04-17T15:41:48.169850+0000","last_active":"2024-04-17T15:41:48.169787+0000","last_peered":"2024-04-17T15:41:48.169787+0000","last_clean":"2024-04-17T15:41:48.169787+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:41:48.169787+0000","last_undegraded":"2024-04-17T15:41:48.169787+0000","last_fullsized":"2024-04-17T15:41:48.169787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-17T15:41:48.169585+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-17T15:41:48.169585+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.169585+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:47:43.416986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.670189+0000","last_change":"2024-04-17T15:41:49.670249+0000","last_active":"2024-04-17T15:41:49.670189+0000","last_peered":"2024-04-17T15:41:49.670189+0000","last_clean":"2024-04-17T15:41:49.670189+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:41:49.670189+0000","last_undegraded":"2024-04-17T15:41:49.670189+0000","last_fullsized":"2024-04-17T15:41:49.670189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'8","last_scrub_stamp":"2024-04-17T15:41:49.669975+0000","last_deep_scrub":"112'8","last_deep_scrub_stamp":"2024-04-17T15:41:49.669975+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.669975+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:51:14.590761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.956906+0000","last_change":"2024-04-17T15:41:24.956906+0000","last_active":"2024-04-17T15:41:24.956906+0000","last_peered":"2024-04-17T15:41:24.956906+0000","last_clean":"2024-04-17T15:41:24.956906+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:41:24.956906+0000","last_undegraded":"2024-04-17T15:41:24.956906+0000","last_fullsized":"2024-04-17T15:41:24.956906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:24.956622+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:24.956622+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.956622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:12.092172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"130'54","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.223833+0000","last_change":"2024-04-17T15:41:42.223894+0000","last_active":"2024-04-17T15:41:42.223833+0000","last_peered":"2024-04-17T15:41:42.223833+0000","last_clean":"2024-04-17T15:41:42.223833+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:41:42.223833+0000","last_undegraded":"2024-04-17T15:41:42.223833+0000","last_fullsized":"2024-04-17T15:41:42.223833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'54","last_scrub_stamp":"2024-04-17T15:41:42.223645+0000","last_deep_scrub":"130'54","last_deep_scrub_stamp":"2024-04-17T15:41:42.223645+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.223645+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:37.233245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.413463+0000","last_change":"2024-04-17T15:41:18.413463+0000","last_active":"2024-04-17T15:41:18.413463+0000","last_peered":"2024-04-17T15:41:18.413463+0000","last_clean":"2024-04-17T15:41:18.413463+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:41:18.413463+0000","last_undegraded":"2024-04-17T15:41:18.413463+0000","last_fullsized":"2024-04-17T15:41:18.413463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.413210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.413210+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.413210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:44:25.659696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"130'26","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.692690+0000","last_change":"2024-04-17T15:41:22.692690+0000","last_active":"2024-04-17T15:41:22.692690+0000","last_peered":"2024-04-17T15:41:22.692690+0000","last_clean":"2024-04-17T15:41:22.692690+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:41:22.692690+0000","last_undegraded":"2024-04-17T15:41:22.692690+0000","last_fullsized":"2024-04-17T15:41:22.692690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:22.692221+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:22.692221+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.692221+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:31:39.418145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.588234+0000","last_change":"2024-04-17T15:41:16.588234+0000","last_active":"2024-04-17T15:41:16.588234+0000","last_peered":"2024-04-17T15:41:16.588234+0000","last_clean":"2024-04-17T15:41:16.588234+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:41:16.588234+0000","last_undegraded":"2024-04-17T15:41:16.588234+0000","last_fullsized":"2024-04-17T15:41:16.588234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.587982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.587982+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.587982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:58.647298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:55.733957+0000","last_change":"2024-04-17T15:41:55.734018+0000","last_active":"2024-04-17T15:41:55.733957+0000","last_peered":"2024-04-17T15:41:55.733957+0000","last_clean":"2024-04-17T15:41:55.733957+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:41:55.733957+0000","last_undegraded":"2024-04-17T15:41:55.733957+0000","last_fullsized":"2024-04-17T15:41:55.733957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:55.733757+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:55.733757+0000","last_clean_scrub_stamp":"2024-04-17T15:41:55.733757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:52:27.045959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":204,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:54.162127+0000","last_change":"2024-04-17T15:41:54.162186+0000","last_active":"2024-04-17T15:41:54.162127+0000","last_peered":"2024-04-17T15:41:54.162127+0000","last_clean":"2024-04-17T15:41:54.162127+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:41:54.162127+0000","last_undegraded":"2024-04-17T15:41:54.162127+0000","last_fullsized":"2024-04-17T15:41:54.162127+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-17T15:41:54.161926+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-17T15:41:54.161926+0000","last_clean_scrub_stamp":"2024-04-17T15:41:54.161926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:54:09.123894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"130'48","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.583034+0000","last_change":"2024-04-17T15:41:43.583034+0000","last_active":"2024-04-17T15:41:43.583034+0000","last_peered":"2024-04-17T15:41:43.583034+0000","last_clean":"2024-04-17T15:41:43.583034+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:41:43.583034+0000","last_undegraded":"2024-04-17T15:41:43.583034+0000","last_fullsized":"2024-04-17T15:41:43.583034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:43.582628+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:43.582628+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.582628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:22:30.232655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"130'2","reported_seq":327,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.594234+0000","last_change":"2024-04-17T15:41:35.594234+0000","last_active":"2024-04-17T15:41:35.594234+0000","last_peered":"2024-04-17T15:41:35.594234+0000","last_clean":"2024-04-17T15:41:35.594234+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:41:35.594234+0000","last_undegraded":"2024-04-17T15:41:35.594234+0000","last_fullsized":"2024-04-17T15:41:35.594234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:35.593954+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:35.593954+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.593954+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:24.960351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"130'12","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.651793+0000","last_change":"2024-04-17T15:41:36.651793+0000","last_active":"2024-04-17T15:41:36.651793+0000","last_peered":"2024-04-17T15:41:36.651793+0000","last_clean":"2024-04-17T15:41:36.651793+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:41:36.651793+0000","last_undegraded":"2024-04-17T15:41:36.651793+0000","last_fullsized":"2024-04-17T15:41:36.651793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'12","last_scrub_stamp":"2024-04-17T15:41:36.651500+0000","last_deep_scrub":"130'12","last_deep_scrub_stamp":"2024-04-17T15:41:36.651500+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.651500+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:44:27.730441+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.636329+0000","last_change":"2024-04-17T15:41:47.636384+0000","last_active":"2024-04-17T15:41:47.636329+0000","last_peered":"2024-04-17T15:41:47.636329+0000","last_clean":"2024-04-17T15:41:47.636329+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:41:47.636329+0000","last_undegraded":"2024-04-17T15:41:47.636329+0000","last_fullsized":"2024-04-17T15:41:47.636329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:47.636128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:47.636128+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.636128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:10:58.188394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.640005+0000","last_change":"2024-04-17T15:41:48.640076+0000","last_active":"2024-04-17T15:41:48.640005+0000","last_peered":"2024-04-17T15:41:48.640005+0000","last_clean":"2024-04-17T15:41:48.640005+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:41:48.640005+0000","last_undegraded":"2024-04-17T15:41:48.640005+0000","last_fullsized":"2024-04-17T15:41:48.640005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:48.639752+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:48.639752+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.639752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:22.481597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.612791+0000","last_change":"2024-04-17T15:41:29.612791+0000","last_active":"2024-04-17T15:41:29.612791+0000","last_peered":"2024-04-17T15:41:29.612791+0000","last_clean":"2024-04-17T15:41:29.612791+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:41:29.612791+0000","last_undegraded":"2024-04-17T15:41:29.612791+0000","last_fullsized":"2024-04-17T15:41:29.612791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:29.612509+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:29.612509+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.612509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:48:26.850872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"130'62","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.838432+0000","last_change":"2024-04-17T15:41:34.838496+0000","last_active":"2024-04-17T15:41:34.838432+0000","last_peered":"2024-04-17T15:41:34.838432+0000","last_clean":"2024-04-17T15:41:34.838432+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:41:34.838432+0000","last_undegraded":"2024-04-17T15:41:34.838432+0000","last_fullsized":"2024-04-17T15:41:34.838432+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'62","last_scrub_stamp":"2024-04-17T15:41:34.838245+0000","last_deep_scrub":"130'62","last_deep_scrub_stamp":"2024-04-17T15:41:34.838245+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.838245+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:46.266575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.493472+0000","last_change":"2024-04-17T15:41:23.493472+0000","last_active":"2024-04-17T15:41:23.493472+0000","last_peered":"2024-04-17T15:41:23.493472+0000","last_clean":"2024-04-17T15:41:23.493472+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:41:23.493472+0000","last_undegraded":"2024-04-17T15:41:23.493472+0000","last_fullsized":"2024-04-17T15:41:23.493472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.493211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.493211+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.493211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:31.172500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"130'26","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.718224+0000","last_change":"2024-04-17T15:41:21.718224+0000","last_active":"2024-04-17T15:41:21.718224+0000","last_peered":"2024-04-17T15:41:21.718224+0000","last_clean":"2024-04-17T15:41:21.718224+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:41:21.718224+0000","last_undegraded":"2024-04-17T15:41:21.718224+0000","last_fullsized":"2024-04-17T15:41:21.718224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:21.717955+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:21.717955+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.717955+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:52.277915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.418466+0000","last_change":"2024-04-17T15:41:35.418466+0000","last_active":"2024-04-17T15:41:35.418466+0000","last_peered":"2024-04-17T15:41:35.418466+0000","last_clean":"2024-04-17T15:41:35.418466+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:41:35.418466+0000","last_undegraded":"2024-04-17T15:41:35.418466+0000","last_fullsized":"2024-04-17T15:41:35.418466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:35.418155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:35.418155+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.418155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:38.384411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.126107+0000","last_change":"2024-04-17T15:41:49.126192+0000","last_active":"2024-04-17T15:41:49.126107+0000","last_peered":"2024-04-17T15:41:49.126107+0000","last_clean":"2024-04-17T15:41:49.126107+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:41:49.126107+0000","last_undegraded":"2024-04-17T15:41:49.126107+0000","last_fullsized":"2024-04-17T15:41:49.126107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-17T15:41:49.125902+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-17T15:41:49.125902+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.125902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:35.241531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.622129+0000","last_change":"2024-04-17T15:41:34.622129+0000","last_active":"2024-04-17T15:41:34.622129+0000","last_peered":"2024-04-17T15:41:34.622129+0000","last_clean":"2024-04-17T15:41:34.622129+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:41:34.622129+0000","last_undegraded":"2024-04-17T15:41:34.622129+0000","last_fullsized":"2024-04-17T15:41:34.622129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-17T15:41:34.621741+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-17T15:41:34.621741+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.621741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:49.137359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"130'56","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.604147+0000","last_change":"2024-04-17T15:41:43.604147+0000","last_active":"2024-04-17T15:41:43.604147+0000","last_peered":"2024-04-17T15:41:43.604147+0000","last_clean":"2024-04-17T15:41:43.604147+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:41:43.604147+0000","last_undegraded":"2024-04-17T15:41:43.604147+0000","last_fullsized":"2024-04-17T15:41:43.604147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:43.603751+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:43.603751+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.603751+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:19:38.454042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.369623+0000","last_change":"2024-04-17T15:41:20.369623+0000","last_active":"2024-04-17T15:41:20.369623+0000","last_peered":"2024-04-17T15:41:20.369623+0000","last_clean":"2024-04-17T15:41:20.369623+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:41:20.369623+0000","last_undegraded":"2024-04-17T15:41:20.369623+0000","last_fullsized":"2024-04-17T15:41:20.369623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.369359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.369359+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.369359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:36:34.772497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"130'24","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.583225+0000","last_change":"2024-04-17T15:41:33.583225+0000","last_active":"2024-04-17T15:41:33.583225+0000","last_peered":"2024-04-17T15:41:33.583225+0000","last_clean":"2024-04-17T15:41:33.583225+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:41:33.583225+0000","last_undegraded":"2024-04-17T15:41:33.583225+0000","last_fullsized":"2024-04-17T15:41:33.583225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:33.582912+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:33.582912+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.582912+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:18.775745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.642389+0000","last_change":"2024-04-17T15:41:15.642389+0000","last_active":"2024-04-17T15:41:15.642389+0000","last_peered":"2024-04-17T15:41:15.642389+0000","last_clean":"2024-04-17T15:41:15.642389+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:41:15.642389+0000","last_undegraded":"2024-04-17T15:41:15.642389+0000","last_fullsized":"2024-04-17T15:41:15.642389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.642137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.642137+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.642137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:23.321426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.357866+0000","last_change":"2024-04-17T15:41:17.357933+0000","last_active":"2024-04-17T15:41:17.357866+0000","last_peered":"2024-04-17T15:41:17.357866+0000","last_clean":"2024-04-17T15:41:17.357866+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:41:17.357866+0000","last_undegraded":"2024-04-17T15:41:17.357866+0000","last_fullsized":"2024-04-17T15:41:17.357866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'10","last_scrub_stamp":"2024-04-17T15:41:17.357662+0000","last_deep_scrub":"112'10","last_deep_scrub_stamp":"2024-04-17T15:41:17.357662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.357662+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:00:44.064799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"130'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.722689+0000","last_change":"2024-04-17T15:41:42.722689+0000","last_active":"2024-04-17T15:41:42.722689+0000","last_peered":"2024-04-17T15:41:42.722689+0000","last_clean":"2024-04-17T15:41:42.722689+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:41:42.722689+0000","last_undegraded":"2024-04-17T15:41:42.722689+0000","last_fullsized":"2024-04-17T15:41:42.722689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:42.722423+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:42.722423+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.722423+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:48.377709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.698570+0000","last_change":"2024-04-17T15:41:32.698625+0000","last_active":"2024-04-17T15:41:32.698570+0000","last_peered":"2024-04-17T15:41:32.698570+0000","last_clean":"2024-04-17T15:41:32.698570+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:41:32.698570+0000","last_undegraded":"2024-04-17T15:41:32.698570+0000","last_fullsized":"2024-04-17T15:41:32.698570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:32.698372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:32.698372+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.698372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:59.986646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"130'37","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.536385+0000","last_change":"2024-04-17T15:41:26.536460+0000","last_active":"2024-04-17T15:41:26.536385+0000","last_peered":"2024-04-17T15:41:26.536385+0000","last_clean":"2024-04-17T15:41:26.536385+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:41:26.536385+0000","last_undegraded":"2024-04-17T15:41:26.536385+0000","last_fullsized":"2024-04-17T15:41:26.536385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'37","last_scrub_stamp":"2024-04-17T15:41:26.536186+0000","last_deep_scrub":"130'37","last_deep_scrub_stamp":"2024-04-17T15:41:26.536186+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.536186+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:34.215475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.737865+0000","last_change":"2024-04-17T15:41:20.737920+0000","last_active":"2024-04-17T15:41:20.737865+0000","last_peered":"2024-04-17T15:41:20.737865+0000","last_clean":"2024-04-17T15:41:20.737865+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:41:20.737865+0000","last_undegraded":"2024-04-17T15:41:20.737865+0000","last_fullsized":"2024-04-17T15:41:20.737865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.737664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.737664+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.737664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:28.416953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:54.729654+0000","last_change":"2024-04-17T15:41:54.729716+0000","last_active":"2024-04-17T15:41:54.729654+0000","last_peered":"2024-04-17T15:41:54.729654+0000","last_clean":"2024-04-17T15:41:54.729654+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:41:54.729654+0000","last_undegraded":"2024-04-17T15:41:54.729654+0000","last_fullsized":"2024-04-17T15:41:54.729654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'8","last_scrub_stamp":"2024-04-17T15:41:54.729407+0000","last_deep_scrub":"112'8","last_deep_scrub_stamp":"2024-04-17T15:41:54.729407+0000","last_clean_scrub_stamp":"2024-04-17T15:41:54.729407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:31:58.510809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.565309+0000","last_change":"2024-04-17T15:41:26.565461+0000","last_active":"2024-04-17T15:41:26.565309+0000","last_peered":"2024-04-17T15:41:26.565309+0000","last_clean":"2024-04-17T15:41:26.565309+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:41:26.565309+0000","last_undegraded":"2024-04-17T15:41:26.565309+0000","last_fullsized":"2024-04-17T15:41:26.565309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:26.565064+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.565064+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.565064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:34:10.523713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"130'48","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.517842+0000","last_change":"2024-04-17T15:41:32.517842+0000","last_active":"2024-04-17T15:41:32.517842+0000","last_peered":"2024-04-17T15:41:32.517842+0000","last_clean":"2024-04-17T15:41:32.517842+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:41:32.517842+0000","last_undegraded":"2024-04-17T15:41:32.517842+0000","last_fullsized":"2024-04-17T15:41:32.517842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:32.517588+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:32.517588+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.517588+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:04.220651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.364512+0000","last_change":"2024-04-17T15:41:18.364569+0000","last_active":"2024-04-17T15:41:18.364512+0000","last_peered":"2024-04-17T15:41:18.364512+0000","last_clean":"2024-04-17T15:41:18.364512+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:41:18.364512+0000","last_undegraded":"2024-04-17T15:41:18.364512+0000","last_fullsized":"2024-04-17T15:41:18.364512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.364298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.364298+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.364298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:57:42.347669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"130'32","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.655785+0000","last_change":"2024-04-17T15:41:35.655882+0000","last_active":"2024-04-17T15:41:35.655785+0000","last_peered":"2024-04-17T15:41:35.655785+0000","last_clean":"2024-04-17T15:41:35.655785+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:41:35.655785+0000","last_undegraded":"2024-04-17T15:41:35.655785+0000","last_fullsized":"2024-04-17T15:41:35.655785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:35.655589+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:35.655589+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.655589+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:05.201474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.533348+0000","last_change":"2024-04-17T15:41:37.533402+0000","last_active":"2024-04-17T15:41:37.533348+0000","last_peered":"2024-04-17T15:41:37.533348+0000","last_clean":"2024-04-17T15:41:37.533348+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:41:37.533348+0000","last_undegraded":"2024-04-17T15:41:37.533348+0000","last_fullsized":"2024-04-17T15:41:37.533348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.533123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.533123+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.533123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:51:02.910797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.456410+0000","last_change":"2024-04-17T15:41:41.456410+0000","last_active":"2024-04-17T15:41:41.456410+0000","last_peered":"2024-04-17T15:41:41.456410+0000","last_clean":"2024-04-17T15:41:41.456410+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:41:41.456410+0000","last_undegraded":"2024-04-17T15:41:41.456410+0000","last_fullsized":"2024-04-17T15:41:41.456410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-17T15:41:41.456110+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-17T15:41:41.456110+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.456110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:11:15.220613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.623363+0000","last_change":"2024-04-17T15:41:32.623363+0000","last_active":"2024-04-17T15:41:32.623363+0000","last_peered":"2024-04-17T15:41:32.623363+0000","last_clean":"2024-04-17T15:41:32.623363+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:41:32.623363+0000","last_undegraded":"2024-04-17T15:41:32.623363+0000","last_fullsized":"2024-04-17T15:41:32.623363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'2","last_scrub_stamp":"2024-04-17T15:41:32.622791+0000","last_deep_scrub":"73'2","last_deep_scrub_stamp":"2024-04-17T15:41:32.622791+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.622791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:08:11.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"130'56","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.118550+0000","last_change":"2024-04-17T15:41:38.118550+0000","last_active":"2024-04-17T15:41:38.118550+0000","last_peered":"2024-04-17T15:41:38.118550+0000","last_clean":"2024-04-17T15:41:38.118550+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:41:38.118550+0000","last_undegraded":"2024-04-17T15:41:38.118550+0000","last_fullsized":"2024-04-17T15:41:38.118550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:38.118255+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:38.118255+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.118255+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:38.085884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.259924+0000","last_change":"2024-04-17T15:41:46.260046+0000","last_active":"2024-04-17T15:41:46.259924+0000","last_peered":"2024-04-17T15:41:46.259924+0000","last_clean":"2024-04-17T15:41:46.259924+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:41:46.259924+0000","last_undegraded":"2024-04-17T15:41:46.259924+0000","last_fullsized":"2024-04-17T15:41:46.259924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:46.259693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:46.259693+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.259693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:25.604303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.654691+0000","last_change":"2024-04-17T15:41:18.654793+0000","last_active":"2024-04-17T15:41:18.654691+0000","last_peered":"2024-04-17T15:41:18.654691+0000","last_clean":"2024-04-17T15:41:18.654691+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:41:18.654691+0000","last_undegraded":"2024-04-17T15:41:18.654691+0000","last_fullsized":"2024-04-17T15:41:18.654691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-17T15:41:18.654502+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-17T15:41:18.654502+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.654502+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:42:37.262801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.542483+0000","last_change":"2024-04-17T15:41:39.542546+0000","last_active":"2024-04-17T15:41:39.542483+0000","last_peered":"2024-04-17T15:41:39.542483+0000","last_clean":"2024-04-17T15:41:39.542483+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:41:39.542483+0000","last_undegraded":"2024-04-17T15:41:39.542483+0000","last_fullsized":"2024-04-17T15:41:39.542483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:39.542288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:39.542288+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.542288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:18:36.212641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.133932+0000","last_change":"2024-04-17T15:41:50.134056+0000","last_active":"2024-04-17T15:41:50.133932+0000","last_peered":"2024-04-17T15:41:50.133932+0000","last_clean":"2024-04-17T15:41:50.133932+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:41:50.133932+0000","last_undegraded":"2024-04-17T15:41:50.133932+0000","last_fullsized":"2024-04-17T15:41:50.133932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:50.133680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:50.133680+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.133680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:33.250661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.873386+0000","last_change":"2024-04-17T15:41:23.873386+0000","last_active":"2024-04-17T15:41:23.873386+0000","last_peered":"2024-04-17T15:41:23.873386+0000","last_clean":"2024-04-17T15:41:23.873386+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:41:23.873386+0000","last_undegraded":"2024-04-17T15:41:23.873386+0000","last_fullsized":"2024-04-17T15:41:23.873386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:23.873020+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.873020+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.873020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:45.277191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"130'54","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.633370+0000","last_change":"2024-04-17T15:41:45.633370+0000","last_active":"2024-04-17T15:41:45.633370+0000","last_peered":"2024-04-17T15:41:45.633370+0000","last_clean":"2024-04-17T15:41:45.633370+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:41:45.633370+0000","last_undegraded":"2024-04-17T15:41:45.633370+0000","last_fullsized":"2024-04-17T15:41:45.633370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'54","last_scrub_stamp":"2024-04-17T15:41:45.633107+0000","last_deep_scrub":"130'54","last_deep_scrub_stamp":"2024-04-17T15:41:45.633107+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.633107+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:05.064501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.443969+0000","last_change":"2024-04-17T15:41:22.444024+0000","last_active":"2024-04-17T15:41:22.443969+0000","last_peered":"2024-04-17T15:41:22.443969+0000","last_clean":"2024-04-17T15:41:22.443969+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:41:22.443969+0000","last_undegraded":"2024-04-17T15:41:22.443969+0000","last_fullsized":"2024-04-17T15:41:22.443969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:22.443742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:22.443742+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.443742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:05.643225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"130'17","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.942474+0000","last_change":"2024-04-17T15:41:19.942554+0000","last_active":"2024-04-17T15:41:19.942474+0000","last_peered":"2024-04-17T15:41:19.942474+0000","last_clean":"2024-04-17T15:41:19.942474+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:41:19.942474+0000","last_undegraded":"2024-04-17T15:41:19.942474+0000","last_fullsized":"2024-04-17T15:41:19.942474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'17","last_scrub_stamp":"2024-04-17T15:41:19.942239+0000","last_deep_scrub":"130'17","last_deep_scrub_stamp":"2024-04-17T15:41:19.942239+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.942239+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:27:11.048555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"130'138","reported_seq":413,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.426953+0000","last_change":"2024-04-17T15:41:36.427021+0000","last_active":"2024-04-17T15:41:36.426953+0000","last_peered":"2024-04-17T15:41:36.426953+0000","last_clean":"2024-04-17T15:41:36.426953+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:41:36.426953+0000","last_undegraded":"2024-04-17T15:41:36.426953+0000","last_fullsized":"2024-04-17T15:41:36.426953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:36.426750+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:36.426750+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.426750+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:06:06.422194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.614129+0000","last_change":"2024-04-17T15:41:49.614186+0000","last_active":"2024-04-17T15:41:49.614129+0000","last_peered":"2024-04-17T15:41:49.614129+0000","last_clean":"2024-04-17T15:41:49.614129+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:41:49.614129+0000","last_undegraded":"2024-04-17T15:41:49.614129+0000","last_fullsized":"2024-04-17T15:41:49.614129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:49.613923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:49.613923+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.613923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.115004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.219567+0000","last_change":"2024-04-17T15:41:45.219567+0000","last_active":"2024-04-17T15:41:45.219567+0000","last_peered":"2024-04-17T15:41:45.219567+0000","last_clean":"2024-04-17T15:41:45.219567+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:41:45.219567+0000","last_undegraded":"2024-04-17T15:41:45.219567+0000","last_fullsized":"2024-04-17T15:41:45.219567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'2","last_scrub_stamp":"2024-04-17T15:41:45.219183+0000","last_deep_scrub":"112'2","last_deep_scrub_stamp":"2024-04-17T15:41:45.219183+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.219183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:59.186120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"130'42","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.172583+0000","last_change":"2024-04-17T15:41:42.172583+0000","last_active":"2024-04-17T15:41:42.172583+0000","last_peered":"2024-04-17T15:41:42.172583+0000","last_clean":"2024-04-17T15:41:42.172583+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:41:42.172583+0000","last_undegraded":"2024-04-17T15:41:42.172583+0000","last_fullsized":"2024-04-17T15:41:42.172583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:42.172287+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:42.172287+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.172287+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:37.181887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":231,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.534461+0000","last_change":"2024-04-17T15:41:29.534535+0000","last_active":"2024-04-17T15:41:29.534461+0000","last_peered":"2024-04-17T15:41:29.534461+0000","last_clean":"2024-04-17T15:41:29.534461+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:41:29.534461+0000","last_undegraded":"2024-04-17T15:41:29.534461+0000","last_fullsized":"2024-04-17T15:41:29.534461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:29.534228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:29.534228+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.534228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:01.237291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"130'32","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.740980+0000","last_change":"2024-04-17T15:41:21.740980+0000","last_active":"2024-04-17T15:41:21.740980+0000","last_peered":"2024-04-17T15:41:21.740980+0000","last_clean":"2024-04-17T15:41:21.740980+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:41:21.740980+0000","last_undegraded":"2024-04-17T15:41:21.740980+0000","last_fullsized":"2024-04-17T15:41:21.740980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:21.740710+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:21.740710+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.740710+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:34:57.749235+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.614223+0000","last_change":"2024-04-17T15:41:18.614223+0000","last_active":"2024-04-17T15:41:18.614223+0000","last_peered":"2024-04-17T15:41:18.614223+0000","last_clean":"2024-04-17T15:41:18.614223+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:41:18.614223+0000","last_undegraded":"2024-04-17T15:41:18.614223+0000","last_fullsized":"2024-04-17T15:41:18.614223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.613953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.613953+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.613953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:05.749502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.640401+0000","last_change":"2024-04-17T15:41:51.640401+0000","last_active":"2024-04-17T15:41:51.640401+0000","last_peered":"2024-04-17T15:41:51.640401+0000","last_clean":"2024-04-17T15:41:51.640401+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:41:51.640401+0000","last_undegraded":"2024-04-17T15:41:51.640401+0000","last_fullsized":"2024-04-17T15:41:51.640401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-17T15:41:51.639968+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-17T15:41:51.639968+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.639968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:37.755597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.181355+0000","last_change":"2024-04-17T15:41:43.181355+0000","last_active":"2024-04-17T15:41:43.181355+0000","last_peered":"2024-04-17T15:41:43.181355+0000","last_clean":"2024-04-17T15:41:43.181355+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:41:43.181355+0000","last_undegraded":"2024-04-17T15:41:43.181355+0000","last_fullsized":"2024-04-17T15:41:43.181355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-04-17T15:41:43.181098+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-04-17T15:41:43.181098+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.181098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:44:34.260039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"130'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.139796+0000","last_change":"2024-04-17T15:41:41.139796+0000","last_active":"2024-04-17T15:41:41.139796+0000","last_peered":"2024-04-17T15:41:41.139796+0000","last_clean":"2024-04-17T15:41:41.139796+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:41:41.139796+0000","last_undegraded":"2024-04-17T15:41:41.139796+0000","last_fullsized":"2024-04-17T15:41:41.139796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:41.139537+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:41.139537+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.139537+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:22:27.789564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.018281+0000","last_change":"2024-04-17T15:41:37.018422+0000","last_active":"2024-04-17T15:41:37.018281+0000","last_peered":"2024-04-17T15:41:37.018281+0000","last_clean":"2024-04-17T15:41:37.018281+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:41:37.018281+0000","last_undegraded":"2024-04-17T15:41:37.018281+0000","last_fullsized":"2024-04-17T15:41:37.018281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.018026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.018026+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.018026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:57:34.310856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"130'25","reported_seq":267,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.603444+0000","last_change":"2024-04-17T15:41:46.603444+0000","last_active":"2024-04-17T15:41:46.603444+0000","last_peered":"2024-04-17T15:41:46.603444+0000","last_clean":"2024-04-17T15:41:46.603444+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:41:46.603444+0000","last_undegraded":"2024-04-17T15:41:46.603444+0000","last_fullsized":"2024-04-17T15:41:46.603444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'25","last_scrub_stamp":"2024-04-17T15:41:46.603166+0000","last_deep_scrub":"130'25","last_deep_scrub_stamp":"2024-04-17T15:41:46.603166+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.603166+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:59:20.981525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.357478+0000","last_change":"2024-04-17T15:41:24.357478+0000","last_active":"2024-04-17T15:41:24.357478+0000","last_peered":"2024-04-17T15:41:24.357478+0000","last_clean":"2024-04-17T15:41:24.357478+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:41:24.357478+0000","last_undegraded":"2024-04-17T15:41:24.357478+0000","last_fullsized":"2024-04-17T15:41:24.357478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:24.357216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:24.357216+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.357216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:19:42.020463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.685016+0000","last_change":"2024-04-17T15:41:51.685016+0000","last_active":"2024-04-17T15:41:51.685016+0000","last_peered":"2024-04-17T15:41:51.685016+0000","last_clean":"2024-04-17T15:41:51.685016+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:41:51.685016+0000","last_undegraded":"2024-04-17T15:41:51.685016+0000","last_fullsized":"2024-04-17T15:41:51.685016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-04-17T15:41:51.684760+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-04-17T15:41:51.684760+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.684760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:54:02.019064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.682834+0000","last_change":"2024-04-17T15:41:25.682834+0000","last_active":"2024-04-17T15:41:25.682834+0000","last_peered":"2024-04-17T15:41:25.682834+0000","last_clean":"2024-04-17T15:41:25.682834+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:41:25.682834+0000","last_undegraded":"2024-04-17T15:41:25.682834+0000","last_fullsized":"2024-04-17T15:41:25.682834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:25.682410+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:25.682410+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.682410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:14.881844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.700567+0000","last_change":"2024-04-17T15:41:48.700626+0000","last_active":"2024-04-17T15:41:48.700567+0000","last_peered":"2024-04-17T15:41:48.700567+0000","last_clean":"2024-04-17T15:41:48.700567+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:41:48.700567+0000","last_undegraded":"2024-04-17T15:41:48.700567+0000","last_fullsized":"2024-04-17T15:41:48.700567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:48.700365+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:48.700365+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.700365+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:12:10.148004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.983417+0000","last_change":"2024-04-17T15:41:31.983417+0000","last_active":"2024-04-17T15:41:31.983417+0000","last_peered":"2024-04-17T15:41:31.983417+0000","last_clean":"2024-04-17T15:41:31.983417+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:41:31.983417+0000","last_undegraded":"2024-04-17T15:41:31.983417+0000","last_fullsized":"2024-04-17T15:41:31.983417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.983157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.983157+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.983157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:17.175990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"130'17","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.715510+0000","last_change":"2024-04-17T15:41:24.715584+0000","last_active":"2024-04-17T15:41:24.715510+0000","last_peered":"2024-04-17T15:41:24.715510+0000","last_clean":"2024-04-17T15:41:24.715510+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:41:24.715510+0000","last_undegraded":"2024-04-17T15:41:24.715510+0000","last_fullsized":"2024-04-17T15:41:24.715510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'17","last_scrub_stamp":"2024-04-17T15:41:24.715319+0000","last_deep_scrub":"130'17","last_deep_scrub_stamp":"2024-04-17T15:41:24.715319+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.715319+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:41.283821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.265248+0000","last_change":"2024-04-17T15:41:47.265403+0000","last_active":"2024-04-17T15:41:47.265248+0000","last_peered":"2024-04-17T15:41:47.265248+0000","last_clean":"2024-04-17T15:41:47.265248+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:41:47.265248+0000","last_undegraded":"2024-04-17T15:41:47.265248+0000","last_fullsized":"2024-04-17T15:41:47.265248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:47.265026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:47.265026+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.265026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:12.766107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.639649+0000","last_change":"2024-04-17T15:41:50.639649+0000","last_active":"2024-04-17T15:41:50.639649+0000","last_peered":"2024-04-17T15:41:50.639649+0000","last_clean":"2024-04-17T15:41:50.639649+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:41:50.639649+0000","last_undegraded":"2024-04-17T15:41:50.639649+0000","last_fullsized":"2024-04-17T15:41:50.639649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:50.639390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:50.639390+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.639390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:47:45.886791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.940965+0000","last_change":"2024-04-17T15:41:22.940965+0000","last_active":"2024-04-17T15:41:22.940965+0000","last_peered":"2024-04-17T15:41:22.940965+0000","last_clean":"2024-04-17T15:41:22.940965+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:41:22.940965+0000","last_undegraded":"2024-04-17T15:41:22.940965+0000","last_fullsized":"2024-04-17T15:41:22.940965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:22.940691+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:22.940691+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.940691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:32:42.716910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"130'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.659974+0000","last_change":"2024-04-17T15:41:39.660037+0000","last_active":"2024-04-17T15:41:39.659974+0000","last_peered":"2024-04-17T15:41:39.659974+0000","last_clean":"2024-04-17T15:41:39.659974+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:41:39.659974+0000","last_undegraded":"2024-04-17T15:41:39.659974+0000","last_fullsized":"2024-04-17T15:41:39.659974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:39.659785+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:39.659785+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.659785+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:19.004395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"130'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.438667+0000","last_change":"2024-04-17T15:41:20.438667+0000","last_active":"2024-04-17T15:41:20.438667+0000","last_peered":"2024-04-17T15:41:20.438667+0000","last_clean":"2024-04-17T15:41:20.438667+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:41:20.438667+0000","last_undegraded":"2024-04-17T15:41:20.438667+0000","last_fullsized":"2024-04-17T15:41:20.438667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:20.438401+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:20.438401+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.438401+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:50:50.631393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"130'24","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.893624+0000","last_change":"2024-04-17T15:41:16.893715+0000","last_active":"2024-04-17T15:41:16.893624+0000","last_peered":"2024-04-17T15:41:16.893624+0000","last_clean":"2024-04-17T15:41:16.893624+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:41:16.893624+0000","last_undegraded":"2024-04-17T15:41:16.893624+0000","last_fullsized":"2024-04-17T15:41:16.893624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:16.893413+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:16.893413+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.893413+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:00.092896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.683265+0000","last_change":"2024-04-17T15:41:14.683319+0000","last_active":"2024-04-17T15:41:14.683265+0000","last_peered":"2024-04-17T15:41:14.683265+0000","last_clean":"2024-04-17T15:41:14.683265+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:41:14.683265+0000","last_undegraded":"2024-04-17T15:41:14.683265+0000","last_fullsized":"2024-04-17T15:41:14.683265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:14.683062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:14.683062+0000","last_clean_scrub_stamp":"2024-04-17T15:41:14.683062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:57:18.851274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.354719+0000","last_change":"2024-04-17T15:41:52.354776+0000","last_active":"2024-04-17T15:41:52.354719+0000","last_peered":"2024-04-17T15:41:52.354719+0000","last_clean":"2024-04-17T15:41:52.354719+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:41:52.354719+0000","last_undegraded":"2024-04-17T15:41:52.354719+0000","last_fullsized":"2024-04-17T15:41:52.354719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:52.354509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:52.354509+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.354509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:11.785903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.441031+0000","last_change":"2024-04-17T15:41:21.441094+0000","last_active":"2024-04-17T15:41:21.441031+0000","last_peered":"2024-04-17T15:41:21.441031+0000","last_clean":"2024-04-17T15:41:21.441031+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:41:21.441031+0000","last_undegraded":"2024-04-17T15:41:21.441031+0000","last_fullsized":"2024-04-17T15:41:21.441031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:21.440828+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:21.440828+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.440828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:38:17.792880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'56","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.375213+0000","last_change":"2024-04-17T15:41:29.375275+0000","last_active":"2024-04-17T15:41:29.375213+0000","last_peered":"2024-04-17T15:41:29.375213+0000","last_clean":"2024-04-17T15:41:29.375213+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:41:29.375213+0000","last_undegraded":"2024-04-17T15:41:29.375213+0000","last_fullsized":"2024-04-17T15:41:29.375213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:29.374989+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:29.374989+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.374989+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:40.803319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.526174+0000","last_change":"2024-04-17T15:41:25.526241+0000","last_active":"2024-04-17T15:41:25.526174+0000","last_peered":"2024-04-17T15:41:25.526174+0000","last_clean":"2024-04-17T15:41:25.526174+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:41:25.526174+0000","last_undegraded":"2024-04-17T15:41:25.526174+0000","last_fullsized":"2024-04-17T15:41:25.526174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-17T15:41:25.525964+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-17T15:41:25.525964+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.525964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:45.166198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"130'44","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.930689+0000","last_change":"2024-04-17T15:41:21.930755+0000","last_active":"2024-04-17T15:41:21.930689+0000","last_peered":"2024-04-17T15:41:21.930689+0000","last_clean":"2024-04-17T15:41:21.930689+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:41:21.930689+0000","last_undegraded":"2024-04-17T15:41:21.930689+0000","last_fullsized":"2024-04-17T15:41:21.930689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:21.930494+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:21.930494+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.930494+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:07.291135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.781887+0000","last_change":"2024-04-17T15:41:22.781960+0000","last_active":"2024-04-17T15:41:22.781887+0000","last_peered":"2024-04-17T15:41:22.781887+0000","last_clean":"2024-04-17T15:41:22.781887+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:41:22.781887+0000","last_undegraded":"2024-04-17T15:41:22.781887+0000","last_fullsized":"2024-04-17T15:41:22.781887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:22.781678+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:22.781678+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.781678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:23.342470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"130'42","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.088955+0000","last_change":"2024-04-17T15:41:46.089116+0000","last_active":"2024-04-17T15:41:46.088955+0000","last_peered":"2024-04-17T15:41:46.088955+0000","last_clean":"2024-04-17T15:41:46.088955+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:41:46.088955+0000","last_undegraded":"2024-04-17T15:41:46.088955+0000","last_fullsized":"2024-04-17T15:41:46.088955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:46.088713+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:46.088713+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.088713+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:25.433323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.409238+0000","last_change":"2024-04-17T15:41:17.409259+0000","last_active":"2024-04-17T15:41:17.409238+0000","last_peered":"2024-04-17T15:41:17.409238+0000","last_clean":"2024-04-17T15:41:17.409238+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:41:17.409238+0000","last_undegraded":"2024-04-17T15:41:17.409238+0000","last_fullsized":"2024-04-17T15:41:17.409238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.409156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.409156+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.409156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:50.849523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"130'42","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.571208+0000","last_change":"2024-04-17T15:41:41.571297+0000","last_active":"2024-04-17T15:41:41.571208+0000","last_peered":"2024-04-17T15:41:41.571208+0000","last_clean":"2024-04-17T15:41:41.571208+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:41:41.571208+0000","last_undegraded":"2024-04-17T15:41:41.571208+0000","last_fullsized":"2024-04-17T15:41:41.571208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:41.570944+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:41.570944+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.570944+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:47:36.818345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.645917+0000","last_change":"2024-04-17T15:41:26.645981+0000","last_active":"2024-04-17T15:41:26.645917+0000","last_peered":"2024-04-17T15:41:26.645917+0000","last_clean":"2024-04-17T15:41:26.645917+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:41:26.645917+0000","last_undegraded":"2024-04-17T15:41:26.645917+0000","last_fullsized":"2024-04-17T15:41:26.645917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:26.645717+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.645717+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.645717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:28:00.142871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"130'50","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.790380+0000","last_change":"2024-04-17T15:41:32.790441+0000","last_active":"2024-04-17T15:41:32.790380+0000","last_peered":"2024-04-17T15:41:32.790380+0000","last_clean":"2024-04-17T15:41:32.790380+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:41:32.790380+0000","last_undegraded":"2024-04-17T15:41:32.790380+0000","last_fullsized":"2024-04-17T15:41:32.790380+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:32.790174+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:32.790174+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.790174+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:31:27.935480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.993934+0000","last_change":"2024-04-17T15:41:29.993997+0000","last_active":"2024-04-17T15:41:29.993934+0000","last_peered":"2024-04-17T15:41:29.993934+0000","last_clean":"2024-04-17T15:41:29.993934+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:41:29.993934+0000","last_undegraded":"2024-04-17T15:41:29.993934+0000","last_fullsized":"2024-04-17T15:41:29.993934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-17T15:41:29.993733+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-17T15:41:29.993733+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.993733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:02.192795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"130'64","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.519997+0000","last_change":"2024-04-17T15:41:35.520062+0000","last_active":"2024-04-17T15:41:35.519997+0000","last_peered":"2024-04-17T15:41:35.519997+0000","last_clean":"2024-04-17T15:41:35.519997+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:41:35.519997+0000","last_undegraded":"2024-04-17T15:41:35.519997+0000","last_fullsized":"2024-04-17T15:41:35.519997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'64","last_scrub_stamp":"2024-04-17T15:41:35.519801+0000","last_deep_scrub":"130'64","last_deep_scrub_stamp":"2024-04-17T15:41:35.519801+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.519801+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:48.282272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.587736+0000","last_change":"2024-04-17T15:41:28.587804+0000","last_active":"2024-04-17T15:41:28.587736+0000","last_peered":"2024-04-17T15:41:28.587736+0000","last_clean":"2024-04-17T15:41:28.587736+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:41:28.587736+0000","last_undegraded":"2024-04-17T15:41:28.587736+0000","last_fullsized":"2024-04-17T15:41:28.587736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.587204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.587204+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.587204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:23.366632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"130'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.370927+0000","last_change":"2024-04-17T15:41:30.371062+0000","last_active":"2024-04-17T15:41:30.370927+0000","last_peered":"2024-04-17T15:41:30.370927+0000","last_clean":"2024-04-17T15:41:30.370927+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:41:30.370927+0000","last_undegraded":"2024-04-17T15:41:30.370927+0000","last_fullsized":"2024-04-17T15:41:30.370927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:30.370687+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:30.370687+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.370687+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:41:10.555528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.387185+0000","last_change":"2024-04-17T15:41:23.387250+0000","last_active":"2024-04-17T15:41:23.387185+0000","last_peered":"2024-04-17T15:41:23.387185+0000","last_clean":"2024-04-17T15:41:23.387185+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:41:23.387185+0000","last_undegraded":"2024-04-17T15:41:23.387185+0000","last_fullsized":"2024-04-17T15:41:23.387185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:23.386978+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.386978+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.386978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:00:28.652613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"130'42","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.728250+0000","last_change":"2024-04-17T15:41:45.728311+0000","last_active":"2024-04-17T15:41:45.728250+0000","last_peered":"2024-04-17T15:41:45.728250+0000","last_clean":"2024-04-17T15:41:45.728250+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:41:45.728250+0000","last_undegraded":"2024-04-17T15:41:45.728250+0000","last_fullsized":"2024-04-17T15:41:45.728250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:45.728032+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:45.728032+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.728032+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:29:26.628351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.601066+0000","last_change":"2024-04-17T15:41:23.601066+0000","last_active":"2024-04-17T15:41:23.601066+0000","last_peered":"2024-04-17T15:41:23.601066+0000","last_clean":"2024-04-17T15:41:23.601066+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:41:23.601066+0000","last_undegraded":"2024-04-17T15:41:23.601066+0000","last_fullsized":"2024-04-17T15:41:23.601066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-17T15:41:23.600781+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.600781+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.600781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:49:55.799844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"130'50","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.168205+0000","last_change":"2024-04-17T15:41:43.168269+0000","last_active":"2024-04-17T15:41:43.168205+0000","last_peered":"2024-04-17T15:41:43.168205+0000","last_clean":"2024-04-17T15:41:43.168205+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:41:43.168205+0000","last_undegraded":"2024-04-17T15:41:43.168205+0000","last_fullsized":"2024-04-17T15:41:43.168205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:43.167980+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:43.167980+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.167980+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:44:34.246920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.979375+0000","last_change":"2024-04-17T15:41:32.979375+0000","last_active":"2024-04-17T15:41:32.979375+0000","last_peered":"2024-04-17T15:41:32.979375+0000","last_clean":"2024-04-17T15:41:32.979375+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:41:32.979375+0000","last_undegraded":"2024-04-17T15:41:32.979375+0000","last_fullsized":"2024-04-17T15:41:32.979375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'16","last_scrub_stamp":"2024-04-17T15:41:32.979109+0000","last_deep_scrub":"90'16","last_deep_scrub_stamp":"2024-04-17T15:41:32.979109+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.979109+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:34:16.937759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.709359+0000","last_change":"2024-04-17T15:41:46.709523+0000","last_active":"2024-04-17T15:41:46.709359+0000","last_peered":"2024-04-17T15:41:46.709359+0000","last_clean":"2024-04-17T15:41:46.709359+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:41:46.709359+0000","last_undegraded":"2024-04-17T15:41:46.709359+0000","last_fullsized":"2024-04-17T15:41:46.709359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:46.709131+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:46.709131+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.709131+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:29:48.915395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.852878+0000","last_change":"2024-04-17T15:41:25.852878+0000","last_active":"2024-04-17T15:41:25.852878+0000","last_peered":"2024-04-17T15:41:25.852878+0000","last_clean":"2024-04-17T15:41:25.852878+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:41:25.852878+0000","last_undegraded":"2024-04-17T15:41:25.852878+0000","last_fullsized":"2024-04-17T15:41:25.852878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:25.852499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:25.852499+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.852499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:36:40.255637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"130'48","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.892041+0000","last_change":"2024-04-17T15:41:31.892222+0000","last_active":"2024-04-17T15:41:31.892041+0000","last_peered":"2024-04-17T15:41:31.892041+0000","last_clean":"2024-04-17T15:41:31.892041+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:41:31.892041+0000","last_undegraded":"2024-04-17T15:41:31.892041+0000","last_fullsized":"2024-04-17T15:41:31.892041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:31.891738+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:31.891738+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.891738+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:50:57.269411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.005508+0000","last_change":"2024-04-17T15:41:27.005573+0000","last_active":"2024-04-17T15:41:27.005508+0000","last_peered":"2024-04-17T15:41:27.005508+0000","last_clean":"2024-04-17T15:41:27.005508+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:41:27.005508+0000","last_undegraded":"2024-04-17T15:41:27.005508+0000","last_fullsized":"2024-04-17T15:41:27.005508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:27.005304+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:27.005304+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.005304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:14.664016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"130'52","reported_seq":295,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.651677+0000","last_change":"2024-04-17T15:41:44.651820+0000","last_active":"2024-04-17T15:41:44.651677+0000","last_peered":"2024-04-17T15:41:44.651677+0000","last_clean":"2024-04-17T15:41:44.651677+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:41:44.651677+0000","last_undegraded":"2024-04-17T15:41:44.651677+0000","last_fullsized":"2024-04-17T15:41:44.651677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'52","last_scrub_stamp":"2024-04-17T15:41:44.651437+0000","last_deep_scrub":"130'52","last_deep_scrub_stamp":"2024-04-17T15:41:44.651437+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.651437+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:36.794558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.541354+0000","last_change":"2024-04-17T15:41:26.541416+0000","last_active":"2024-04-17T15:41:26.541354+0000","last_peered":"2024-04-17T15:41:26.541354+0000","last_clean":"2024-04-17T15:41:26.541354+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:41:26.541354+0000","last_undegraded":"2024-04-17T15:41:26.541354+0000","last_fullsized":"2024-04-17T15:41:26.541354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:26.541147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:26.541147+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.541147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:29.507403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"130'58","reported_seq":300,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.384677+0000","last_change":"2024-04-17T15:41:33.384740+0000","last_active":"2024-04-17T15:41:33.384677+0000","last_peered":"2024-04-17T15:41:33.384677+0000","last_clean":"2024-04-17T15:41:33.384677+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:41:33.384677+0000","last_undegraded":"2024-04-17T15:41:33.384677+0000","last_fullsized":"2024-04-17T15:41:33.384677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'58","last_scrub_stamp":"2024-04-17T15:41:33.384469+0000","last_deep_scrub":"130'58","last_deep_scrub_stamp":"2024-04-17T15:41:33.384469+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.384469+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:09.392994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.691041+0000","last_change":"2024-04-17T15:41:33.691101+0000","last_active":"2024-04-17T15:41:33.691041+0000","last_peered":"2024-04-17T15:41:33.691041+0000","last_clean":"2024-04-17T15:41:33.691041+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:41:33.691041+0000","last_undegraded":"2024-04-17T15:41:33.691041+0000","last_fullsized":"2024-04-17T15:41:33.691041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:33.690823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:33.690823+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.690823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:48.637788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"130'40","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.592949+0000","last_change":"2024-04-17T15:41:44.593121+0000","last_active":"2024-04-17T15:41:44.592949+0000","last_peered":"2024-04-17T15:41:44.592949+0000","last_clean":"2024-04-17T15:41:44.592949+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:41:44.592949+0000","last_undegraded":"2024-04-17T15:41:44.592949+0000","last_fullsized":"2024-04-17T15:41:44.592949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'40","last_scrub_stamp":"2024-04-17T15:41:44.592710+0000","last_deep_scrub":"130'40","last_deep_scrub_stamp":"2024-04-17T15:41:44.592710+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.592710+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:39.602310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":196,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.876977+0000","last_change":"2024-04-17T15:41:35.877036+0000","last_active":"2024-04-17T15:41:35.876977+0000","last_peered":"2024-04-17T15:41:35.876977+0000","last_clean":"2024-04-17T15:41:35.876977+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:41:35.876977+0000","last_undegraded":"2024-04-17T15:41:35.876977+0000","last_fullsized":"2024-04-17T15:41:35.876977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:35.876770+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:35.876770+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.876770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:04.436894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"130'32","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.890286+0000","last_change":"2024-04-17T15:41:22.890286+0000","last_active":"2024-04-17T15:41:22.890286+0000","last_peered":"2024-04-17T15:41:22.890286+0000","last_clean":"2024-04-17T15:41:22.890286+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:41:22.890286+0000","last_undegraded":"2024-04-17T15:41:22.890286+0000","last_fullsized":"2024-04-17T15:41:22.890286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:22.890024+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:22.890024+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.890024+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:00:49.597161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.502757+0000","last_change":"2024-04-17T15:41:24.502823+0000","last_active":"2024-04-17T15:41:24.502757+0000","last_peered":"2024-04-17T15:41:24.502757+0000","last_clean":"2024-04-17T15:41:24.502757+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:41:24.502757+0000","last_undegraded":"2024-04-17T15:41:24.502757+0000","last_fullsized":"2024-04-17T15:41:24.502757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-17T15:41:24.502560+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-17T15:41:24.502560+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.502560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:00.511085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"130'46","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.837117+0000","last_change":"2024-04-17T15:41:33.837182+0000","last_active":"2024-04-17T15:41:33.837117+0000","last_peered":"2024-04-17T15:41:33.837117+0000","last_clean":"2024-04-17T15:41:33.837117+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:41:33.837117+0000","last_undegraded":"2024-04-17T15:41:33.837117+0000","last_fullsized":"2024-04-17T15:41:33.837117+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:33.836927+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:33.836927+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.836927+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:19.751050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"130'66","reported_seq":308,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.048431+0000","last_change":"2024-04-17T15:41:38.048494+0000","last_active":"2024-04-17T15:41:38.048431+0000","last_peered":"2024-04-17T15:41:38.048431+0000","last_clean":"2024-04-17T15:41:38.048431+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:41:38.048431+0000","last_undegraded":"2024-04-17T15:41:38.048431+0000","last_fullsized":"2024-04-17T15:41:38.048431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'66","last_scrub_stamp":"2024-04-17T15:41:38.048232+0000","last_deep_scrub":"130'66","last_deep_scrub_stamp":"2024-04-17T15:41:38.048232+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.048232+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:17:27.850025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.601697+0000","last_change":"2024-04-17T15:41:22.601697+0000","last_active":"2024-04-17T15:41:22.601697+0000","last_peered":"2024-04-17T15:41:22.601697+0000","last_clean":"2024-04-17T15:41:22.601697+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:41:22.601697+0000","last_undegraded":"2024-04-17T15:41:22.601697+0000","last_fullsized":"2024-04-17T15:41:22.601697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:22.601419+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:22.601419+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.601419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:00.013870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"130'28","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.529620+0000","last_change":"2024-04-17T15:41:30.529620+0000","last_active":"2024-04-17T15:41:30.529620+0000","last_peered":"2024-04-17T15:41:30.529620+0000","last_clean":"2024-04-17T15:41:30.529620+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:41:30.529620+0000","last_undegraded":"2024-04-17T15:41:30.529620+0000","last_fullsized":"2024-04-17T15:41:30.529620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-17T15:41:30.529343+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-17T15:41:30.529343+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.529343+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:06:00.524787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.858404+0000","last_change":"2024-04-17T15:41:27.858404+0000","last_active":"2024-04-17T15:41:27.858404+0000","last_peered":"2024-04-17T15:41:27.858404+0000","last_clean":"2024-04-17T15:41:27.858404+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:41:27.858404+0000","last_undegraded":"2024-04-17T15:41:27.858404+0000","last_fullsized":"2024-04-17T15:41:27.858404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-17T15:41:27.858121+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-17T15:41:27.858121+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.858121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:05.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1107,"ondisk_log_size":1107,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1539,"num_write":537,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542212,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37484,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334356,"statfs":{"total":96636764160,"available":96598380544,"internally_reserved":0,"allocated":2199552,"data_stored":1519562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542211,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1581056,"data_stored":928534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":929809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542211,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1568768,"data_stored":928032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36908,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334932,"statfs":{"total":96636764160,"available":96598970368,"internally_reserved":0,"allocated":1609728,"data_stored":930326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1568768,"data_stored":928096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36904,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334936,"statfs":{"total":96636764160,"available":96598974464,"internally_reserved":0,"allocated":1605632,"data_stored":929612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1519961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:41:58.852 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-17T15:37:03.239017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=37, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=15, tm_min=41, tm_sec=12, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T15:41:58.853 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T15:42:18.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T15:42:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-17T15:42:19.195 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-17T15:42:19.207 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-04-17T15:42:18.365299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616016,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5028,"num_read_kb":3926,"num_write":4421,"num_write_kb":6187915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5695,"ondisk_log_size":5695,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":292152,"kb_used_data":13624,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754682568,"statfs":{"total":773094113280,"available":772794949632,"internally_reserved":0,"allocated":13950976,"data_stored":8613932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":285134386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006728"},"pg_stats":[{"pgid":"3.3f","version":"130'38","reported_seq":278,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.617314+0000","last_change":"2024-04-17T15:41:34.617374+0000","last_active":"2024-04-17T15:41:34.617314+0000","last_peered":"2024-04-17T15:41:34.617314+0000","last_clean":"2024-04-17T15:41:34.617314+0000","last_became_active":"2024-04-17T15:36:54.208001+0000","last_became_peered":"2024-04-17T15:36:54.208001+0000","last_unstale":"2024-04-17T15:41:34.617314+0000","last_undegraded":"2024-04-17T15:41:34.617314+0000","last_fullsized":"2024-04-17T15:41:34.617314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:34.617105+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:34.617105+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.617105+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:50:59.994778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.797545+0000","last_change":"2024-04-17T15:41:23.797545+0000","last_active":"2024-04-17T15:41:23.797545+0000","last_peered":"2024-04-17T15:41:23.797545+0000","last_clean":"2024-04-17T15:41:23.797545+0000","last_became_active":"2024-04-17T15:36:56.214606+0000","last_became_peered":"2024-04-17T15:36:56.214606+0000","last_unstale":"2024-04-17T15:41:23.797545+0000","last_undegraded":"2024-04-17T15:41:23.797545+0000","last_fullsized":"2024-04-17T15:41:23.797545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.797290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.797290+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.797290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:26.763546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"130'52","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.493816+0000","last_change":"2024-04-17T15:41:34.493879+0000","last_active":"2024-04-17T15:41:34.493816+0000","last_peered":"2024-04-17T15:41:34.493816+0000","last_clean":"2024-04-17T15:41:34.493816+0000","last_became_active":"2024-04-17T15:36:54.171406+0000","last_became_peered":"2024-04-17T15:36:54.171406+0000","last_unstale":"2024-04-17T15:41:34.493816+0000","last_undegraded":"2024-04-17T15:41:34.493816+0000","last_fullsized":"2024-04-17T15:41:34.493816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'52","last_scrub_stamp":"2024-04-17T15:41:34.493584+0000","last_deep_scrub":"130'52","last_deep_scrub_stamp":"2024-04-17T15:41:34.493584+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.493584+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:06.692647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"72'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.516308+0000","last_change":"2024-04-17T15:41:22.516308+0000","last_active":"2024-04-17T15:41:22.516308+0000","last_peered":"2024-04-17T15:41:22.516308+0000","last_clean":"2024-04-17T15:41:22.516308+0000","last_became_active":"2024-04-17T15:36:56.209323+0000","last_became_peered":"2024-04-17T15:36:56.209323+0000","last_unstale":"2024-04-17T15:41:22.516308+0000","last_undegraded":"2024-04-17T15:41:22.516308+0000","last_fullsized":"2024-04-17T15:41:22.516308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:22.516050+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:22.516050+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.516050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:42.156284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"130'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.693604+0000","last_change":"2024-04-17T15:41:38.693672+0000","last_active":"2024-04-17T15:41:38.693604+0000","last_peered":"2024-04-17T15:41:38.693604+0000","last_clean":"2024-04-17T15:41:38.693604+0000","last_became_active":"2024-04-17T15:36:54.174259+0000","last_became_peered":"2024-04-17T15:36:54.174259+0000","last_unstale":"2024-04-17T15:41:38.693604+0000","last_undegraded":"2024-04-17T15:41:38.693604+0000","last_fullsized":"2024-04-17T15:41:38.693604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:38.693372+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:38.693372+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.693372+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:52.660308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"77'8","reported_seq":258,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.995193+0000","last_change":"2024-04-17T15:41:28.995193+0000","last_active":"2024-04-17T15:41:28.995193+0000","last_peered":"2024-04-17T15:41:28.995193+0000","last_clean":"2024-04-17T15:41:28.995193+0000","last_became_active":"2024-04-17T15:36:56.196724+0000","last_became_peered":"2024-04-17T15:36:56.196724+0000","last_unstale":"2024-04-17T15:41:28.995193+0000","last_undegraded":"2024-04-17T15:41:28.995193+0000","last_fullsized":"2024-04-17T15:41:28.995193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'8","last_scrub_stamp":"2024-04-17T15:41:28.994794+0000","last_deep_scrub":"77'8","last_deep_scrub_stamp":"2024-04-17T15:41:28.994794+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.994794+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:06.407245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"130'38","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.979316+0000","last_change":"2024-04-17T15:41:33.979447+0000","last_active":"2024-04-17T15:41:33.979316+0000","last_peered":"2024-04-17T15:41:33.979316+0000","last_clean":"2024-04-17T15:41:33.979316+0000","last_became_active":"2024-04-17T15:36:54.180796+0000","last_became_peered":"2024-04-17T15:36:54.180796+0000","last_unstale":"2024-04-17T15:41:33.979316+0000","last_undegraded":"2024-04-17T15:41:33.979316+0000","last_fullsized":"2024-04-17T15:41:33.979316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:33.979064+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:33.979064+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.979064+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:18:30.649416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"72'8","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.615086+0000","last_change":"2024-04-17T15:41:27.615086+0000","last_active":"2024-04-17T15:41:27.615086+0000","last_peered":"2024-04-17T15:41:27.615086+0000","last_clean":"2024-04-17T15:41:27.615086+0000","last_became_active":"2024-04-17T15:36:56.194886+0000","last_became_peered":"2024-04-17T15:36:56.194886+0000","last_unstale":"2024-04-17T15:41:27.615086+0000","last_undegraded":"2024-04-17T15:41:27.615086+0000","last_fullsized":"2024-04-17T15:41:27.615086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'8","last_scrub_stamp":"2024-04-17T15:41:27.614662+0000","last_deep_scrub":"72'8","last_deep_scrub_stamp":"2024-04-17T15:41:27.614662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.614662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:02.679627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"130'62","reported_seq":302,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.564666+0000","last_change":"2024-04-17T15:41:42.564666+0000","last_active":"2024-04-17T15:41:42.564666+0000","last_peered":"2024-04-17T15:41:42.564666+0000","last_clean":"2024-04-17T15:41:42.564666+0000","last_became_active":"2024-04-17T15:36:54.205862+0000","last_became_peered":"2024-04-17T15:36:54.205862+0000","last_unstale":"2024-04-17T15:41:42.564666+0000","last_undegraded":"2024-04-17T15:41:42.564666+0000","last_fullsized":"2024-04-17T15:41:42.564666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'62","last_scrub_stamp":"2024-04-17T15:41:42.564409+0000","last_deep_scrub":"130'62","last_deep_scrub_stamp":"2024-04-17T15:41:42.564409+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.564409+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:06.242267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"72'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.338879+0000","last_change":"2024-04-17T15:41:25.338942+0000","last_active":"2024-04-17T15:41:25.338879+0000","last_peered":"2024-04-17T15:41:25.338879+0000","last_clean":"2024-04-17T15:41:25.338879+0000","last_became_active":"2024-04-17T15:36:56.191729+0000","last_became_peered":"2024-04-17T15:36:56.191729+0000","last_unstale":"2024-04-17T15:41:25.338879+0000","last_undegraded":"2024-04-17T15:41:25.338879+0000","last_fullsized":"2024-04-17T15:41:25.338879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:25.338660+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:25.338660+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.338660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:09.383031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"130'38","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.120465+0000","last_change":"2024-04-17T15:41:44.120465+0000","last_active":"2024-04-17T15:41:44.120465+0000","last_peered":"2024-04-17T15:41:44.120465+0000","last_clean":"2024-04-17T15:41:44.120465+0000","last_became_active":"2024-04-17T15:36:54.175289+0000","last_became_peered":"2024-04-17T15:36:54.175289+0000","last_unstale":"2024-04-17T15:41:44.120465+0000","last_undegraded":"2024-04-17T15:41:44.120465+0000","last_fullsized":"2024-04-17T15:41:44.120465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:44.120208+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:44.120208+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.120208+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:50.597675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"71'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.969227+0000","last_change":"2024-04-17T15:41:25.969291+0000","last_active":"2024-04-17T15:41:25.969227+0000","last_peered":"2024-04-17T15:41:25.969227+0000","last_clean":"2024-04-17T15:41:25.969227+0000","last_became_active":"2024-04-17T15:36:56.202642+0000","last_became_peered":"2024-04-17T15:36:56.202642+0000","last_unstale":"2024-04-17T15:41:25.969227+0000","last_undegraded":"2024-04-17T15:41:25.969227+0000","last_fullsized":"2024-04-17T15:41:25.969227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:25.969023+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:25.969023+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.969023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:20:34.200894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"130'48","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.572326+0000","last_change":"2024-04-17T15:41:40.572326+0000","last_active":"2024-04-17T15:41:40.572326+0000","last_peered":"2024-04-17T15:41:40.572326+0000","last_clean":"2024-04-17T15:41:40.572326+0000","last_became_active":"2024-04-17T15:36:54.204554+0000","last_became_peered":"2024-04-17T15:36:54.204554+0000","last_unstale":"2024-04-17T15:41:40.572326+0000","last_undegraded":"2024-04-17T15:41:40.572326+0000","last_fullsized":"2024-04-17T15:41:40.572326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:40.572070+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:40.572070+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.572070+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:17:30.373864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"77'4","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.787979+0000","last_change":"2024-04-17T15:41:25.788128+0000","last_active":"2024-04-17T15:41:25.787979+0000","last_peered":"2024-04-17T15:41:25.787979+0000","last_clean":"2024-04-17T15:41:25.787979+0000","last_became_active":"2024-04-17T15:36:56.206163+0000","last_became_peered":"2024-04-17T15:36:56.206163+0000","last_unstale":"2024-04-17T15:41:25.787979+0000","last_undegraded":"2024-04-17T15:41:25.787979+0000","last_fullsized":"2024-04-17T15:41:25.787979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-17T15:41:25.787631+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-17T15:41:25.787631+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.787631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:13.446342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"130'58","reported_seq":300,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.731477+0000","last_change":"2024-04-17T15:41:47.731477+0000","last_active":"2024-04-17T15:41:47.731477+0000","last_peered":"2024-04-17T15:41:47.731477+0000","last_clean":"2024-04-17T15:41:47.731477+0000","last_became_active":"2024-04-17T15:36:54.186087+0000","last_became_peered":"2024-04-17T15:36:54.186087+0000","last_unstale":"2024-04-17T15:41:47.731477+0000","last_undegraded":"2024-04-17T15:41:47.731477+0000","last_fullsized":"2024-04-17T15:41:47.731477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'58","last_scrub_stamp":"2024-04-17T15:41:47.731042+0000","last_deep_scrub":"130'58","last_deep_scrub_stamp":"2024-04-17T15:41:47.731042+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.731042+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:31:30.372812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.804128+0000","last_change":"2024-04-17T15:41:26.804250+0000","last_active":"2024-04-17T15:41:26.804128+0000","last_peered":"2024-04-17T15:41:26.804128+0000","last_clean":"2024-04-17T15:41:26.804128+0000","last_became_active":"2024-04-17T15:36:56.195350+0000","last_became_peered":"2024-04-17T15:36:56.195350+0000","last_unstale":"2024-04-17T15:41:26.804128+0000","last_undegraded":"2024-04-17T15:41:26.804128+0000","last_fullsized":"2024-04-17T15:41:26.804128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:26.803898+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:26.803898+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.803898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:47:27.426934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"112'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.964726+0000","last_change":"2024-04-17T15:41:30.964726+0000","last_active":"2024-04-17T15:41:30.964726+0000","last_peered":"2024-04-17T15:41:30.964726+0000","last_clean":"2024-04-17T15:41:30.964726+0000","last_became_active":"2024-04-17T15:36:56.196234+0000","last_became_peered":"2024-04-17T15:36:56.196234+0000","last_unstale":"2024-04-17T15:41:30.964726+0000","last_undegraded":"2024-04-17T15:41:30.964726+0000","last_fullsized":"2024-04-17T15:41:30.964726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:30.964462+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:30.964462+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.964462+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:43.726934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"130'30","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.677642+0000","last_change":"2024-04-17T15:41:52.677702+0000","last_active":"2024-04-17T15:41:52.677642+0000","last_peered":"2024-04-17T15:41:52.677642+0000","last_clean":"2024-04-17T15:41:52.677642+0000","last_became_active":"2024-04-17T15:37:41.355820+0000","last_became_peered":"2024-04-17T15:37:41.355820+0000","last_unstale":"2024-04-17T15:41:52.677642+0000","last_undegraded":"2024-04-17T15:41:52.677642+0000","last_fullsized":"2024-04-17T15:41:52.677642+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'30","last_scrub_stamp":"2024-04-17T15:41:52.677443+0000","last_deep_scrub":"130'30","last_deep_scrub_stamp":"2024-04-17T15:41:52.677443+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.677443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:35.794425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"71'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.518571+0000","last_change":"2024-04-17T15:41:21.518571+0000","last_active":"2024-04-17T15:41:21.518571+0000","last_peered":"2024-04-17T15:41:21.518571+0000","last_clean":"2024-04-17T15:41:21.518571+0000","last_became_active":"2024-04-17T15:36:56.213480+0000","last_became_peered":"2024-04-17T15:36:56.213480+0000","last_unstale":"2024-04-17T15:41:21.518571+0000","last_undegraded":"2024-04-17T15:41:21.518571+0000","last_fullsized":"2024-04-17T15:41:21.518571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:21.518229+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:21.518229+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.518229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:19.754292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"130'38","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.352217+0000","last_change":"2024-04-17T15:41:32.352217+0000","last_active":"2024-04-17T15:41:32.352217+0000","last_peered":"2024-04-17T15:41:32.352217+0000","last_clean":"2024-04-17T15:41:32.352217+0000","last_became_active":"2024-04-17T15:36:54.196611+0000","last_became_peered":"2024-04-17T15:36:54.196611+0000","last_unstale":"2024-04-17T15:41:32.352217+0000","last_undegraded":"2024-04-17T15:41:32.352217+0000","last_fullsized":"2024-04-17T15:41:32.352217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:32.351945+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:32.351945+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.351945+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:53.957332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"72'6","reported_seq":251,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.894223+0000","last_change":"2024-04-17T15:41:29.894223+0000","last_active":"2024-04-17T15:41:29.894223+0000","last_peered":"2024-04-17T15:41:29.894223+0000","last_clean":"2024-04-17T15:41:29.894223+0000","last_became_active":"2024-04-17T15:36:56.192565+0000","last_became_peered":"2024-04-17T15:36:56.192565+0000","last_unstale":"2024-04-17T15:41:29.894223+0000","last_undegraded":"2024-04-17T15:41:29.894223+0000","last_fullsized":"2024-04-17T15:41:29.894223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:29.893844+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:29.893844+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.893844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:42.656316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.338947+0000","last_change":"2024-04-17T15:41:31.338947+0000","last_active":"2024-04-17T15:41:31.338947+0000","last_peered":"2024-04-17T15:41:31.338947+0000","last_clean":"2024-04-17T15:41:31.338947+0000","last_became_active":"2024-04-17T15:36:54.196255+0000","last_became_peered":"2024-04-17T15:36:54.196255+0000","last_unstale":"2024-04-17T15:41:31.338947+0000","last_undegraded":"2024-04-17T15:41:31.338947+0000","last_fullsized":"2024-04-17T15:41:31.338947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:31.338675+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:31.338675+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.338675+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:57:35.506887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'14","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.859707+0000","last_change":"2024-04-17T15:41:24.859707+0000","last_active":"2024-04-17T15:41:24.859707+0000","last_peered":"2024-04-17T15:41:24.859707+0000","last_clean":"2024-04-17T15:41:24.859707+0000","last_became_active":"2024-04-17T15:36:56.189642+0000","last_became_peered":"2024-04-17T15:36:56.189642+0000","last_unstale":"2024-04-17T15:41:24.859707+0000","last_undegraded":"2024-04-17T15:41:24.859707+0000","last_fullsized":"2024-04-17T15:41:24.859707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'14","last_scrub_stamp":"2024-04-17T15:41:24.859436+0000","last_deep_scrub":"90'14","last_deep_scrub_stamp":"2024-04-17T15:41:24.859436+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.859436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:24:28.370533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"130'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.180166+0000","last_change":"2024-04-17T15:41:41.180166+0000","last_active":"2024-04-17T15:41:41.180166+0000","last_peered":"2024-04-17T15:41:41.180166+0000","last_clean":"2024-04-17T15:41:41.180166+0000","last_became_active":"2024-04-17T15:36:54.190706+0000","last_became_peered":"2024-04-17T15:36:54.190706+0000","last_unstale":"2024-04-17T15:41:41.180166+0000","last_undegraded":"2024-04-17T15:41:41.180166+0000","last_fullsized":"2024-04-17T15:41:41.180166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:41.179912+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:41.179912+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.179912+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:37:58.777061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"90'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.790501+0000","last_change":"2024-04-17T15:41:27.790501+0000","last_active":"2024-04-17T15:41:27.790501+0000","last_peered":"2024-04-17T15:41:27.790501+0000","last_clean":"2024-04-17T15:41:27.790501+0000","last_became_active":"2024-04-17T15:36:56.199027+0000","last_became_peered":"2024-04-17T15:36:56.199027+0000","last_unstale":"2024-04-17T15:41:27.790501+0000","last_undegraded":"2024-04-17T15:41:27.790501+0000","last_fullsized":"2024-04-17T15:41:27.790501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-17T15:41:27.790233+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-17T15:41:27.790233+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.790233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:19:14.364970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"130'40","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.674475+0000","last_change":"2024-04-17T15:41:40.674475+0000","last_active":"2024-04-17T15:41:40.674475+0000","last_peered":"2024-04-17T15:41:40.674475+0000","last_clean":"2024-04-17T15:41:40.674475+0000","last_became_active":"2024-04-17T15:36:54.188469+0000","last_became_peered":"2024-04-17T15:36:54.188469+0000","last_unstale":"2024-04-17T15:41:40.674475+0000","last_undegraded":"2024-04-17T15:41:40.674475+0000","last_fullsized":"2024-04-17T15:41:40.674475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'40","last_scrub_stamp":"2024-04-17T15:41:40.674221+0000","last_deep_scrub":"130'40","last_deep_scrub_stamp":"2024-04-17T15:41:40.674221+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.674221+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:23:54.146356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"112'6","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.056174+0000","last_change":"2024-04-17T15:41:35.056174+0000","last_active":"2024-04-17T15:41:35.056174+0000","last_peered":"2024-04-17T15:41:35.056174+0000","last_clean":"2024-04-17T15:41:35.056174+0000","last_became_active":"2024-04-17T15:36:56.186042+0000","last_became_peered":"2024-04-17T15:36:56.186042+0000","last_unstale":"2024-04-17T15:41:35.056174+0000","last_undegraded":"2024-04-17T15:41:35.056174+0000","last_fullsized":"2024-04-17T15:41:35.056174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'6","last_scrub_stamp":"2024-04-17T15:41:35.055896+0000","last_deep_scrub":"112'6","last_deep_scrub_stamp":"2024-04-17T15:41:35.055896+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.055896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:37.223590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"130'48","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.567580+0000","last_change":"2024-04-17T15:41:42.567651+0000","last_active":"2024-04-17T15:41:42.567580+0000","last_peered":"2024-04-17T15:41:42.567580+0000","last_clean":"2024-04-17T15:41:42.567580+0000","last_became_active":"2024-04-17T15:36:54.181157+0000","last_became_peered":"2024-04-17T15:36:54.181157+0000","last_unstale":"2024-04-17T15:41:42.567580+0000","last_undegraded":"2024-04-17T15:41:42.567580+0000","last_fullsized":"2024-04-17T15:41:42.567580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:42.567359+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:42.567359+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.567359+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:28.682988+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"77'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:53.380195+0000","last_change":"2024-04-17T15:41:53.380195+0000","last_active":"2024-04-17T15:41:53.380195+0000","last_peered":"2024-04-17T15:41:53.380195+0000","last_clean":"2024-04-17T15:41:53.380195+0000","last_became_active":"2024-04-17T15:37:04.297686+0000","last_became_peered":"2024-04-17T15:37:04.297686+0000","last_unstale":"2024-04-17T15:41:53.380195+0000","last_undegraded":"2024-04-17T15:41:53.380195+0000","last_fullsized":"2024-04-17T15:41:53.380195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-17T15:41:53.379919+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-17T15:41:53.379919+0000","last_clean_scrub_stamp":"2024-04-17T15:41:53.379919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:59:27.758278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"71'2","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.590969+0000","last_change":"2024-04-17T15:41:36.591060+0000","last_active":"2024-04-17T15:41:36.590969+0000","last_peered":"2024-04-17T15:41:36.590969+0000","last_clean":"2024-04-17T15:41:36.590969+0000","last_became_active":"2024-04-17T15:36:56.178188+0000","last_became_peered":"2024-04-17T15:36:56.178188+0000","last_unstale":"2024-04-17T15:41:36.590969+0000","last_undegraded":"2024-04-17T15:41:36.590969+0000","last_fullsized":"2024-04-17T15:41:36.590969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:36.590741+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:36.590741+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.590741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:57:33.412196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"130'52","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.531281+0000","last_change":"2024-04-17T15:41:32.531281+0000","last_active":"2024-04-17T15:41:32.531281+0000","last_peered":"2024-04-17T15:41:32.531281+0000","last_clean":"2024-04-17T15:41:32.531281+0000","last_became_active":"2024-04-17T15:36:54.210803+0000","last_became_peered":"2024-04-17T15:36:54.210803+0000","last_unstale":"2024-04-17T15:41:32.531281+0000","last_undegraded":"2024-04-17T15:41:32.531281+0000","last_fullsized":"2024-04-17T15:41:32.531281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'52","last_scrub_stamp":"2024-04-17T15:41:32.531024+0000","last_deep_scrub":"130'52","last_deep_scrub_stamp":"2024-04-17T15:41:32.531024+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.531024+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.293496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.857605+0000","last_change":"2024-04-17T15:41:28.857605+0000","last_active":"2024-04-17T15:41:28.857605+0000","last_peered":"2024-04-17T15:41:28.857605+0000","last_clean":"2024-04-17T15:41:28.857605+0000","last_became_active":"2024-04-17T15:36:58.218734+0000","last_became_peered":"2024-04-17T15:36:58.218734+0000","last_unstale":"2024-04-17T15:41:28.857605+0000","last_undegraded":"2024-04-17T15:41:28.857605+0000","last_fullsized":"2024-04-17T15:41:28.857605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.857277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.857277+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.857277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:01.056340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"130'23","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.600731+0000","last_change":"2024-04-17T15:41:19.600731+0000","last_active":"2024-04-17T15:41:19.600731+0000","last_peered":"2024-04-17T15:41:19.600731+0000","last_clean":"2024-04-17T15:41:19.600731+0000","last_became_active":"2024-04-17T15:37:00.261751+0000","last_became_peered":"2024-04-17T15:37:00.261751+0000","last_unstale":"2024-04-17T15:41:19.600731+0000","last_undegraded":"2024-04-17T15:41:19.600731+0000","last_fullsized":"2024-04-17T15:41:19.600731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'23","last_scrub_stamp":"2024-04-17T15:41:19.600479+0000","last_deep_scrub":"130'23","last_deep_scrub_stamp":"2024-04-17T15:41:19.600479+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.600479+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:20:27.832350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.643073+0000","last_change":"2024-04-17T15:41:48.643073+0000","last_active":"2024-04-17T15:41:48.643073+0000","last_peered":"2024-04-17T15:41:48.643073+0000","last_clean":"2024-04-17T15:41:48.643073+0000","last_became_active":"2024-04-17T15:37:02.273698+0000","last_became_peered":"2024-04-17T15:37:02.273698+0000","last_unstale":"2024-04-17T15:41:48.643073+0000","last_undegraded":"2024-04-17T15:41:48.643073+0000","last_fullsized":"2024-04-17T15:41:48.643073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:48.642765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:48.642765+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.642765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:27.987375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"130'53","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.194531+0000","last_change":"2024-04-17T15:41:52.194531+0000","last_active":"2024-04-17T15:41:52.194531+0000","last_peered":"2024-04-17T15:41:52.194531+0000","last_clean":"2024-04-17T15:41:52.194531+0000","last_became_active":"2024-04-17T15:37:04.292939+0000","last_became_peered":"2024-04-17T15:37:04.292939+0000","last_unstale":"2024-04-17T15:41:52.194531+0000","last_undegraded":"2024-04-17T15:41:52.194531+0000","last_fullsized":"2024-04-17T15:41:52.194531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'53","last_scrub_stamp":"2024-04-17T15:41:52.194193+0000","last_deep_scrub":"130'53","last_deep_scrub_stamp":"2024-04-17T15:41:52.194193+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.194193+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:13:42.015063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":109,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"98'4","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.784439+0000","last_change":"2024-04-17T15:41:24.784439+0000","last_active":"2024-04-17T15:41:24.784439+0000","last_peered":"2024-04-17T15:41:24.784439+0000","last_clean":"2024-04-17T15:41:24.784439+0000","last_became_active":"2024-04-17T15:36:56.214229+0000","last_became_peered":"2024-04-17T15:36:56.214229+0000","last_unstale":"2024-04-17T15:41:24.784439+0000","last_undegraded":"2024-04-17T15:41:24.784439+0000","last_fullsized":"2024-04-17T15:41:24.784439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-17T15:41:24.784150+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-17T15:41:24.784150+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.784150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:54.779594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"130'36","reported_seq":279,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.657345+0000","last_change":"2024-04-17T15:41:35.657345+0000","last_active":"2024-04-17T15:41:35.657345+0000","last_peered":"2024-04-17T15:41:35.657345+0000","last_clean":"2024-04-17T15:41:35.657345+0000","last_became_active":"2024-04-17T15:36:54.202892+0000","last_became_peered":"2024-04-17T15:36:54.202892+0000","last_unstale":"2024-04-17T15:41:35.657345+0000","last_undegraded":"2024-04-17T15:41:35.657345+0000","last_fullsized":"2024-04-17T15:41:35.657345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'36","last_scrub_stamp":"2024-04-17T15:41:35.657082+0000","last_deep_scrub":"130'36","last_deep_scrub_stamp":"2024-04-17T15:41:35.657082+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.657082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:30.666682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.638165+0000","last_change":"2024-04-17T15:41:37.638165+0000","last_active":"2024-04-17T15:41:37.638165+0000","last_peered":"2024-04-17T15:41:37.638165+0000","last_clean":"2024-04-17T15:41:37.638165+0000","last_became_active":"2024-04-17T15:36:58.236012+0000","last_became_peered":"2024-04-17T15:36:58.236012+0000","last_unstale":"2024-04-17T15:41:37.638165+0000","last_undegraded":"2024-04-17T15:41:37.638165+0000","last_fullsized":"2024-04-17T15:41:37.638165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.637910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.637910+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.637910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:50:36.988918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"130'9","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.964582+0000","last_change":"2024-04-17T15:41:20.964582+0000","last_active":"2024-04-17T15:41:20.964582+0000","last_peered":"2024-04-17T15:41:20.964582+0000","last_clean":"2024-04-17T15:41:20.964582+0000","last_became_active":"2024-04-17T15:37:00.241868+0000","last_became_peered":"2024-04-17T15:37:00.241868+0000","last_unstale":"2024-04-17T15:41:20.964582+0000","last_undegraded":"2024-04-17T15:41:20.964582+0000","last_fullsized":"2024-04-17T15:41:20.964582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'9","last_scrub_stamp":"2024-04-17T15:41:20.964292+0000","last_deep_scrub":"130'9","last_deep_scrub_stamp":"2024-04-17T15:41:20.964292+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.964292+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:40.604526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.276078+0000","last_change":"2024-04-17T15:41:48.276078+0000","last_active":"2024-04-17T15:41:48.276078+0000","last_peered":"2024-04-17T15:41:48.276078+0000","last_clean":"2024-04-17T15:41:48.276078+0000","last_became_active":"2024-04-17T15:37:02.276419+0000","last_became_peered":"2024-04-17T15:37:02.276419+0000","last_unstale":"2024-04-17T15:41:48.276078+0000","last_undegraded":"2024-04-17T15:41:48.276078+0000","last_fullsized":"2024-04-17T15:41:48.276078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:48.275702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:48.275702+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.275702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:47:43.523103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.631079+0000","last_change":"2024-04-17T15:41:52.631079+0000","last_active":"2024-04-17T15:41:52.631079+0000","last_peered":"2024-04-17T15:41:52.631079+0000","last_clean":"2024-04-17T15:41:52.631079+0000","last_became_active":"2024-04-17T15:37:04.284779+0000","last_became_peered":"2024-04-17T15:37:04.284779+0000","last_unstale":"2024-04-17T15:41:52.631079+0000","last_undegraded":"2024-04-17T15:41:52.631079+0000","last_fullsized":"2024-04-17T15:41:52.631079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:52.630798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:52.630798+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.630798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:36:27.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"112'4","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.618274+0000","last_change":"2024-04-17T15:41:29.618274+0000","last_active":"2024-04-17T15:41:29.618274+0000","last_peered":"2024-04-17T15:41:29.618274+0000","last_clean":"2024-04-17T15:41:29.618274+0000","last_became_active":"2024-04-17T15:36:56.194680+0000","last_became_peered":"2024-04-17T15:36:56.194680+0000","last_unstale":"2024-04-17T15:41:29.618274+0000","last_undegraded":"2024-04-17T15:41:29.618274+0000","last_fullsized":"2024-04-17T15:41:29.618274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:29.618029+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:29.618029+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.618029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:31.723480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"130'64","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.640152+0000","last_change":"2024-04-17T15:41:36.640212+0000","last_active":"2024-04-17T15:41:36.640152+0000","last_peered":"2024-04-17T15:41:36.640152+0000","last_clean":"2024-04-17T15:41:36.640152+0000","last_became_active":"2024-04-17T15:36:54.207882+0000","last_became_peered":"2024-04-17T15:36:54.207882+0000","last_unstale":"2024-04-17T15:41:36.640152+0000","last_undegraded":"2024-04-17T15:41:36.640152+0000","last_fullsized":"2024-04-17T15:41:36.640152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'64","last_scrub_stamp":"2024-04-17T15:41:36.639951+0000","last_deep_scrub":"130'64","last_deep_scrub_stamp":"2024-04-17T15:41:36.639951+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.639951+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:18:33.310304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.629316+0000","last_change":"2024-04-17T15:41:31.629316+0000","last_active":"2024-04-17T15:41:31.629316+0000","last_peered":"2024-04-17T15:41:31.629316+0000","last_clean":"2024-04-17T15:41:31.629316+0000","last_became_active":"2024-04-17T15:36:58.216933+0000","last_became_peered":"2024-04-17T15:36:58.216933+0000","last_unstale":"2024-04-17T15:41:31.629316+0000","last_undegraded":"2024-04-17T15:41:31.629316+0000","last_fullsized":"2024-04-17T15:41:31.629316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.629060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.629060+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.629060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:44.224061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"130'16","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.792764+0000","last_change":"2024-04-17T15:41:28.792764+0000","last_active":"2024-04-17T15:41:28.792764+0000","last_peered":"2024-04-17T15:41:28.792764+0000","last_clean":"2024-04-17T15:41:28.792764+0000","last_became_active":"2024-04-17T15:37:00.231354+0000","last_became_peered":"2024-04-17T15:37:00.231354+0000","last_unstale":"2024-04-17T15:41:28.792764+0000","last_undegraded":"2024-04-17T15:41:28.792764+0000","last_fullsized":"2024-04-17T15:41:28.792764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'16","last_scrub_stamp":"2024-04-17T15:41:28.792469+0000","last_deep_scrub":"130'16","last_deep_scrub_stamp":"2024-04-17T15:41:28.792469+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.792469+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:00:34.058105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'139","reported_seq":412,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.625401+0000","last_change":"2024-04-17T15:41:46.625401+0000","last_active":"2024-04-17T15:41:46.625401+0000","last_peered":"2024-04-17T15:41:46.625401+0000","last_clean":"2024-04-17T15:41:46.625401+0000","last_became_active":"2024-04-17T15:37:02.270551+0000","last_became_peered":"2024-04-17T15:37:02.270551+0000","last_unstale":"2024-04-17T15:41:46.625401+0000","last_undegraded":"2024-04-17T15:41:46.625401+0000","last_fullsized":"2024-04-17T15:41:46.625401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'139","last_scrub_stamp":"2024-04-17T15:41:46.625140+0000","last_deep_scrub":"130'139","last_deep_scrub_stamp":"2024-04-17T15:41:46.625140+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.625140+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:40:53.102607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'2","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.260192+0000","last_change":"2024-04-17T15:41:50.260192+0000","last_active":"2024-04-17T15:41:50.260192+0000","last_peered":"2024-04-17T15:41:50.260192+0000","last_clean":"2024-04-17T15:41:50.260192+0000","last_became_active":"2024-04-17T15:37:04.263549+0000","last_became_peered":"2024-04-17T15:37:04.263549+0000","last_unstale":"2024-04-17T15:41:50.260192+0000","last_undegraded":"2024-04-17T15:41:50.260192+0000","last_fullsized":"2024-04-17T15:41:50.260192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:50.259923+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:50.259923+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.259923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:19:45.110213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"98'12","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.613037+0000","last_change":"2024-04-17T15:41:27.613037+0000","last_active":"2024-04-17T15:41:27.613037+0000","last_peered":"2024-04-17T15:41:27.613037+0000","last_clean":"2024-04-17T15:41:27.613037+0000","last_became_active":"2024-04-17T15:36:56.195365+0000","last_became_peered":"2024-04-17T15:36:56.195365+0000","last_unstale":"2024-04-17T15:41:27.613037+0000","last_undegraded":"2024-04-17T15:41:27.613037+0000","last_fullsized":"2024-04-17T15:41:27.613037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'12","last_scrub_stamp":"2024-04-17T15:41:27.612626+0000","last_deep_scrub":"98'12","last_deep_scrub_stamp":"2024-04-17T15:41:27.612626+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.612626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:39:17.082170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"130'64","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.410912+0000","last_change":"2024-04-17T15:41:27.410912+0000","last_active":"2024-04-17T15:41:27.410912+0000","last_peered":"2024-04-17T15:41:27.410912+0000","last_clean":"2024-04-17T15:41:27.410912+0000","last_became_active":"2024-04-17T15:36:54.176346+0000","last_became_peered":"2024-04-17T15:36:54.176346+0000","last_unstale":"2024-04-17T15:41:27.410912+0000","last_undegraded":"2024-04-17T15:41:27.410912+0000","last_fullsized":"2024-04-17T15:41:27.410912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'64","last_scrub_stamp":"2024-04-17T15:41:27.410662+0000","last_deep_scrub":"130'64","last_deep_scrub_stamp":"2024-04-17T15:41:27.410662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.410662+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:53:04.407705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":74,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.940497+0000","last_change":"2024-04-17T15:41:32.940497+0000","last_active":"2024-04-17T15:41:32.940497+0000","last_peered":"2024-04-17T15:41:32.940497+0000","last_clean":"2024-04-17T15:41:32.940497+0000","last_became_active":"2024-04-17T15:36:58.221945+0000","last_became_peered":"2024-04-17T15:36:58.221945+0000","last_unstale":"2024-04-17T15:41:32.940497+0000","last_undegraded":"2024-04-17T15:41:32.940497+0000","last_fullsized":"2024-04-17T15:41:32.940497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:32.940096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:32.940096+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.940096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:02.485981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"130'23","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.544489+0000","last_change":"2024-04-17T15:41:18.544489+0000","last_active":"2024-04-17T15:41:18.544489+0000","last_peered":"2024-04-17T15:41:18.544489+0000","last_clean":"2024-04-17T15:41:18.544489+0000","last_became_active":"2024-04-17T15:37:00.456592+0000","last_became_peered":"2024-04-17T15:37:00.456592+0000","last_unstale":"2024-04-17T15:41:18.544489+0000","last_undegraded":"2024-04-17T15:41:18.544489+0000","last_fullsized":"2024-04-17T15:41:18.544489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'23","last_scrub_stamp":"2024-04-17T15:41:18.544178+0000","last_deep_scrub":"130'23","last_deep_scrub_stamp":"2024-04-17T15:41:18.544178+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.544178+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:38:14.896230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"130'138","reported_seq":491,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.671540+0000","last_change":"2024-04-17T15:41:19.671540+0000","last_active":"2024-04-17T15:41:19.671540+0000","last_peered":"2024-04-17T15:41:19.671540+0000","last_clean":"2024-04-17T15:41:19.671540+0000","last_became_active":"2024-04-17T15:37:02.279116+0000","last_became_peered":"2024-04-17T15:37:02.279116+0000","last_unstale":"2024-04-17T15:41:19.671540+0000","last_undegraded":"2024-04-17T15:41:19.671540+0000","last_fullsized":"2024-04-17T15:41:19.671540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:19.671263+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:19.671263+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.671263+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:30:55.652499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"112'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.838593+0000","last_change":"2024-04-17T15:41:26.838726+0000","last_active":"2024-04-17T15:41:26.838593+0000","last_peered":"2024-04-17T15:41:26.838593+0000","last_clean":"2024-04-17T15:41:26.838593+0000","last_became_active":"2024-04-17T15:36:56.220705+0000","last_became_peered":"2024-04-17T15:36:56.220705+0000","last_unstale":"2024-04-17T15:41:26.838593+0000","last_undegraded":"2024-04-17T15:41:26.838593+0000","last_fullsized":"2024-04-17T15:41:26.838593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'6","last_scrub_stamp":"2024-04-17T15:41:26.838284+0000","last_deep_scrub":"112'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.838284+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.838284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:58.541347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"130'46","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.553846+0000","last_change":"2024-04-17T15:41:28.553916+0000","last_active":"2024-04-17T15:41:28.553846+0000","last_peered":"2024-04-17T15:41:28.553846+0000","last_clean":"2024-04-17T15:41:28.553846+0000","last_became_active":"2024-04-17T15:36:54.212105+0000","last_became_peered":"2024-04-17T15:36:54.212105+0000","last_unstale":"2024-04-17T15:41:28.553846+0000","last_undegraded":"2024-04-17T15:41:28.553846+0000","last_fullsized":"2024-04-17T15:41:28.553846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:28.553599+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:28.553599+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.553599+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:16.212311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.548510+0000","last_change":"2024-04-17T15:41:25.548695+0000","last_active":"2024-04-17T15:41:25.548510+0000","last_peered":"2024-04-17T15:41:25.548510+0000","last_clean":"2024-04-17T15:41:25.548510+0000","last_became_active":"2024-04-17T15:36:58.238039+0000","last_became_peered":"2024-04-17T15:36:58.238039+0000","last_unstale":"2024-04-17T15:41:25.548510+0000","last_undegraded":"2024-04-17T15:41:25.548510+0000","last_fullsized":"2024-04-17T15:41:25.548510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:25.548222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:25.548222+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.548222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:26.109015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"130'38","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.708552+0000","last_change":"2024-04-17T15:41:18.708552+0000","last_active":"2024-04-17T15:41:18.708552+0000","last_peered":"2024-04-17T15:41:18.708552+0000","last_clean":"2024-04-17T15:41:18.708552+0000","last_became_active":"2024-04-17T15:37:00.453455+0000","last_became_peered":"2024-04-17T15:37:00.453455+0000","last_unstale":"2024-04-17T15:41:18.708552+0000","last_undegraded":"2024-04-17T15:41:18.708552+0000","last_fullsized":"2024-04-17T15:41:18.708552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:18.708164+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:18.708164+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.708164+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:16.944227+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.513515+0000","last_change":"2024-04-17T15:41:38.513570+0000","last_active":"2024-04-17T15:41:38.513515+0000","last_peered":"2024-04-17T15:41:38.513515+0000","last_clean":"2024-04-17T15:41:38.513515+0000","last_became_active":"2024-04-17T15:37:02.272084+0000","last_became_peered":"2024-04-17T15:37:02.272084+0000","last_unstale":"2024-04-17T15:41:38.513515+0000","last_undegraded":"2024-04-17T15:41:38.513515+0000","last_fullsized":"2024-04-17T15:41:38.513515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:38.513298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:38.513298+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.513298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:13.578263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.148509+0000","last_change":"2024-04-17T15:41:51.148570+0000","last_active":"2024-04-17T15:41:51.148509+0000","last_peered":"2024-04-17T15:41:51.148509+0000","last_clean":"2024-04-17T15:41:51.148509+0000","last_became_active":"2024-04-17T15:37:04.292804+0000","last_became_peered":"2024-04-17T15:37:04.292804+0000","last_unstale":"2024-04-17T15:41:51.148509+0000","last_undegraded":"2024-04-17T15:41:51.148509+0000","last_fullsized":"2024-04-17T15:41:51.148509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:51.148298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:51.148298+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.148298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:43.291418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"98'14","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.231740+0000","last_change":"2024-04-17T15:41:44.231806+0000","last_active":"2024-04-17T15:41:44.231740+0000","last_peered":"2024-04-17T15:41:44.231740+0000","last_clean":"2024-04-17T15:41:44.231740+0000","last_became_active":"2024-04-17T15:36:56.178926+0000","last_became_peered":"2024-04-17T15:36:56.178926+0000","last_unstale":"2024-04-17T15:41:44.231740+0000","last_undegraded":"2024-04-17T15:41:44.231740+0000","last_fullsized":"2024-04-17T15:41:44.231740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'14","last_scrub_stamp":"2024-04-17T15:41:44.231509+0000","last_deep_scrub":"98'14","last_deep_scrub_stamp":"2024-04-17T15:41:44.231509+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.231509+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:10.492377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"130'22","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.511631+0000","last_change":"2024-04-17T15:41:30.511692+0000","last_active":"2024-04-17T15:41:30.511631+0000","last_peered":"2024-04-17T15:41:30.511631+0000","last_clean":"2024-04-17T15:41:30.511631+0000","last_became_active":"2024-04-17T15:36:54.210284+0000","last_became_peered":"2024-04-17T15:36:54.210284+0000","last_unstale":"2024-04-17T15:41:30.511631+0000","last_undegraded":"2024-04-17T15:41:30.511631+0000","last_fullsized":"2024-04-17T15:41:30.511631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'22","last_scrub_stamp":"2024-04-17T15:41:30.511439+0000","last_deep_scrub":"130'22","last_deep_scrub_stamp":"2024-04-17T15:41:30.511439+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.511439+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:07.923890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.882775+0000","last_change":"2024-04-17T15:41:15.882775+0000","last_active":"2024-04-17T15:41:15.882775+0000","last_peered":"2024-04-17T15:41:15.882775+0000","last_clean":"2024-04-17T15:41:15.882775+0000","last_became_active":"2024-04-17T15:36:58.222629+0000","last_became_peered":"2024-04-17T15:36:58.222629+0000","last_unstale":"2024-04-17T15:41:15.882775+0000","last_undegraded":"2024-04-17T15:41:15.882775+0000","last_fullsized":"2024-04-17T15:41:15.882775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.882598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.882598+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.882598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:40:28.164354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"130'25","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.744933+0000","last_change":"2024-04-17T15:41:49.745014+0000","last_active":"2024-04-17T15:41:49.744933+0000","last_peered":"2024-04-17T15:41:49.744933+0000","last_clean":"2024-04-17T15:41:49.744933+0000","last_became_active":"2024-04-17T15:37:00.257321+0000","last_became_peered":"2024-04-17T15:37:00.257321+0000","last_unstale":"2024-04-17T15:41:49.744933+0000","last_undegraded":"2024-04-17T15:41:49.744933+0000","last_fullsized":"2024-04-17T15:41:49.744933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'25","last_scrub_stamp":"2024-04-17T15:41:49.744737+0000","last_deep_scrub":"130'25","last_deep_scrub_stamp":"2024-04-17T15:41:49.744737+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.744737+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:38.480384+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.664017+0000","last_change":"2024-04-17T15:41:23.664075+0000","last_active":"2024-04-17T15:41:23.664017+0000","last_peered":"2024-04-17T15:41:23.664017+0000","last_clean":"2024-04-17T15:41:23.664017+0000","last_became_active":"2024-04-17T15:37:02.282046+0000","last_became_peered":"2024-04-17T15:37:02.282046+0000","last_unstale":"2024-04-17T15:41:23.664017+0000","last_undegraded":"2024-04-17T15:41:23.664017+0000","last_fullsized":"2024-04-17T15:41:23.664017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.663756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.663756+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.663756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:56:55.726756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.424301+0000","last_change":"2024-04-17T15:41:39.424360+0000","last_active":"2024-04-17T15:41:39.424301+0000","last_peered":"2024-04-17T15:41:39.424301+0000","last_clean":"2024-04-17T15:41:39.424301+0000","last_became_active":"2024-04-17T15:37:04.279827+0000","last_became_peered":"2024-04-17T15:37:04.279827+0000","last_unstale":"2024-04-17T15:41:39.424301+0000","last_undegraded":"2024-04-17T15:41:39.424301+0000","last_fullsized":"2024-04-17T15:41:39.424301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:39.424110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:39.424110+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.424110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:38:34.626149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"112'8","reported_seq":272,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.324344+0000","last_change":"2024-04-17T15:41:21.324413+0000","last_active":"2024-04-17T15:41:21.324344+0000","last_peered":"2024-04-17T15:41:21.324344+0000","last_clean":"2024-04-17T15:41:21.324344+0000","last_became_active":"2024-04-17T15:36:56.210522+0000","last_became_peered":"2024-04-17T15:36:56.210522+0000","last_unstale":"2024-04-17T15:41:21.324344+0000","last_undegraded":"2024-04-17T15:41:21.324344+0000","last_fullsized":"2024-04-17T15:41:21.324344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'8","last_scrub_stamp":"2024-04-17T15:41:21.324137+0000","last_deep_scrub":"112'8","last_deep_scrub_stamp":"2024-04-17T15:41:21.324137+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.324137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:47:21.947173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"130'40","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.583835+0000","last_change":"2024-04-17T15:41:41.583900+0000","last_active":"2024-04-17T15:41:41.583835+0000","last_peered":"2024-04-17T15:41:41.583835+0000","last_clean":"2024-04-17T15:41:41.583835+0000","last_became_active":"2024-04-17T15:36:54.204865+0000","last_became_peered":"2024-04-17T15:36:54.204865+0000","last_unstale":"2024-04-17T15:41:41.583835+0000","last_undegraded":"2024-04-17T15:41:41.583835+0000","last_fullsized":"2024-04-17T15:41:41.583835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'40","last_scrub_stamp":"2024-04-17T15:41:41.583607+0000","last_deep_scrub":"130'40","last_deep_scrub_stamp":"2024-04-17T15:41:41.583607+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.583607+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:51.961297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.920383+0000","last_change":"2024-04-17T15:41:16.920383+0000","last_active":"2024-04-17T15:41:16.920383+0000","last_peered":"2024-04-17T15:41:16.920383+0000","last_clean":"2024-04-17T15:41:16.920383+0000","last_became_active":"2024-04-17T15:36:58.225373+0000","last_became_peered":"2024-04-17T15:36:58.225373+0000","last_unstale":"2024-04-17T15:41:16.920383+0000","last_undegraded":"2024-04-17T15:41:16.920383+0000","last_fullsized":"2024-04-17T15:41:16.920383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.920269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.920269+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.920269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:30.123465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"130'35","reported_seq":277,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.494452+0000","last_change":"2024-04-17T15:41:31.494534+0000","last_active":"2024-04-17T15:41:31.494452+0000","last_peered":"2024-04-17T15:41:31.494452+0000","last_clean":"2024-04-17T15:41:31.494452+0000","last_became_active":"2024-04-17T15:37:00.253599+0000","last_became_peered":"2024-04-17T15:37:00.253599+0000","last_unstale":"2024-04-17T15:41:31.494452+0000","last_undegraded":"2024-04-17T15:41:31.494452+0000","last_fullsized":"2024-04-17T15:41:31.494452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'35","last_scrub_stamp":"2024-04-17T15:41:31.494253+0000","last_deep_scrub":"130'35","last_deep_scrub_stamp":"2024-04-17T15:41:31.494253+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.494253+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:03.693316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":151,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"130'139","reported_seq":415,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.623039+0000","last_change":"2024-04-17T15:41:47.623108+0000","last_active":"2024-04-17T15:41:47.623039+0000","last_peered":"2024-04-17T15:41:47.623039+0000","last_clean":"2024-04-17T15:41:47.623039+0000","last_became_active":"2024-04-17T15:37:02.286867+0000","last_became_peered":"2024-04-17T15:37:02.286867+0000","last_unstale":"2024-04-17T15:41:47.623039+0000","last_undegraded":"2024-04-17T15:41:47.623039+0000","last_fullsized":"2024-04-17T15:41:47.623039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'139","last_scrub_stamp":"2024-04-17T15:41:47.622786+0000","last_deep_scrub":"130'139","last_deep_scrub_stamp":"2024-04-17T15:41:47.622786+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.622786+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:43:05.418475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.677386+0000","last_change":"2024-04-17T15:41:51.677441+0000","last_active":"2024-04-17T15:41:51.677386+0000","last_peered":"2024-04-17T15:41:51.677386+0000","last_clean":"2024-04-17T15:41:51.677386+0000","last_became_active":"2024-04-17T15:37:04.284810+0000","last_became_peered":"2024-04-17T15:37:04.284810+0000","last_unstale":"2024-04-17T15:41:51.677386+0000","last_undegraded":"2024-04-17T15:41:51.677386+0000","last_fullsized":"2024-04-17T15:41:51.677386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:51.677176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:51.677176+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.677176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:40:03.017072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.674154+0000","last_change":"2024-04-17T15:41:31.674211+0000","last_active":"2024-04-17T15:41:31.674154+0000","last_peered":"2024-04-17T15:41:31.674154+0000","last_clean":"2024-04-17T15:41:31.674154+0000","last_became_active":"2024-04-17T15:36:56.191315+0000","last_became_peered":"2024-04-17T15:36:56.191315+0000","last_unstale":"2024-04-17T15:41:31.674154+0000","last_undegraded":"2024-04-17T15:41:31.674154+0000","last_fullsized":"2024-04-17T15:41:31.674154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.673958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.673958+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.673958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:31.641587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.108630+0000","last_change":"2024-04-17T15:41:45.108788+0000","last_active":"2024-04-17T15:41:45.108630+0000","last_peered":"2024-04-17T15:41:45.108630+0000","last_clean":"2024-04-17T15:41:45.108630+0000","last_became_active":"2024-04-17T15:36:54.179756+0000","last_became_peered":"2024-04-17T15:36:54.179756+0000","last_unstale":"2024-04-17T15:41:45.108630+0000","last_undegraded":"2024-04-17T15:41:45.108630+0000","last_fullsized":"2024-04-17T15:41:45.108630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:45.108390+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:45.108390+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.108390+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:10:55.660655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.974163+0000","last_change":"2024-04-17T15:41:19.974163+0000","last_active":"2024-04-17T15:41:19.974163+0000","last_peered":"2024-04-17T15:41:19.974163+0000","last_clean":"2024-04-17T15:41:19.974163+0000","last_became_active":"2024-04-17T15:36:58.210962+0000","last_became_peered":"2024-04-17T15:36:58.210962+0000","last_unstale":"2024-04-17T15:41:19.974163+0000","last_undegraded":"2024-04-17T15:41:19.974163+0000","last_fullsized":"2024-04-17T15:41:19.974163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.973921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.973921+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.973921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:28:46.132982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"130'39","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.676347+0000","last_change":"2024-04-17T15:41:34.676425+0000","last_active":"2024-04-17T15:41:34.676347+0000","last_peered":"2024-04-17T15:41:34.676347+0000","last_clean":"2024-04-17T15:41:34.676347+0000","last_became_active":"2024-04-17T15:37:00.260539+0000","last_became_peered":"2024-04-17T15:37:00.260539+0000","last_unstale":"2024-04-17T15:41:34.676347+0000","last_undegraded":"2024-04-17T15:41:34.676347+0000","last_fullsized":"2024-04-17T15:41:34.676347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'39","last_scrub_stamp":"2024-04-17T15:41:34.676154+0000","last_deep_scrub":"130'39","last_deep_scrub_stamp":"2024-04-17T15:41:34.676154+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.676154+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:37:52.273303+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.747022+0000","last_change":"2024-04-17T15:41:30.747076+0000","last_active":"2024-04-17T15:41:30.747022+0000","last_peered":"2024-04-17T15:41:30.747022+0000","last_clean":"2024-04-17T15:41:30.747022+0000","last_became_active":"2024-04-17T15:37:02.268096+0000","last_became_peered":"2024-04-17T15:37:02.268096+0000","last_unstale":"2024-04-17T15:41:30.747022+0000","last_undegraded":"2024-04-17T15:41:30.747022+0000","last_fullsized":"2024-04-17T15:41:30.747022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:30.746811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:30.746811+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.746811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:07:17.390374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"130'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.499677+0000","last_change":"2024-04-17T15:41:43.499738+0000","last_active":"2024-04-17T15:41:43.499677+0000","last_peered":"2024-04-17T15:41:43.499677+0000","last_clean":"2024-04-17T15:41:43.499677+0000","last_became_active":"2024-04-17T15:37:04.296443+0000","last_became_peered":"2024-04-17T15:37:04.296443+0000","last_unstale":"2024-04-17T15:41:43.499677+0000","last_undegraded":"2024-04-17T15:41:43.499677+0000","last_fullsized":"2024-04-17T15:41:43.499677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'6","last_scrub_stamp":"2024-04-17T15:41:43.499488+0000","last_deep_scrub":"130'6","last_deep_scrub_stamp":"2024-04-17T15:41:43.499488+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.499488+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:22:10.787762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.146599+0000","last_change":"2024-04-17T15:41:37.146653+0000","last_active":"2024-04-17T15:41:37.146599+0000","last_peered":"2024-04-17T15:41:37.146599+0000","last_clean":"2024-04-17T15:41:37.146599+0000","last_became_active":"2024-04-17T15:36:56.184811+0000","last_became_peered":"2024-04-17T15:36:56.184811+0000","last_unstale":"2024-04-17T15:41:37.146599+0000","last_undegraded":"2024-04-17T15:41:37.146599+0000","last_fullsized":"2024-04-17T15:41:37.146599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.146395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.146395+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.146395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:37:39.812659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"130'42","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.716678+0000","last_change":"2024-04-17T15:41:44.716736+0000","last_active":"2024-04-17T15:41:44.716678+0000","last_peered":"2024-04-17T15:41:44.716678+0000","last_clean":"2024-04-17T15:41:44.716678+0000","last_became_active":"2024-04-17T15:36:54.177325+0000","last_became_peered":"2024-04-17T15:36:54.177325+0000","last_unstale":"2024-04-17T15:41:44.716678+0000","last_undegraded":"2024-04-17T15:41:44.716678+0000","last_fullsized":"2024-04-17T15:41:44.716678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:44.716489+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:44.716489+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.716489+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:45.580892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.003296+0000","last_change":"2024-04-17T15:41:19.003296+0000","last_active":"2024-04-17T15:41:19.003296+0000","last_peered":"2024-04-17T15:41:19.003296+0000","last_clean":"2024-04-17T15:41:19.003296+0000","last_became_active":"2024-04-17T15:36:58.237115+0000","last_became_peered":"2024-04-17T15:36:58.237115+0000","last_unstale":"2024-04-17T15:41:19.003296+0000","last_undegraded":"2024-04-17T15:41:19.003296+0000","last_fullsized":"2024-04-17T15:41:19.003296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.003037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.003037+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.003037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:36:30.103992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"130'26","reported_seq":266,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.859010+0000","last_change":"2024-04-17T15:41:17.859010+0000","last_active":"2024-04-17T15:41:17.859010+0000","last_peered":"2024-04-17T15:41:17.859010+0000","last_clean":"2024-04-17T15:41:17.859010+0000","last_became_active":"2024-04-17T15:37:00.250574+0000","last_became_peered":"2024-04-17T15:37:00.250574+0000","last_unstale":"2024-04-17T15:41:17.859010+0000","last_undegraded":"2024-04-17T15:41:17.859010+0000","last_fullsized":"2024-04-17T15:41:17.859010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:17.858698+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:17.858698+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.858698+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:49.387644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.573820+0000","last_change":"2024-04-17T15:41:20.573820+0000","last_active":"2024-04-17T15:41:20.573820+0000","last_peered":"2024-04-17T15:41:20.573820+0000","last_clean":"2024-04-17T15:41:20.573820+0000","last_became_active":"2024-04-17T15:37:02.282685+0000","last_became_peered":"2024-04-17T15:37:02.282685+0000","last_unstale":"2024-04-17T15:41:20.573820+0000","last_undegraded":"2024-04-17T15:41:20.573820+0000","last_fullsized":"2024-04-17T15:41:20.573820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.573596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.573596+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.573596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:08.232307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"130'2","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.726223+0000","last_change":"2024-04-17T15:41:52.726309+0000","last_active":"2024-04-17T15:41:52.726223+0000","last_peered":"2024-04-17T15:41:52.726223+0000","last_clean":"2024-04-17T15:41:52.726223+0000","last_became_active":"2024-04-17T15:37:04.296308+0000","last_became_peered":"2024-04-17T15:37:04.296308+0000","last_unstale":"2024-04-17T15:41:52.726223+0000","last_undegraded":"2024-04-17T15:41:52.726223+0000","last_fullsized":"2024-04-17T15:41:52.726223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:52.726030+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:52.726030+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.726030+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:36:19.207192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.931854+0000","last_change":"2024-04-17T15:41:23.931854+0000","last_active":"2024-04-17T15:41:23.931854+0000","last_peered":"2024-04-17T15:41:23.931854+0000","last_clean":"2024-04-17T15:41:23.931854+0000","last_became_active":"2024-04-17T15:36:56.201073+0000","last_became_peered":"2024-04-17T15:36:56.201073+0000","last_unstale":"2024-04-17T15:41:23.931854+0000","last_undegraded":"2024-04-17T15:41:23.931854+0000","last_fullsized":"2024-04-17T15:41:23.931854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.931597+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.931597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:26:48.545570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"130'54","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.418665+0000","last_change":"2024-04-17T15:41:28.418733+0000","last_active":"2024-04-17T15:41:28.418665+0000","last_peered":"2024-04-17T15:41:28.418665+0000","last_clean":"2024-04-17T15:41:28.418665+0000","last_became_active":"2024-04-17T15:36:54.182926+0000","last_became_peered":"2024-04-17T15:36:54.182926+0000","last_unstale":"2024-04-17T15:41:28.418665+0000","last_undegraded":"2024-04-17T15:41:28.418665+0000","last_fullsized":"2024-04-17T15:41:28.418665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'54","last_scrub_stamp":"2024-04-17T15:41:28.418456+0000","last_deep_scrub":"130'54","last_deep_scrub_stamp":"2024-04-17T15:41:28.418456+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.418456+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:14.332579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.410798+0000","last_change":"2024-04-17T15:41:16.410798+0000","last_active":"2024-04-17T15:41:16.410798+0000","last_peered":"2024-04-17T15:41:16.410798+0000","last_clean":"2024-04-17T15:41:16.410798+0000","last_became_active":"2024-04-17T15:36:58.208356+0000","last_became_peered":"2024-04-17T15:36:58.208356+0000","last_unstale":"2024-04-17T15:41:16.410798+0000","last_undegraded":"2024-04-17T15:41:16.410798+0000","last_fullsized":"2024-04-17T15:41:16.410798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.410708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.410708+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.410708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:20:21.792199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"130'32","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.797272+0000","last_change":"2024-04-17T15:41:29.797272+0000","last_active":"2024-04-17T15:41:29.797272+0000","last_peered":"2024-04-17T15:41:29.797272+0000","last_clean":"2024-04-17T15:41:29.797272+0000","last_became_active":"2024-04-17T15:37:00.254210+0000","last_became_peered":"2024-04-17T15:37:00.254210+0000","last_unstale":"2024-04-17T15:41:29.797272+0000","last_undegraded":"2024-04-17T15:41:29.797272+0000","last_fullsized":"2024-04-17T15:41:29.797272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:29.797005+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:29.797005+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.797005+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:19:47.460252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"130'138","reported_seq":457,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.763214+0000","last_change":"2024-04-17T15:41:31.763280+0000","last_active":"2024-04-17T15:41:31.763214+0000","last_peered":"2024-04-17T15:41:31.763214+0000","last_clean":"2024-04-17T15:41:31.763214+0000","last_became_active":"2024-04-17T15:37:02.273392+0000","last_became_peered":"2024-04-17T15:37:02.273392+0000","last_unstale":"2024-04-17T15:41:31.763214+0000","last_undegraded":"2024-04-17T15:41:31.763214+0000","last_fullsized":"2024-04-17T15:41:31.763214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:31.762996+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:31.762996+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.762996+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:11.486658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"98'6","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.555054+0000","last_change":"2024-04-17T15:41:41.555120+0000","last_active":"2024-04-17T15:41:41.555054+0000","last_peered":"2024-04-17T15:41:41.555054+0000","last_clean":"2024-04-17T15:41:41.555054+0000","last_became_active":"2024-04-17T15:37:04.276891+0000","last_became_peered":"2024-04-17T15:37:04.276891+0000","last_unstale":"2024-04-17T15:41:41.555054+0000","last_undegraded":"2024-04-17T15:41:41.555054+0000","last_fullsized":"2024-04-17T15:41:41.555054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-17T15:41:41.554794+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-17T15:41:41.554794+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.554794+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:37:44.221058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"77'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.988205+0000","last_change":"2024-04-17T15:41:21.988205+0000","last_active":"2024-04-17T15:41:21.988205+0000","last_peered":"2024-04-17T15:41:21.988205+0000","last_clean":"2024-04-17T15:41:21.988205+0000","last_became_active":"2024-04-17T15:36:56.198020+0000","last_became_peered":"2024-04-17T15:36:56.198020+0000","last_unstale":"2024-04-17T15:41:21.988205+0000","last_undegraded":"2024-04-17T15:41:21.988205+0000","last_fullsized":"2024-04-17T15:41:21.988205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-17T15:41:21.987932+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-17T15:41:21.987932+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.987932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:37:21.925709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"130'48","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.134502+0000","last_change":"2024-04-17T15:41:40.134572+0000","last_active":"2024-04-17T15:41:40.134502+0000","last_peered":"2024-04-17T15:41:40.134502+0000","last_clean":"2024-04-17T15:41:40.134502+0000","last_became_active":"2024-04-17T15:36:54.180537+0000","last_became_peered":"2024-04-17T15:36:54.180537+0000","last_unstale":"2024-04-17T15:41:40.134502+0000","last_undegraded":"2024-04-17T15:41:40.134502+0000","last_fullsized":"2024-04-17T15:41:40.134502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:40.134281+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:40.134281+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.134281+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:55.081246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"130'4","reported_seq":420,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.974117+0000","last_change":"2024-04-17T15:41:34.974187+0000","last_active":"2024-04-17T15:41:34.974117+0000","last_peered":"2024-04-17T15:41:34.974117+0000","last_clean":"2024-04-17T15:41:34.974117+0000","last_became_active":"2024-04-17T15:36:58.226111+0000","last_became_peered":"2024-04-17T15:36:58.226111+0000","last_unstale":"2024-04-17T15:41:34.974117+0000","last_undegraded":"2024-04-17T15:41:34.974117+0000","last_fullsized":"2024-04-17T15:41:34.974117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'4","last_scrub_stamp":"2024-04-17T15:41:34.973920+0000","last_deep_scrub":"130'4","last_deep_scrub_stamp":"2024-04-17T15:41:34.973920+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.973920+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:37.079372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"130'15","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.716392+0000","last_change":"2024-04-17T15:41:20.716392+0000","last_active":"2024-04-17T15:41:20.716392+0000","last_peered":"2024-04-17T15:41:20.716392+0000","last_clean":"2024-04-17T15:41:20.716392+0000","last_became_active":"2024-04-17T15:37:00.452604+0000","last_became_peered":"2024-04-17T15:37:00.452604+0000","last_unstale":"2024-04-17T15:41:20.716392+0000","last_undegraded":"2024-04-17T15:41:20.716392+0000","last_fullsized":"2024-04-17T15:41:20.716392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'15","last_scrub_stamp":"2024-04-17T15:41:20.715961+0000","last_deep_scrub":"130'15","last_deep_scrub_stamp":"2024-04-17T15:41:20.715961+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.715961+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:49:31.497504+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"130'138","reported_seq":464,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.386431+0000","last_change":"2024-04-17T15:41:34.386500+0000","last_active":"2024-04-17T15:41:34.386431+0000","last_peered":"2024-04-17T15:41:34.386431+0000","last_clean":"2024-04-17T15:41:34.386431+0000","last_became_active":"2024-04-17T15:37:02.268193+0000","last_became_peered":"2024-04-17T15:37:02.268193+0000","last_unstale":"2024-04-17T15:41:34.386431+0000","last_undegraded":"2024-04-17T15:41:34.386431+0000","last_fullsized":"2024-04-17T15:41:34.386431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:34.386200+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:34.386200+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.386200+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:34.946993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"71'4","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.308024+0000","last_change":"2024-04-17T15:41:51.308092+0000","last_active":"2024-04-17T15:41:51.308024+0000","last_peered":"2024-04-17T15:41:51.308024+0000","last_clean":"2024-04-17T15:41:51.308024+0000","last_became_active":"2024-04-17T15:37:04.277796+0000","last_became_peered":"2024-04-17T15:37:04.277796+0000","last_unstale":"2024-04-17T15:41:51.308024+0000","last_undegraded":"2024-04-17T15:41:51.308024+0000","last_fullsized":"2024-04-17T15:41:51.308024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-17T15:41:51.307790+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-17T15:41:51.307790+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.307790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:43.450910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"72'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.539306+0000","last_change":"2024-04-17T15:41:27.539373+0000","last_active":"2024-04-17T15:41:27.539306+0000","last_peered":"2024-04-17T15:41:27.539306+0000","last_clean":"2024-04-17T15:41:27.539306+0000","last_became_active":"2024-04-17T15:36:56.179348+0000","last_became_peered":"2024-04-17T15:36:56.179348+0000","last_unstale":"2024-04-17T15:41:27.539306+0000","last_undegraded":"2024-04-17T15:41:27.539306+0000","last_fullsized":"2024-04-17T15:41:27.539306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:27.539086+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:27.539086+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.539086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:03.547611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"130'58","reported_seq":300,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.697160+0000","last_change":"2024-04-17T15:41:41.697225+0000","last_active":"2024-04-17T15:41:41.697160+0000","last_peered":"2024-04-17T15:41:41.697160+0000","last_clean":"2024-04-17T15:41:41.697160+0000","last_became_active":"2024-04-17T15:36:54.172772+0000","last_became_peered":"2024-04-17T15:36:54.172772+0000","last_unstale":"2024-04-17T15:41:41.697160+0000","last_undegraded":"2024-04-17T15:41:41.697160+0000","last_fullsized":"2024-04-17T15:41:41.697160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'58","last_scrub_stamp":"2024-04-17T15:41:41.696954+0000","last_deep_scrub":"130'58","last_deep_scrub_stamp":"2024-04-17T15:41:41.696954+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.696954+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:13:40.832871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.103273+0000","last_change":"2024-04-17T15:41:36.103328+0000","last_active":"2024-04-17T15:41:36.103273+0000","last_peered":"2024-04-17T15:41:36.103273+0000","last_clean":"2024-04-17T15:41:36.103273+0000","last_became_active":"2024-04-17T15:36:58.222007+0000","last_became_peered":"2024-04-17T15:36:58.222007+0000","last_unstale":"2024-04-17T15:41:36.103273+0000","last_undegraded":"2024-04-17T15:41:36.103273+0000","last_fullsized":"2024-04-17T15:41:36.103273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:36.103079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:36.103079+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.103079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:38.208530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"130'36","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.132609+0000","last_change":"2024-04-17T15:41:47.132685+0000","last_active":"2024-04-17T15:41:47.132609+0000","last_peered":"2024-04-17T15:41:47.132609+0000","last_clean":"2024-04-17T15:41:47.132609+0000","last_became_active":"2024-04-17T15:37:00.248945+0000","last_became_peered":"2024-04-17T15:37:00.248945+0000","last_unstale":"2024-04-17T15:41:47.132609+0000","last_undegraded":"2024-04-17T15:41:47.132609+0000","last_fullsized":"2024-04-17T15:41:47.132609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'36","last_scrub_stamp":"2024-04-17T15:41:47.132426+0000","last_deep_scrub":"130'36","last_deep_scrub_stamp":"2024-04-17T15:41:47.132426+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.132426+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:12.633507+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.409309+0000","last_change":"2024-04-17T15:41:38.409365+0000","last_active":"2024-04-17T15:41:38.409309+0000","last_peered":"2024-04-17T15:41:38.409309+0000","last_clean":"2024-04-17T15:41:38.409309+0000","last_became_active":"2024-04-17T15:37:02.283477+0000","last_became_peered":"2024-04-17T15:37:02.283477+0000","last_unstale":"2024-04-17T15:41:38.409309+0000","last_undegraded":"2024-04-17T15:41:38.409309+0000","last_fullsized":"2024-04-17T15:41:38.409309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:38.409103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:38.409103+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.409103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:04:45.628583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.529560+0000","last_change":"2024-04-17T15:41:42.529620+0000","last_active":"2024-04-17T15:41:42.529560+0000","last_peered":"2024-04-17T15:41:42.529560+0000","last_clean":"2024-04-17T15:41:42.529560+0000","last_became_active":"2024-04-17T15:37:04.281212+0000","last_became_peered":"2024-04-17T15:37:04.281212+0000","last_unstale":"2024-04-17T15:41:42.529560+0000","last_undegraded":"2024-04-17T15:41:42.529560+0000","last_fullsized":"2024-04-17T15:41:42.529560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:42.529352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:42.529352+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.529352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:42.496981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.399852+0000","last_change":"2024-04-17T15:41:19.400009+0000","last_active":"2024-04-17T15:41:19.399852+0000","last_peered":"2024-04-17T15:41:19.399852+0000","last_clean":"2024-04-17T15:41:19.399852+0000","last_became_active":"2024-04-17T15:36:56.211349+0000","last_became_peered":"2024-04-17T15:36:56.211349+0000","last_unstale":"2024-04-17T15:41:19.399852+0000","last_undegraded":"2024-04-17T15:41:19.399852+0000","last_fullsized":"2024-04-17T15:41:19.399852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:19.399591+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:19.399591+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.399591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:24:22.910688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"130'119","reported_seq":398,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.611248+0000","last_change":"2024-04-17T15:41:39.611324+0000","last_active":"2024-04-17T15:41:39.611248+0000","last_peered":"2024-04-17T15:41:39.611248+0000","last_clean":"2024-04-17T15:41:39.611248+0000","last_became_active":"2024-04-17T15:36:48.281335+0000","last_became_peered":"2024-04-17T15:36:48.281335+0000","last_unstale":"2024-04-17T15:41:39.611248+0000","last_undegraded":"2024-04-17T15:41:39.611248+0000","last_fullsized":"2024-04-17T15:41:39.611248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'119","last_scrub_stamp":"2024-04-17T15:41:39.611071+0000","last_deep_scrub":"130'119","last_deep_scrub_stamp":"2024-04-17T15:41:39.611071+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.611071+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:57:36.903900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.066863+0000","last_change":"2024-04-17T15:41:39.066921+0000","last_active":"2024-04-17T15:41:39.066863+0000","last_peered":"2024-04-17T15:41:39.066863+0000","last_clean":"2024-04-17T15:41:39.066863+0000","last_became_active":"2024-04-17T15:36:48.074391+0000","last_became_peered":"2024-04-17T15:36:48.074391+0000","last_unstale":"2024-04-17T15:41:39.066863+0000","last_undegraded":"2024-04-17T15:41:39.066863+0000","last_fullsized":"2024-04-17T15:41:39.066863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:39.066661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:39.066661+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.066661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:14:49.444351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"130'40","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.764442+0000","last_change":"2024-04-17T15:41:43.764505+0000","last_active":"2024-04-17T15:41:43.764442+0000","last_peered":"2024-04-17T15:41:43.764442+0000","last_clean":"2024-04-17T15:41:43.764442+0000","last_became_active":"2024-04-17T15:36:54.176680+0000","last_became_peered":"2024-04-17T15:36:54.176680+0000","last_unstale":"2024-04-17T15:41:43.764442+0000","last_undegraded":"2024-04-17T15:41:43.764442+0000","last_fullsized":"2024-04-17T15:41:43.764442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'40","last_scrub_stamp":"2024-04-17T15:41:43.764249+0000","last_deep_scrub":"130'40","last_deep_scrub_stamp":"2024-04-17T15:41:43.764249+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.764249+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:38:37.215832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.505160+0000","last_change":"2024-04-17T15:41:27.505218+0000","last_active":"2024-04-17T15:41:27.505160+0000","last_peered":"2024-04-17T15:41:27.505160+0000","last_clean":"2024-04-17T15:41:27.505160+0000","last_became_active":"2024-04-17T15:36:58.238563+0000","last_became_peered":"2024-04-17T15:36:58.238563+0000","last_unstale":"2024-04-17T15:41:27.505160+0000","last_undegraded":"2024-04-17T15:41:27.505160+0000","last_fullsized":"2024-04-17T15:41:27.505160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:27.504920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:27.504920+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.504920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:57.500364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"130'48","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.723889+0000","last_change":"2024-04-17T15:41:19.723889+0000","last_active":"2024-04-17T15:41:19.723889+0000","last_peered":"2024-04-17T15:41:19.723889+0000","last_clean":"2024-04-17T15:41:19.723889+0000","last_became_active":"2024-04-17T15:37:00.259561+0000","last_became_peered":"2024-04-17T15:37:00.259561+0000","last_unstale":"2024-04-17T15:41:19.723889+0000","last_undegraded":"2024-04-17T15:41:19.723889+0000","last_fullsized":"2024-04-17T15:41:19.723889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:19.723620+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:19.723620+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.723620+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:39.363853+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.633668+0000","last_change":"2024-04-17T15:41:17.633668+0000","last_active":"2024-04-17T15:41:17.633668+0000","last_peered":"2024-04-17T15:41:17.633668+0000","last_clean":"2024-04-17T15:41:17.633668+0000","last_became_active":"2024-04-17T15:37:02.266160+0000","last_became_peered":"2024-04-17T15:37:02.266160+0000","last_unstale":"2024-04-17T15:41:17.633668+0000","last_undegraded":"2024-04-17T15:41:17.633668+0000","last_fullsized":"2024-04-17T15:41:17.633668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.633428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.633428+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.633428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:26:42.247400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.415737+0000","last_change":"2024-04-17T15:41:40.415797+0000","last_active":"2024-04-17T15:41:40.415737+0000","last_peered":"2024-04-17T15:41:40.415737+0000","last_clean":"2024-04-17T15:41:40.415737+0000","last_became_active":"2024-04-17T15:37:04.282142+0000","last_became_peered":"2024-04-17T15:37:04.282142+0000","last_unstale":"2024-04-17T15:41:40.415737+0000","last_undegraded":"2024-04-17T15:41:40.415737+0000","last_fullsized":"2024-04-17T15:41:40.415737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:40.415542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:40.415542+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.415542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:29:07.263911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"112'16","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.578723+0000","last_change":"2024-04-17T15:41:25.578792+0000","last_active":"2024-04-17T15:41:25.578723+0000","last_peered":"2024-04-17T15:41:25.578723+0000","last_clean":"2024-04-17T15:41:25.578723+0000","last_became_active":"2024-04-17T15:36:56.194808+0000","last_became_peered":"2024-04-17T15:36:56.194808+0000","last_unstale":"2024-04-17T15:41:25.578723+0000","last_undegraded":"2024-04-17T15:41:25.578723+0000","last_fullsized":"2024-04-17T15:41:25.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'16","last_scrub_stamp":"2024-04-17T15:41:25.578500+0000","last_deep_scrub":"112'16","last_deep_scrub_stamp":"2024-04-17T15:41:25.578500+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.578500+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:10.771333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":61,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.630737+0000","last_change":"2024-04-17T15:41:37.630796+0000","last_active":"2024-04-17T15:41:37.630737+0000","last_peered":"2024-04-17T15:41:37.630737+0000","last_clean":"2024-04-17T15:41:37.630737+0000","last_became_active":"2024-04-17T15:36:48.073799+0000","last_became_peered":"2024-04-17T15:36:48.073799+0000","last_unstale":"2024-04-17T15:41:37.630737+0000","last_undegraded":"2024-04-17T15:41:37.630737+0000","last_fullsized":"2024-04-17T15:41:37.630737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.630505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.630505+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.630505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:39.735956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"130'56","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.683184+0000","last_change":"2024-04-17T15:41:37.683257+0000","last_active":"2024-04-17T15:41:37.683184+0000","last_peered":"2024-04-17T15:41:37.683184+0000","last_clean":"2024-04-17T15:41:37.683184+0000","last_became_active":"2024-04-17T15:36:54.199888+0000","last_became_peered":"2024-04-17T15:36:54.199888+0000","last_unstale":"2024-04-17T15:41:37.683184+0000","last_undegraded":"2024-04-17T15:41:37.683184+0000","last_fullsized":"2024-04-17T15:41:37.683184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:37.682962+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:37.682962+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.682962+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:44:03.943830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"130'2","reported_seq":327,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.883480+0000","last_change":"2024-04-17T15:41:30.883549+0000","last_active":"2024-04-17T15:41:30.883480+0000","last_peered":"2024-04-17T15:41:30.883480+0000","last_clean":"2024-04-17T15:41:30.883480+0000","last_became_active":"2024-04-17T15:36:58.218867+0000","last_became_peered":"2024-04-17T15:36:58.218867+0000","last_unstale":"2024-04-17T15:41:30.883480+0000","last_undegraded":"2024-04-17T15:41:30.883480+0000","last_fullsized":"2024-04-17T15:41:30.883480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:30.883291+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:30.883291+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.883291+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:16.076124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"130'156","reported_seq":511,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.485445+0000","last_change":"2024-04-17T15:41:24.485530+0000","last_active":"2024-04-17T15:41:24.485445+0000","last_peered":"2024-04-17T15:41:24.485445+0000","last_clean":"2024-04-17T15:41:24.485445+0000","last_became_active":"2024-04-17T15:37:00.245879+0000","last_became_peered":"2024-04-17T15:37:00.245879+0000","last_unstale":"2024-04-17T15:41:24.485445+0000","last_undegraded":"2024-04-17T15:41:24.485445+0000","last_fullsized":"2024-04-17T15:41:24.485445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'156","last_scrub_stamp":"2024-04-17T15:41:24.485255+0000","last_deep_scrub":"130'156","last_deep_scrub_stamp":"2024-04-17T15:41:24.485255+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.485255+0000","objects_scrubbed":10,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:22.721318+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.520694+0000","last_change":"2024-04-17T15:41:19.520750+0000","last_active":"2024-04-17T15:41:19.520694+0000","last_peered":"2024-04-17T15:41:19.520694+0000","last_clean":"2024-04-17T15:41:19.520694+0000","last_became_active":"2024-04-17T15:37:02.267483+0000","last_became_peered":"2024-04-17T15:37:02.267483+0000","last_unstale":"2024-04-17T15:41:19.520694+0000","last_undegraded":"2024-04-17T15:41:19.520694+0000","last_fullsized":"2024-04-17T15:41:19.520694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:19.520254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:19.520254+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.520254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:02.719737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.504326+0000","last_change":"2024-04-17T15:41:40.504380+0000","last_active":"2024-04-17T15:41:40.504326+0000","last_peered":"2024-04-17T15:41:40.504326+0000","last_clean":"2024-04-17T15:41:40.504326+0000","last_became_active":"2024-04-17T15:37:04.264952+0000","last_became_peered":"2024-04-17T15:37:04.264952+0000","last_unstale":"2024-04-17T15:41:40.504326+0000","last_undegraded":"2024-04-17T15:41:40.504326+0000","last_fullsized":"2024-04-17T15:41:40.504326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:40.504130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:40.504130+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.504130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:42.609581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.371151+0000","last_change":"2024-04-17T15:41:15.371151+0000","last_active":"2024-04-17T15:41:15.371151+0000","last_peered":"2024-04-17T15:41:15.371151+0000","last_clean":"2024-04-17T15:41:15.371151+0000","last_became_active":"2024-04-17T15:36:56.200111+0000","last_became_peered":"2024-04-17T15:36:56.200111+0000","last_unstale":"2024-04-17T15:41:15.371151+0000","last_undegraded":"2024-04-17T15:41:15.371151+0000","last_fullsized":"2024-04-17T15:41:15.371151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.371032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.371032+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.371032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:03.976479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.958911+0000","last_change":"2024-04-17T15:41:20.958967+0000","last_active":"2024-04-17T15:41:20.958911+0000","last_peered":"2024-04-17T15:41:20.958911+0000","last_clean":"2024-04-17T15:41:20.958911+0000","last_became_active":"2024-04-17T15:36:48.327064+0000","last_became_peered":"2024-04-17T15:36:48.327064+0000","last_unstale":"2024-04-17T15:41:20.958911+0000","last_undegraded":"2024-04-17T15:41:20.958911+0000","last_fullsized":"2024-04-17T15:41:20.958911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.958694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.958694+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.958694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:17:27.161135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"130'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.538296+0000","last_change":"2024-04-17T15:41:31.538435+0000","last_active":"2024-04-17T15:41:31.538296+0000","last_peered":"2024-04-17T15:41:31.538296+0000","last_clean":"2024-04-17T15:41:31.538296+0000","last_became_active":"2024-04-17T15:36:54.168978+0000","last_became_peered":"2024-04-17T15:36:54.168978+0000","last_unstale":"2024-04-17T15:41:31.538296+0000","last_undegraded":"2024-04-17T15:41:31.538296+0000","last_fullsized":"2024-04-17T15:41:31.538296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:31.537911+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:31.537911+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.537911+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:19.196623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"130'2","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.973550+0000","last_change":"2024-04-17T15:41:17.973550+0000","last_active":"2024-04-17T15:41:17.973550+0000","last_peered":"2024-04-17T15:41:17.973550+0000","last_clean":"2024-04-17T15:41:17.973550+0000","last_became_active":"2024-04-17T15:36:58.213758+0000","last_became_peered":"2024-04-17T15:36:58.213758+0000","last_unstale":"2024-04-17T15:41:17.973550+0000","last_undegraded":"2024-04-17T15:41:17.973550+0000","last_fullsized":"2024-04-17T15:41:17.973550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:17.973240+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:17.973240+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.973240+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:52:50.450436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'24","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.483241+0000","last_change":"2024-04-17T15:41:20.483333+0000","last_active":"2024-04-17T15:41:20.483241+0000","last_peered":"2024-04-17T15:41:20.483241+0000","last_clean":"2024-04-17T15:41:20.483241+0000","last_became_active":"2024-04-17T15:37:00.456793+0000","last_became_peered":"2024-04-17T15:37:00.456793+0000","last_unstale":"2024-04-17T15:41:20.483241+0000","last_undegraded":"2024-04-17T15:41:20.483241+0000","last_fullsized":"2024-04-17T15:41:20.483241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:20.483050+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:20.483050+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.483050+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:37:49.043173+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.593731+0000","last_change":"2024-04-17T15:41:16.593786+0000","last_active":"2024-04-17T15:41:16.593731+0000","last_peered":"2024-04-17T15:41:16.593731+0000","last_clean":"2024-04-17T15:41:16.593731+0000","last_became_active":"2024-04-17T15:37:02.279765+0000","last_became_peered":"2024-04-17T15:37:02.279765+0000","last_unstale":"2024-04-17T15:41:16.593731+0000","last_undegraded":"2024-04-17T15:41:16.593731+0000","last_fullsized":"2024-04-17T15:41:16.593731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.593549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.593549+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.593549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:32:36.369768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:53.750568+0000","last_change":"2024-04-17T15:41:53.750727+0000","last_active":"2024-04-17T15:41:53.750568+0000","last_peered":"2024-04-17T15:41:53.750568+0000","last_clean":"2024-04-17T15:41:53.750568+0000","last_became_active":"2024-04-17T15:37:04.296638+0000","last_became_peered":"2024-04-17T15:37:04.296638+0000","last_unstale":"2024-04-17T15:41:53.750568+0000","last_undegraded":"2024-04-17T15:41:53.750568+0000","last_fullsized":"2024-04-17T15:41:53.750568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:53.750333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:53.750333+0000","last_clean_scrub_stamp":"2024-04-17T15:41:53.750333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:57.968456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"77'6","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.474447+0000","last_change":"2024-04-17T15:41:23.474580+0000","last_active":"2024-04-17T15:41:23.474447+0000","last_peered":"2024-04-17T15:41:23.474447+0000","last_clean":"2024-04-17T15:41:23.474447+0000","last_became_active":"2024-04-17T15:36:56.185636+0000","last_became_peered":"2024-04-17T15:36:56.185636+0000","last_unstale":"2024-04-17T15:41:23.474447+0000","last_undegraded":"2024-04-17T15:41:23.474447+0000","last_fullsized":"2024-04-17T15:41:23.474447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-17T15:41:23.474143+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.474143+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.474143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:37:52.034266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.097439+0000","last_change":"2024-04-17T15:41:40.097493+0000","last_active":"2024-04-17T15:41:40.097439+0000","last_peered":"2024-04-17T15:41:40.097439+0000","last_clean":"2024-04-17T15:41:40.097439+0000","last_became_active":"2024-04-17T15:36:48.074219+0000","last_became_peered":"2024-04-17T15:36:48.074219+0000","last_unstale":"2024-04-17T15:41:40.097439+0000","last_undegraded":"2024-04-17T15:41:40.097439+0000","last_fullsized":"2024-04-17T15:41:40.097439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:40.097243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:40.097243+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.097243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:03.775101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"130'48","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.111520+0000","last_change":"2024-04-17T15:41:39.111584+0000","last_active":"2024-04-17T15:41:39.111520+0000","last_peered":"2024-04-17T15:41:39.111520+0000","last_clean":"2024-04-17T15:41:39.111520+0000","last_became_active":"2024-04-17T15:36:54.179109+0000","last_became_peered":"2024-04-17T15:36:54.179109+0000","last_unstale":"2024-04-17T15:41:39.111520+0000","last_undegraded":"2024-04-17T15:41:39.111520+0000","last_fullsized":"2024-04-17T15:41:39.111520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:39.111299+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:39.111299+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.111299+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:22:06.399573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.587358+0000","last_change":"2024-04-17T15:41:28.587481+0000","last_active":"2024-04-17T15:41:28.587358+0000","last_peered":"2024-04-17T15:41:28.587358+0000","last_clean":"2024-04-17T15:41:28.587358+0000","last_became_active":"2024-04-17T15:36:58.220909+0000","last_became_peered":"2024-04-17T15:36:58.220909+0000","last_unstale":"2024-04-17T15:41:28.587358+0000","last_undegraded":"2024-04-17T15:41:28.587358+0000","last_fullsized":"2024-04-17T15:41:28.587358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.587010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.587010+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.587010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:30.754705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"130'19","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.663734+0000","last_change":"2024-04-17T15:41:39.663907+0000","last_active":"2024-04-17T15:41:39.663734+0000","last_peered":"2024-04-17T15:41:39.663734+0000","last_clean":"2024-04-17T15:41:39.663734+0000","last_became_active":"2024-04-17T15:37:00.256632+0000","last_became_peered":"2024-04-17T15:37:00.256632+0000","last_unstale":"2024-04-17T15:41:39.663734+0000","last_undegraded":"2024-04-17T15:41:39.663734+0000","last_fullsized":"2024-04-17T15:41:39.663734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'19","last_scrub_stamp":"2024-04-17T15:41:39.663473+0000","last_deep_scrub":"130'19","last_deep_scrub_stamp":"2024-04-17T15:41:39.663473+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.663473+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:37:19.638455+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.417231+0000","last_change":"2024-04-17T15:41:37.417287+0000","last_active":"2024-04-17T15:41:37.417231+0000","last_peered":"2024-04-17T15:41:37.417231+0000","last_clean":"2024-04-17T15:41:37.417231+0000","last_became_active":"2024-04-17T15:37:02.269903+0000","last_became_peered":"2024-04-17T15:37:02.269903+0000","last_unstale":"2024-04-17T15:41:37.417231+0000","last_undegraded":"2024-04-17T15:41:37.417231+0000","last_fullsized":"2024-04-17T15:41:37.417231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.416998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.416998+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.416998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:38:57.992894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:53.161192+0000","last_change":"2024-04-17T15:41:53.161310+0000","last_active":"2024-04-17T15:41:53.161192+0000","last_peered":"2024-04-17T15:41:53.161192+0000","last_clean":"2024-04-17T15:41:53.161192+0000","last_became_active":"2024-04-17T15:37:04.303174+0000","last_became_peered":"2024-04-17T15:37:04.303174+0000","last_unstale":"2024-04-17T15:41:53.161192+0000","last_undegraded":"2024-04-17T15:41:53.161192+0000","last_fullsized":"2024-04-17T15:41:53.161192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:53.160953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:53.160953+0000","last_clean_scrub_stamp":"2024-04-17T15:41:53.160953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:44.445063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'8","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.435512+0000","last_change":"2024-04-17T15:41:19.435573+0000","last_active":"2024-04-17T15:41:19.435512+0000","last_peered":"2024-04-17T15:41:19.435512+0000","last_clean":"2024-04-17T15:41:19.435512+0000","last_became_active":"2024-04-17T15:36:56.194418+0000","last_became_peered":"2024-04-17T15:36:56.194418+0000","last_unstale":"2024-04-17T15:41:19.435512+0000","last_undegraded":"2024-04-17T15:41:19.435512+0000","last_fullsized":"2024-04-17T15:41:19.435512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-17T15:41:19.435287+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-17T15:41:19.435287+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.435287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:03.479658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.975846+0000","last_change":"2024-04-17T15:41:35.975908+0000","last_active":"2024-04-17T15:41:35.975846+0000","last_peered":"2024-04-17T15:41:35.975846+0000","last_clean":"2024-04-17T15:41:35.975846+0000","last_became_active":"2024-04-17T15:36:54.180268+0000","last_became_peered":"2024-04-17T15:36:54.180268+0000","last_unstale":"2024-04-17T15:41:35.975846+0000","last_undegraded":"2024-04-17T15:41:35.975846+0000","last_fullsized":"2024-04-17T15:41:35.975846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:35.975645+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:35.975645+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.975645+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:57:32.977017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.560233+0000","last_change":"2024-04-17T15:41:29.560287+0000","last_active":"2024-04-17T15:41:29.560233+0000","last_peered":"2024-04-17T15:41:29.560233+0000","last_clean":"2024-04-17T15:41:29.560233+0000","last_became_active":"2024-04-17T15:36:48.279988+0000","last_became_peered":"2024-04-17T15:36:48.279988+0000","last_unstale":"2024-04-17T15:41:29.560233+0000","last_undegraded":"2024-04-17T15:41:29.560233+0000","last_fullsized":"2024-04-17T15:41:29.560233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:29.560033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:29.560033+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.560033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:32.526290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.651601+0000","last_change":"2024-04-17T15:41:30.651711+0000","last_active":"2024-04-17T15:41:30.651601+0000","last_peered":"2024-04-17T15:41:30.651601+0000","last_clean":"2024-04-17T15:41:30.651601+0000","last_became_active":"2024-04-17T15:36:58.224346+0000","last_became_peered":"2024-04-17T15:36:58.224346+0000","last_unstale":"2024-04-17T15:41:30.651601+0000","last_undegraded":"2024-04-17T15:41:30.651601+0000","last_fullsized":"2024-04-17T15:41:30.651601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:30.651296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:30.651296+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.651296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:57:27.652669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"130'46","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.613727+0000","last_change":"2024-04-17T15:41:21.613816+0000","last_active":"2024-04-17T15:41:21.613727+0000","last_peered":"2024-04-17T15:41:21.613727+0000","last_clean":"2024-04-17T15:41:21.613727+0000","last_became_active":"2024-04-17T15:37:00.261611+0000","last_became_peered":"2024-04-17T15:37:00.261611+0000","last_unstale":"2024-04-17T15:41:21.613727+0000","last_undegraded":"2024-04-17T15:41:21.613727+0000","last_fullsized":"2024-04-17T15:41:21.613727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:21.613527+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:21.613527+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.613527+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:53.316589+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.235919+0000","last_change":"2024-04-17T15:41:49.235973+0000","last_active":"2024-04-17T15:41:49.235919+0000","last_peered":"2024-04-17T15:41:49.235919+0000","last_clean":"2024-04-17T15:41:49.235919+0000","last_became_active":"2024-04-17T15:37:02.279846+0000","last_became_peered":"2024-04-17T15:37:02.279846+0000","last_unstale":"2024-04-17T15:41:49.235919+0000","last_undegraded":"2024-04-17T15:41:49.235919+0000","last_fullsized":"2024-04-17T15:41:49.235919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:49.235725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:49.235725+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.235725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:35.351354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":223,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.672141+0000","last_change":"2024-04-17T15:41:50.672194+0000","last_active":"2024-04-17T15:41:50.672141+0000","last_peered":"2024-04-17T15:41:50.672141+0000","last_clean":"2024-04-17T15:41:50.672141+0000","last_became_active":"2024-04-17T15:37:04.282004+0000","last_became_peered":"2024-04-17T15:37:04.282004+0000","last_unstale":"2024-04-17T15:41:50.672141+0000","last_undegraded":"2024-04-17T15:41:50.672141+0000","last_fullsized":"2024-04-17T15:41:50.672141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:50.671939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:50.671939+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.671939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:10:51.459569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"72'2","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.565847+0000","last_change":"2024-04-17T15:41:24.565913+0000","last_active":"2024-04-17T15:41:24.565847+0000","last_peered":"2024-04-17T15:41:24.565847+0000","last_clean":"2024-04-17T15:41:24.565847+0000","last_became_active":"2024-04-17T15:36:56.205134+0000","last_became_peered":"2024-04-17T15:36:56.205134+0000","last_unstale":"2024-04-17T15:41:24.565847+0000","last_undegraded":"2024-04-17T15:41:24.565847+0000","last_fullsized":"2024-04-17T15:41:24.565847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:24.565634+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:24.565634+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.565634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:37.328106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"130'42","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.476800+0000","last_change":"2024-04-17T15:41:33.476859+0000","last_active":"2024-04-17T15:41:33.476800+0000","last_peered":"2024-04-17T15:41:33.476800+0000","last_clean":"2024-04-17T15:41:33.476800+0000","last_became_active":"2024-04-17T15:36:54.170528+0000","last_became_peered":"2024-04-17T15:36:54.170528+0000","last_unstale":"2024-04-17T15:41:33.476800+0000","last_undegraded":"2024-04-17T15:41:33.476800+0000","last_fullsized":"2024-04-17T15:41:33.476800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:33.476604+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:33.476604+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.476604+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:10.889055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.623136+0000","last_change":"2024-04-17T15:41:38.623190+0000","last_active":"2024-04-17T15:41:38.623136+0000","last_peered":"2024-04-17T15:41:38.623136+0000","last_clean":"2024-04-17T15:41:38.623136+0000","last_became_active":"2024-04-17T15:36:48.281264+0000","last_became_peered":"2024-04-17T15:36:48.281264+0000","last_unstale":"2024-04-17T15:41:38.623136+0000","last_undegraded":"2024-04-17T15:41:38.623136+0000","last_fullsized":"2024-04-17T15:41:38.623136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:38.622912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:38.622912+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.622912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:57:35.624284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.354296+0000","last_change":"2024-04-17T15:41:22.354371+0000","last_active":"2024-04-17T15:41:22.354296+0000","last_peered":"2024-04-17T15:41:22.354296+0000","last_clean":"2024-04-17T15:41:22.354296+0000","last_became_active":"2024-04-17T15:36:58.228758+0000","last_became_peered":"2024-04-17T15:36:58.228758+0000","last_unstale":"2024-04-17T15:41:22.354296+0000","last_undegraded":"2024-04-17T15:41:22.354296+0000","last_fullsized":"2024-04-17T15:41:22.354296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:22.354099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:22.354099+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.354099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:10:05.544157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"130'22","reported_seq":260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.524562+0000","last_change":"2024-04-17T15:41:36.524643+0000","last_active":"2024-04-17T15:41:36.524562+0000","last_peered":"2024-04-17T15:41:36.524562+0000","last_clean":"2024-04-17T15:41:36.524562+0000","last_became_active":"2024-04-17T15:37:00.454778+0000","last_became_peered":"2024-04-17T15:37:00.454778+0000","last_unstale":"2024-04-17T15:41:36.524562+0000","last_undegraded":"2024-04-17T15:41:36.524562+0000","last_fullsized":"2024-04-17T15:41:36.524562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'22","last_scrub_stamp":"2024-04-17T15:41:36.524367+0000","last_deep_scrub":"130'22","last_deep_scrub_stamp":"2024-04-17T15:41:36.524367+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.524367+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:21.717200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"130'138","reported_seq":413,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.654818+0000","last_change":"2024-04-17T15:41:17.654886+0000","last_active":"2024-04-17T15:41:17.654818+0000","last_peered":"2024-04-17T15:41:17.654818+0000","last_clean":"2024-04-17T15:41:17.654818+0000","last_became_active":"2024-04-17T15:37:02.263878+0000","last_became_peered":"2024-04-17T15:37:02.263878+0000","last_unstale":"2024-04-17T15:41:17.654818+0000","last_undegraded":"2024-04-17T15:41:17.654818+0000","last_fullsized":"2024-04-17T15:41:17.654818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:17.654603+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:17.654603+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.654603+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:33:49.183549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:56.763093+0000","last_change":"2024-04-17T15:41:56.763148+0000","last_active":"2024-04-17T15:41:56.763093+0000","last_peered":"2024-04-17T15:41:56.763093+0000","last_clean":"2024-04-17T15:41:56.763093+0000","last_became_active":"2024-04-17T15:37:04.302006+0000","last_became_peered":"2024-04-17T15:37:04.302006+0000","last_unstale":"2024-04-17T15:41:56.763093+0000","last_undegraded":"2024-04-17T15:41:56.763093+0000","last_fullsized":"2024-04-17T15:41:56.763093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:56.762865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:56.762865+0000","last_clean_scrub_stamp":"2024-04-17T15:41:56.762865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:15:24.737306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"98'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.657495+0000","last_change":"2024-04-17T15:41:30.657565+0000","last_active":"2024-04-17T15:41:30.657495+0000","last_peered":"2024-04-17T15:41:30.657495+0000","last_clean":"2024-04-17T15:41:30.657495+0000","last_became_active":"2024-04-17T15:36:56.188815+0000","last_became_peered":"2024-04-17T15:36:56.188815+0000","last_unstale":"2024-04-17T15:41:30.657495+0000","last_undegraded":"2024-04-17T15:41:30.657495+0000","last_fullsized":"2024-04-17T15:41:30.657495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-17T15:41:30.656952+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-17T15:41:30.656952+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.656952+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:13:38.069792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"130'38","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.605523+0000","last_change":"2024-04-17T15:41:38.605586+0000","last_active":"2024-04-17T15:41:38.605523+0000","last_peered":"2024-04-17T15:41:38.605523+0000","last_clean":"2024-04-17T15:41:38.605523+0000","last_became_active":"2024-04-17T15:36:54.203112+0000","last_became_peered":"2024-04-17T15:36:54.203112+0000","last_unstale":"2024-04-17T15:41:38.605523+0000","last_undegraded":"2024-04-17T15:41:38.605523+0000","last_fullsized":"2024-04-17T15:41:38.605523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'38","last_scrub_stamp":"2024-04-17T15:41:38.605318+0000","last_deep_scrub":"130'38","last_deep_scrub_stamp":"2024-04-17T15:41:38.605318+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.605318+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:02:30.984640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.552965+0000","last_change":"2024-04-17T15:41:28.553023+0000","last_active":"2024-04-17T15:41:28.552965+0000","last_peered":"2024-04-17T15:41:28.552965+0000","last_clean":"2024-04-17T15:41:28.552965+0000","last_became_active":"2024-04-17T15:36:48.073642+0000","last_became_peered":"2024-04-17T15:36:48.073642+0000","last_unstale":"2024-04-17T15:41:28.552965+0000","last_undegraded":"2024-04-17T15:41:28.552965+0000","last_fullsized":"2024-04-17T15:41:28.552965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.552768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.552768+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.552768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:29.113561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.011972+0000","last_change":"2024-04-17T15:41:34.012036+0000","last_active":"2024-04-17T15:41:34.011972+0000","last_peered":"2024-04-17T15:41:34.011972+0000","last_clean":"2024-04-17T15:41:34.011972+0000","last_became_active":"2024-04-17T15:36:58.221944+0000","last_became_peered":"2024-04-17T15:36:58.221944+0000","last_unstale":"2024-04-17T15:41:34.011972+0000","last_undegraded":"2024-04-17T15:41:34.011972+0000","last_fullsized":"2024-04-17T15:41:34.011972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:34.011770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:34.011770+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.011770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:20:09.076736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"130'15","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.898748+0000","last_change":"2024-04-17T15:41:18.898829+0000","last_active":"2024-04-17T15:41:18.898748+0000","last_peered":"2024-04-17T15:41:18.898748+0000","last_clean":"2024-04-17T15:41:18.898748+0000","last_became_active":"2024-04-17T15:37:00.248600+0000","last_became_peered":"2024-04-17T15:37:00.248600+0000","last_unstale":"2024-04-17T15:41:18.898748+0000","last_undegraded":"2024-04-17T15:41:18.898748+0000","last_fullsized":"2024-04-17T15:41:18.898748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'15","last_scrub_stamp":"2024-04-17T15:41:18.898561+0000","last_deep_scrub":"130'15","last_deep_scrub_stamp":"2024-04-17T15:41:18.898561+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.898561+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:40:59.083402+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"130'139","reported_seq":414,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.705530+0000","last_change":"2024-04-17T15:41:50.705597+0000","last_active":"2024-04-17T15:41:50.705530+0000","last_peered":"2024-04-17T15:41:50.705530+0000","last_clean":"2024-04-17T15:41:50.705530+0000","last_became_active":"2024-04-17T15:37:02.281889+0000","last_became_peered":"2024-04-17T15:37:02.281889+0000","last_unstale":"2024-04-17T15:41:50.705530+0000","last_undegraded":"2024-04-17T15:41:50.705530+0000","last_fullsized":"2024-04-17T15:41:50.705530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'139","last_scrub_stamp":"2024-04-17T15:41:50.705336+0000","last_deep_scrub":"130'139","last_deep_scrub_stamp":"2024-04-17T15:41:50.705336+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.705336+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:00:23.614143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'7","reported_seq":233,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:53.582897+0000","last_change":"2024-04-17T15:41:53.583000+0000","last_active":"2024-04-17T15:41:53.582897+0000","last_peered":"2024-04-17T15:41:53.582897+0000","last_clean":"2024-04-17T15:41:53.582897+0000","last_became_active":"2024-04-17T15:37:04.290085+0000","last_became_peered":"2024-04-17T15:37:04.290085+0000","last_unstale":"2024-04-17T15:41:53.582897+0000","last_undegraded":"2024-04-17T15:41:53.582897+0000","last_fullsized":"2024-04-17T15:41:53.582897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'7","last_scrub_stamp":"2024-04-17T15:41:53.582657+0000","last_deep_scrub":"73'7","last_deep_scrub_stamp":"2024-04-17T15:41:53.582657+0000","last_clean_scrub_stamp":"2024-04-17T15:41:53.582657+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:12:40.918106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.986901+0000","last_change":"2024-04-17T15:41:27.986964+0000","last_active":"2024-04-17T15:41:27.986901+0000","last_peered":"2024-04-17T15:41:27.986901+0000","last_clean":"2024-04-17T15:41:27.986901+0000","last_became_active":"2024-04-17T15:36:56.206333+0000","last_became_peered":"2024-04-17T15:36:56.206333+0000","last_unstale":"2024-04-17T15:41:27.986901+0000","last_undegraded":"2024-04-17T15:41:27.986901+0000","last_fullsized":"2024-04-17T15:41:27.986901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:27.986679+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:27.986679+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.986679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:38:59.689742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"130'56","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:40.615229+0000","last_change":"2024-04-17T15:41:40.615320+0000","last_active":"2024-04-17T15:41:40.615229+0000","last_peered":"2024-04-17T15:41:40.615229+0000","last_clean":"2024-04-17T15:41:40.615229+0000","last_became_active":"2024-04-17T15:36:54.176425+0000","last_became_peered":"2024-04-17T15:36:54.176425+0000","last_unstale":"2024-04-17T15:41:40.615229+0000","last_undegraded":"2024-04-17T15:41:40.615229+0000","last_fullsized":"2024-04-17T15:41:40.615229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:40.614968+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:40.614968+0000","last_clean_scrub_stamp":"2024-04-17T15:41:40.614968+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:06.116049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":248,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.373410+0000","last_change":"2024-04-17T15:41:26.373472+0000","last_active":"2024-04-17T15:41:26.373410+0000","last_peered":"2024-04-17T15:41:26.373410+0000","last_clean":"2024-04-17T15:41:26.373410+0000","last_became_active":"2024-04-17T15:36:48.076965+0000","last_became_peered":"2024-04-17T15:36:48.076965+0000","last_unstale":"2024-04-17T15:41:26.373410+0000","last_undegraded":"2024-04-17T15:41:26.373410+0000","last_fullsized":"2024-04-17T15:41:26.373410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:26.373211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:26.373211+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.373211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:50:56.566202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.575551+0000","last_change":"2024-04-17T15:41:33.575608+0000","last_active":"2024-04-17T15:41:33.575551+0000","last_peered":"2024-04-17T15:41:33.575551+0000","last_clean":"2024-04-17T15:41:33.575551+0000","last_became_active":"2024-04-17T15:36:58.218735+0000","last_became_peered":"2024-04-17T15:36:58.218735+0000","last_unstale":"2024-04-17T15:41:33.575551+0000","last_undegraded":"2024-04-17T15:41:33.575551+0000","last_fullsized":"2024-04-17T15:41:33.575551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:33.575347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:33.575347+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.575347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:54.599783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"130'65","reported_seq":322,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.606453+0000","last_change":"2024-04-17T15:41:45.606676+0000","last_active":"2024-04-17T15:41:45.606453+0000","last_peered":"2024-04-17T15:41:45.606453+0000","last_clean":"2024-04-17T15:41:45.606453+0000","last_became_active":"2024-04-17T15:37:00.454924+0000","last_became_peered":"2024-04-17T15:37:00.454924+0000","last_unstale":"2024-04-17T15:41:45.606453+0000","last_undegraded":"2024-04-17T15:41:45.606453+0000","last_fullsized":"2024-04-17T15:41:45.606453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'65","last_scrub_stamp":"2024-04-17T15:41:45.606155+0000","last_deep_scrub":"130'65","last_deep_scrub_stamp":"2024-04-17T15:41:45.606155+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.606155+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:44:36.685095+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":69,"num_read_kb":410,"num_write":38,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.616056+0000","last_change":"2024-04-17T15:41:17.616109+0000","last_active":"2024-04-17T15:41:17.616056+0000","last_peered":"2024-04-17T15:41:17.616056+0000","last_clean":"2024-04-17T15:41:17.616056+0000","last_became_active":"2024-04-17T15:37:02.277876+0000","last_became_peered":"2024-04-17T15:37:02.277876+0000","last_unstale":"2024-04-17T15:41:17.616056+0000","last_undegraded":"2024-04-17T15:41:17.616056+0000","last_fullsized":"2024-04-17T15:41:17.616056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.615825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.615825+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.615825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:40.729641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'7","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.169787+0000","last_change":"2024-04-17T15:41:48.169850+0000","last_active":"2024-04-17T15:41:48.169787+0000","last_peered":"2024-04-17T15:41:48.169787+0000","last_clean":"2024-04-17T15:41:48.169787+0000","last_became_active":"2024-04-17T15:37:04.287752+0000","last_became_peered":"2024-04-17T15:37:04.287752+0000","last_unstale":"2024-04-17T15:41:48.169787+0000","last_undegraded":"2024-04-17T15:41:48.169787+0000","last_fullsized":"2024-04-17T15:41:48.169787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'7","last_scrub_stamp":"2024-04-17T15:41:48.169585+0000","last_deep_scrub":"72'7","last_deep_scrub_stamp":"2024-04-17T15:41:48.169585+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.169585+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:47:43.416986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"112'8","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.670189+0000","last_change":"2024-04-17T15:41:49.670249+0000","last_active":"2024-04-17T15:41:49.670189+0000","last_peered":"2024-04-17T15:41:49.670189+0000","last_clean":"2024-04-17T15:41:49.670189+0000","last_became_active":"2024-04-17T15:37:04.279726+0000","last_became_peered":"2024-04-17T15:37:04.279726+0000","last_unstale":"2024-04-17T15:41:49.670189+0000","last_undegraded":"2024-04-17T15:41:49.670189+0000","last_fullsized":"2024-04-17T15:41:49.670189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'8","last_scrub_stamp":"2024-04-17T15:41:49.669975+0000","last_deep_scrub":"112'8","last_deep_scrub_stamp":"2024-04-17T15:41:49.669975+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.669975+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:51:14.590761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"72'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.956906+0000","last_change":"2024-04-17T15:41:24.956906+0000","last_active":"2024-04-17T15:41:24.956906+0000","last_peered":"2024-04-17T15:41:24.956906+0000","last_clean":"2024-04-17T15:41:24.956906+0000","last_became_active":"2024-04-17T15:36:56.198031+0000","last_became_peered":"2024-04-17T15:36:56.198031+0000","last_unstale":"2024-04-17T15:41:24.956906+0000","last_undegraded":"2024-04-17T15:41:24.956906+0000","last_fullsized":"2024-04-17T15:41:24.956906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:24.956622+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:24.956622+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.956622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:12.092172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"130'54","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.223833+0000","last_change":"2024-04-17T15:41:42.223894+0000","last_active":"2024-04-17T15:41:42.223833+0000","last_peered":"2024-04-17T15:41:42.223833+0000","last_clean":"2024-04-17T15:41:42.223833+0000","last_became_active":"2024-04-17T15:36:54.201306+0000","last_became_peered":"2024-04-17T15:36:54.201306+0000","last_unstale":"2024-04-17T15:41:42.223833+0000","last_undegraded":"2024-04-17T15:41:42.223833+0000","last_fullsized":"2024-04-17T15:41:42.223833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'54","last_scrub_stamp":"2024-04-17T15:41:42.223645+0000","last_deep_scrub":"130'54","last_deep_scrub_stamp":"2024-04-17T15:41:42.223645+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.223645+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:37.233245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.413463+0000","last_change":"2024-04-17T15:41:18.413463+0000","last_active":"2024-04-17T15:41:18.413463+0000","last_peered":"2024-04-17T15:41:18.413463+0000","last_clean":"2024-04-17T15:41:18.413463+0000","last_became_active":"2024-04-17T15:36:58.218099+0000","last_became_peered":"2024-04-17T15:36:58.218099+0000","last_unstale":"2024-04-17T15:41:18.413463+0000","last_undegraded":"2024-04-17T15:41:18.413463+0000","last_fullsized":"2024-04-17T15:41:18.413463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.413210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.413210+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.413210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:44:25.659696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"130'26","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.692690+0000","last_change":"2024-04-17T15:41:22.692690+0000","last_active":"2024-04-17T15:41:22.692690+0000","last_peered":"2024-04-17T15:41:22.692690+0000","last_clean":"2024-04-17T15:41:22.692690+0000","last_became_active":"2024-04-17T15:37:00.262126+0000","last_became_peered":"2024-04-17T15:37:00.262126+0000","last_unstale":"2024-04-17T15:41:22.692690+0000","last_undegraded":"2024-04-17T15:41:22.692690+0000","last_fullsized":"2024-04-17T15:41:22.692690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:22.692221+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:22.692221+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.692221+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:31:39.418145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.588234+0000","last_change":"2024-04-17T15:41:16.588234+0000","last_active":"2024-04-17T15:41:16.588234+0000","last_peered":"2024-04-17T15:41:16.588234+0000","last_clean":"2024-04-17T15:41:16.588234+0000","last_became_active":"2024-04-17T15:37:02.278274+0000","last_became_peered":"2024-04-17T15:37:02.278274+0000","last_unstale":"2024-04-17T15:41:16.588234+0000","last_undegraded":"2024-04-17T15:41:16.588234+0000","last_fullsized":"2024-04-17T15:41:16.588234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:16.587982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:16.587982+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.587982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:05:58.647298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"72'4","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:55.733957+0000","last_change":"2024-04-17T15:41:55.734018+0000","last_active":"2024-04-17T15:41:55.733957+0000","last_peered":"2024-04-17T15:41:55.733957+0000","last_clean":"2024-04-17T15:41:55.733957+0000","last_became_active":"2024-04-17T15:37:04.297413+0000","last_became_peered":"2024-04-17T15:37:04.297413+0000","last_unstale":"2024-04-17T15:41:55.733957+0000","last_undegraded":"2024-04-17T15:41:55.733957+0000","last_fullsized":"2024-04-17T15:41:55.733957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:55.733757+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:55.733757+0000","last_clean_scrub_stamp":"2024-04-17T15:41:55.733757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:52:27.045959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"98'4","reported_seq":204,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:54.162127+0000","last_change":"2024-04-17T15:41:54.162186+0000","last_active":"2024-04-17T15:41:54.162127+0000","last_peered":"2024-04-17T15:41:54.162127+0000","last_clean":"2024-04-17T15:41:54.162127+0000","last_became_active":"2024-04-17T15:37:41.433399+0000","last_became_peered":"2024-04-17T15:37:41.433399+0000","last_unstale":"2024-04-17T15:41:54.162127+0000","last_undegraded":"2024-04-17T15:41:54.162127+0000","last_fullsized":"2024-04-17T15:41:54.162127+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-17T15:41:54.161926+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-17T15:41:54.161926+0000","last_clean_scrub_stamp":"2024-04-17T15:41:54.161926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:54:09.123894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"130'48","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.583034+0000","last_change":"2024-04-17T15:41:43.583034+0000","last_active":"2024-04-17T15:41:43.583034+0000","last_peered":"2024-04-17T15:41:43.583034+0000","last_clean":"2024-04-17T15:41:43.583034+0000","last_became_active":"2024-04-17T15:36:54.205608+0000","last_became_peered":"2024-04-17T15:36:54.205608+0000","last_unstale":"2024-04-17T15:41:43.583034+0000","last_undegraded":"2024-04-17T15:41:43.583034+0000","last_fullsized":"2024-04-17T15:41:43.583034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:43.582628+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:43.582628+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.582628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:22:30.232655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"130'2","reported_seq":327,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.594234+0000","last_change":"2024-04-17T15:41:35.594234+0000","last_active":"2024-04-17T15:41:35.594234+0000","last_peered":"2024-04-17T15:41:35.594234+0000","last_clean":"2024-04-17T15:41:35.594234+0000","last_became_active":"2024-04-17T15:36:58.225742+0000","last_became_peered":"2024-04-17T15:36:58.225742+0000","last_unstale":"2024-04-17T15:41:35.594234+0000","last_undegraded":"2024-04-17T15:41:35.594234+0000","last_fullsized":"2024-04-17T15:41:35.594234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:35.593954+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:35.593954+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.593954+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:46:24.960351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"130'12","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.651793+0000","last_change":"2024-04-17T15:41:36.651793+0000","last_active":"2024-04-17T15:41:36.651793+0000","last_peered":"2024-04-17T15:41:36.651793+0000","last_clean":"2024-04-17T15:41:36.651793+0000","last_became_active":"2024-04-17T15:37:00.260495+0000","last_became_peered":"2024-04-17T15:37:00.260495+0000","last_unstale":"2024-04-17T15:41:36.651793+0000","last_undegraded":"2024-04-17T15:41:36.651793+0000","last_fullsized":"2024-04-17T15:41:36.651793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'12","last_scrub_stamp":"2024-04-17T15:41:36.651500+0000","last_deep_scrub":"130'12","last_deep_scrub_stamp":"2024-04-17T15:41:36.651500+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.651500+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:44:27.730441+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.636329+0000","last_change":"2024-04-17T15:41:47.636384+0000","last_active":"2024-04-17T15:41:47.636329+0000","last_peered":"2024-04-17T15:41:47.636329+0000","last_clean":"2024-04-17T15:41:47.636329+0000","last_became_active":"2024-04-17T15:37:02.271177+0000","last_became_peered":"2024-04-17T15:37:02.271177+0000","last_unstale":"2024-04-17T15:41:47.636329+0000","last_undegraded":"2024-04-17T15:41:47.636329+0000","last_fullsized":"2024-04-17T15:41:47.636329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:47.636128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:47.636128+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.636128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:10:58.188394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.640076+0000","last_change":"2024-04-17T15:41:48.640076+0000","last_active":"2024-04-17T15:41:48.640076+0000","last_peered":"2024-04-17T15:41:48.640076+0000","last_clean":"2024-04-17T15:41:48.640076+0000","last_became_active":"2024-04-17T15:37:04.273903+0000","last_became_peered":"2024-04-17T15:37:04.273903+0000","last_unstale":"2024-04-17T15:41:48.640076+0000","last_undegraded":"2024-04-17T15:41:48.640076+0000","last_fullsized":"2024-04-17T15:41:48.640076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:48.639752+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:48.639752+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.639752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:22.481597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"73'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.612791+0000","last_change":"2024-04-17T15:41:29.612791+0000","last_active":"2024-04-17T15:41:29.612791+0000","last_peered":"2024-04-17T15:41:29.612791+0000","last_clean":"2024-04-17T15:41:29.612791+0000","last_became_active":"2024-04-17T15:36:56.198727+0000","last_became_peered":"2024-04-17T15:36:56.198727+0000","last_unstale":"2024-04-17T15:41:29.612791+0000","last_undegraded":"2024-04-17T15:41:29.612791+0000","last_fullsized":"2024-04-17T15:41:29.612791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:29.612509+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:29.612509+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.612509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:48:26.850872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"130'62","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.838432+0000","last_change":"2024-04-17T15:41:34.838496+0000","last_active":"2024-04-17T15:41:34.838432+0000","last_peered":"2024-04-17T15:41:34.838432+0000","last_clean":"2024-04-17T15:41:34.838432+0000","last_became_active":"2024-04-17T15:37:41.353812+0000","last_became_peered":"2024-04-17T15:37:41.353812+0000","last_unstale":"2024-04-17T15:41:34.838432+0000","last_undegraded":"2024-04-17T15:41:34.838432+0000","last_fullsized":"2024-04-17T15:41:34.838432+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'62","last_scrub_stamp":"2024-04-17T15:41:34.838245+0000","last_deep_scrub":"130'62","last_deep_scrub_stamp":"2024-04-17T15:41:34.838245+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.838245+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:46.266575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.493472+0000","last_change":"2024-04-17T15:41:23.493472+0000","last_active":"2024-04-17T15:41:23.493472+0000","last_peered":"2024-04-17T15:41:23.493472+0000","last_clean":"2024-04-17T15:41:23.493472+0000","last_became_active":"2024-04-17T15:36:58.236556+0000","last_became_peered":"2024-04-17T15:36:58.236556+0000","last_unstale":"2024-04-17T15:41:23.493472+0000","last_undegraded":"2024-04-17T15:41:23.493472+0000","last_fullsized":"2024-04-17T15:41:23.493472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:23.493211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:23.493211+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.493211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:31.172500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"130'26","reported_seq":268,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.718224+0000","last_change":"2024-04-17T15:41:21.718224+0000","last_active":"2024-04-17T15:41:21.718224+0000","last_peered":"2024-04-17T15:41:21.718224+0000","last_clean":"2024-04-17T15:41:21.718224+0000","last_became_active":"2024-04-17T15:37:00.262776+0000","last_became_peered":"2024-04-17T15:37:00.262776+0000","last_unstale":"2024-04-17T15:41:21.718224+0000","last_undegraded":"2024-04-17T15:41:21.718224+0000","last_fullsized":"2024-04-17T15:41:21.718224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'26","last_scrub_stamp":"2024-04-17T15:41:21.717955+0000","last_deep_scrub":"130'26","last_deep_scrub_stamp":"2024-04-17T15:41:21.717955+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.717955+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:52.277915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.418466+0000","last_change":"2024-04-17T15:41:35.418466+0000","last_active":"2024-04-17T15:41:35.418466+0000","last_peered":"2024-04-17T15:41:35.418466+0000","last_clean":"2024-04-17T15:41:35.418466+0000","last_became_active":"2024-04-17T15:37:02.268747+0000","last_became_peered":"2024-04-17T15:37:02.268747+0000","last_unstale":"2024-04-17T15:41:35.418466+0000","last_undegraded":"2024-04-17T15:41:35.418466+0000","last_fullsized":"2024-04-17T15:41:35.418466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:35.418155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:35.418155+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.418155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:38.384411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"98'4","reported_seq":228,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.126192+0000","last_change":"2024-04-17T15:41:49.126192+0000","last_active":"2024-04-17T15:41:49.126192+0000","last_peered":"2024-04-17T15:41:49.126192+0000","last_clean":"2024-04-17T15:41:49.126192+0000","last_became_active":"2024-04-17T15:37:04.288022+0000","last_became_peered":"2024-04-17T15:37:04.288022+0000","last_unstale":"2024-04-17T15:41:49.126192+0000","last_undegraded":"2024-04-17T15:41:49.126192+0000","last_fullsized":"2024-04-17T15:41:49.126192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-17T15:41:49.125902+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-17T15:41:49.125902+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.125902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:35.241531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"77'6","reported_seq":265,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:34.622129+0000","last_change":"2024-04-17T15:41:34.622129+0000","last_active":"2024-04-17T15:41:34.622129+0000","last_peered":"2024-04-17T15:41:34.622129+0000","last_clean":"2024-04-17T15:41:34.622129+0000","last_became_active":"2024-04-17T15:36:56.179069+0000","last_became_peered":"2024-04-17T15:36:56.179069+0000","last_unstale":"2024-04-17T15:41:34.622129+0000","last_undegraded":"2024-04-17T15:41:34.622129+0000","last_fullsized":"2024-04-17T15:41:34.622129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-17T15:41:34.621741+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-17T15:41:34.621741+0000","last_clean_scrub_stamp":"2024-04-17T15:41:34.621741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:03:49.137359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"130'56","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.604147+0000","last_change":"2024-04-17T15:41:43.604147+0000","last_active":"2024-04-17T15:41:43.604147+0000","last_peered":"2024-04-17T15:41:43.604147+0000","last_clean":"2024-04-17T15:41:43.604147+0000","last_became_active":"2024-04-17T15:36:54.181240+0000","last_became_peered":"2024-04-17T15:36:54.181240+0000","last_unstale":"2024-04-17T15:41:43.604147+0000","last_undegraded":"2024-04-17T15:41:43.604147+0000","last_fullsized":"2024-04-17T15:41:43.604147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:43.603751+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:43.603751+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.603751+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:19:38.454042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.369623+0000","last_change":"2024-04-17T15:41:20.369623+0000","last_active":"2024-04-17T15:41:20.369623+0000","last_peered":"2024-04-17T15:41:20.369623+0000","last_clean":"2024-04-17T15:41:20.369623+0000","last_became_active":"2024-04-17T15:36:58.218053+0000","last_became_peered":"2024-04-17T15:36:58.218053+0000","last_unstale":"2024-04-17T15:41:20.369623+0000","last_undegraded":"2024-04-17T15:41:20.369623+0000","last_fullsized":"2024-04-17T15:41:20.369623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.369359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.369359+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.369359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:36:34.772497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"130'24","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.583225+0000","last_change":"2024-04-17T15:41:33.583225+0000","last_active":"2024-04-17T15:41:33.583225+0000","last_peered":"2024-04-17T15:41:33.583225+0000","last_clean":"2024-04-17T15:41:33.583225+0000","last_became_active":"2024-04-17T15:37:00.254851+0000","last_became_peered":"2024-04-17T15:37:00.254851+0000","last_unstale":"2024-04-17T15:41:33.583225+0000","last_undegraded":"2024-04-17T15:41:33.583225+0000","last_fullsized":"2024-04-17T15:41:33.583225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:33.582912+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:33.582912+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.582912+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:18.775745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:15.642389+0000","last_change":"2024-04-17T15:41:15.642389+0000","last_active":"2024-04-17T15:41:15.642389+0000","last_peered":"2024-04-17T15:41:15.642389+0000","last_clean":"2024-04-17T15:41:15.642389+0000","last_became_active":"2024-04-17T15:37:02.267710+0000","last_became_peered":"2024-04-17T15:37:02.267710+0000","last_unstale":"2024-04-17T15:41:15.642389+0000","last_undegraded":"2024-04-17T15:41:15.642389+0000","last_fullsized":"2024-04-17T15:41:15.642389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:15.642137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:15.642137+0000","last_clean_scrub_stamp":"2024-04-17T15:41:15.642137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:23.321426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"112'10","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.357866+0000","last_change":"2024-04-17T15:41:17.357933+0000","last_active":"2024-04-17T15:41:17.357866+0000","last_peered":"2024-04-17T15:41:17.357866+0000","last_clean":"2024-04-17T15:41:17.357866+0000","last_became_active":"2024-04-17T15:36:56.211459+0000","last_became_peered":"2024-04-17T15:36:56.211459+0000","last_unstale":"2024-04-17T15:41:17.357866+0000","last_undegraded":"2024-04-17T15:41:17.357866+0000","last_fullsized":"2024-04-17T15:41:17.357866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'10","last_scrub_stamp":"2024-04-17T15:41:17.357662+0000","last_deep_scrub":"112'10","last_deep_scrub_stamp":"2024-04-17T15:41:17.357662+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.357662+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:00:44.064799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"130'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.722689+0000","last_change":"2024-04-17T15:41:42.722689+0000","last_active":"2024-04-17T15:41:42.722689+0000","last_peered":"2024-04-17T15:41:42.722689+0000","last_clean":"2024-04-17T15:41:42.722689+0000","last_became_active":"2024-04-17T15:36:54.172560+0000","last_became_peered":"2024-04-17T15:36:54.172560+0000","last_unstale":"2024-04-17T15:41:42.722689+0000","last_undegraded":"2024-04-17T15:41:42.722689+0000","last_fullsized":"2024-04-17T15:41:42.722689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:42.722423+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:42.722423+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.722423+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:30:48.377709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.698570+0000","last_change":"2024-04-17T15:41:32.698625+0000","last_active":"2024-04-17T15:41:32.698570+0000","last_peered":"2024-04-17T15:41:32.698570+0000","last_clean":"2024-04-17T15:41:32.698570+0000","last_became_active":"2024-04-17T15:36:58.239030+0000","last_became_peered":"2024-04-17T15:36:58.239030+0000","last_unstale":"2024-04-17T15:41:32.698570+0000","last_undegraded":"2024-04-17T15:41:32.698570+0000","last_fullsized":"2024-04-17T15:41:32.698570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:32.698372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:32.698372+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.698372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:21:59.986646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"130'37","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.536460+0000","last_change":"2024-04-17T15:41:26.536460+0000","last_active":"2024-04-17T15:41:26.536460+0000","last_peered":"2024-04-17T15:41:26.536460+0000","last_clean":"2024-04-17T15:41:26.536460+0000","last_became_active":"2024-04-17T15:37:00.246129+0000","last_became_peered":"2024-04-17T15:37:00.246129+0000","last_unstale":"2024-04-17T15:41:26.536460+0000","last_undegraded":"2024-04-17T15:41:26.536460+0000","last_fullsized":"2024-04-17T15:41:26.536460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'37","last_scrub_stamp":"2024-04-17T15:41:26.536186+0000","last_deep_scrub":"130'37","last_deep_scrub_stamp":"2024-04-17T15:41:26.536186+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.536186+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:34.215475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.737920+0000","last_change":"2024-04-17T15:41:20.737920+0000","last_active":"2024-04-17T15:41:20.737920+0000","last_peered":"2024-04-17T15:41:20.737920+0000","last_clean":"2024-04-17T15:41:20.737920+0000","last_became_active":"2024-04-17T15:37:02.281625+0000","last_became_peered":"2024-04-17T15:37:02.281625+0000","last_unstale":"2024-04-17T15:41:20.737920+0000","last_undegraded":"2024-04-17T15:41:20.737920+0000","last_fullsized":"2024-04-17T15:41:20.737920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:20.737664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:20.737664+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.737664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:40:28.416953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"112'8","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:54.729654+0000","last_change":"2024-04-17T15:41:54.729716+0000","last_active":"2024-04-17T15:41:54.729654+0000","last_peered":"2024-04-17T15:41:54.729654+0000","last_clean":"2024-04-17T15:41:54.729654+0000","last_became_active":"2024-04-17T15:37:04.295677+0000","last_became_peered":"2024-04-17T15:37:04.295677+0000","last_unstale":"2024-04-17T15:41:54.729654+0000","last_undegraded":"2024-04-17T15:41:54.729654+0000","last_fullsized":"2024-04-17T15:41:54.729654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'8","last_scrub_stamp":"2024-04-17T15:41:54.729407+0000","last_deep_scrub":"112'8","last_deep_scrub_stamp":"2024-04-17T15:41:54.729407+0000","last_clean_scrub_stamp":"2024-04-17T15:41:54.729407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:31:58.510809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"72'6","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.565309+0000","last_change":"2024-04-17T15:41:26.565461+0000","last_active":"2024-04-17T15:41:26.565309+0000","last_peered":"2024-04-17T15:41:26.565309+0000","last_clean":"2024-04-17T15:41:26.565309+0000","last_became_active":"2024-04-17T15:36:56.214214+0000","last_became_peered":"2024-04-17T15:36:56.214214+0000","last_unstale":"2024-04-17T15:41:26.565309+0000","last_undegraded":"2024-04-17T15:41:26.565309+0000","last_fullsized":"2024-04-17T15:41:26.565309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:26.565064+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.565064+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.565064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:34:10.523713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"130'48","reported_seq":291,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.517842+0000","last_change":"2024-04-17T15:41:32.517842+0000","last_active":"2024-04-17T15:41:32.517842+0000","last_peered":"2024-04-17T15:41:32.517842+0000","last_clean":"2024-04-17T15:41:32.517842+0000","last_became_active":"2024-04-17T15:36:54.169410+0000","last_became_peered":"2024-04-17T15:36:54.169410+0000","last_unstale":"2024-04-17T15:41:32.517842+0000","last_undegraded":"2024-04-17T15:41:32.517842+0000","last_fullsized":"2024-04-17T15:41:32.517842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:32.517588+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:32.517588+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.517588+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:04.220651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.364512+0000","last_change":"2024-04-17T15:41:18.364569+0000","last_active":"2024-04-17T15:41:18.364512+0000","last_peered":"2024-04-17T15:41:18.364512+0000","last_clean":"2024-04-17T15:41:18.364512+0000","last_became_active":"2024-04-17T15:36:58.217573+0000","last_became_peered":"2024-04-17T15:36:58.217573+0000","last_unstale":"2024-04-17T15:41:18.364512+0000","last_undegraded":"2024-04-17T15:41:18.364512+0000","last_fullsized":"2024-04-17T15:41:18.364512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.364298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.364298+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.364298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:57:42.347669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"130'32","reported_seq":274,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.655882+0000","last_change":"2024-04-17T15:41:35.655882+0000","last_active":"2024-04-17T15:41:35.655882+0000","last_peered":"2024-04-17T15:41:35.655882+0000","last_clean":"2024-04-17T15:41:35.655882+0000","last_became_active":"2024-04-17T15:37:00.256811+0000","last_became_peered":"2024-04-17T15:37:00.256811+0000","last_unstale":"2024-04-17T15:41:35.655882+0000","last_undegraded":"2024-04-17T15:41:35.655882+0000","last_fullsized":"2024-04-17T15:41:35.655882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:35.655589+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:35.655589+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.655589+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:07:05.201474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.533402+0000","last_change":"2024-04-17T15:41:37.533402+0000","last_active":"2024-04-17T15:41:37.533402+0000","last_peered":"2024-04-17T15:41:37.533402+0000","last_clean":"2024-04-17T15:41:37.533402+0000","last_became_active":"2024-04-17T15:37:02.268229+0000","last_became_peered":"2024-04-17T15:37:02.268229+0000","last_unstale":"2024-04-17T15:41:37.533402+0000","last_undegraded":"2024-04-17T15:41:37.533402+0000","last_fullsized":"2024-04-17T15:41:37.533402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.533123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.533123+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.533123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:51:02.910797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"72'3","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.456410+0000","last_change":"2024-04-17T15:41:41.456410+0000","last_active":"2024-04-17T15:41:41.456410+0000","last_peered":"2024-04-17T15:41:41.456410+0000","last_clean":"2024-04-17T15:41:41.456410+0000","last_became_active":"2024-04-17T15:37:04.281431+0000","last_became_peered":"2024-04-17T15:37:04.281431+0000","last_unstale":"2024-04-17T15:41:41.456410+0000","last_undegraded":"2024-04-17T15:41:41.456410+0000","last_fullsized":"2024-04-17T15:41:41.456410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-17T15:41:41.456110+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-17T15:41:41.456110+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.456110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:11:15.220613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"73'2","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.623363+0000","last_change":"2024-04-17T15:41:32.623363+0000","last_active":"2024-04-17T15:41:32.623363+0000","last_peered":"2024-04-17T15:41:32.623363+0000","last_clean":"2024-04-17T15:41:32.623363+0000","last_became_active":"2024-04-17T15:36:56.182849+0000","last_became_peered":"2024-04-17T15:36:56.182849+0000","last_unstale":"2024-04-17T15:41:32.623363+0000","last_undegraded":"2024-04-17T15:41:32.623363+0000","last_fullsized":"2024-04-17T15:41:32.623363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'2","last_scrub_stamp":"2024-04-17T15:41:32.622791+0000","last_deep_scrub":"73'2","last_deep_scrub_stamp":"2024-04-17T15:41:32.622791+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.622791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:08:11.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"130'56","reported_seq":296,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.118550+0000","last_change":"2024-04-17T15:41:38.118550+0000","last_active":"2024-04-17T15:41:38.118550+0000","last_peered":"2024-04-17T15:41:38.118550+0000","last_clean":"2024-04-17T15:41:38.118550+0000","last_became_active":"2024-04-17T15:36:54.164264+0000","last_became_peered":"2024-04-17T15:36:54.164264+0000","last_unstale":"2024-04-17T15:41:38.118550+0000","last_undegraded":"2024-04-17T15:41:38.118550+0000","last_fullsized":"2024-04-17T15:41:38.118550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:38.118255+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:38.118255+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.118255+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:17:38.085884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.260046+0000","last_change":"2024-04-17T15:41:46.260046+0000","last_active":"2024-04-17T15:41:46.260046+0000","last_peered":"2024-04-17T15:41:46.260046+0000","last_clean":"2024-04-17T15:41:46.260046+0000","last_became_active":"2024-04-17T15:36:58.221318+0000","last_became_peered":"2024-04-17T15:36:58.221318+0000","last_unstale":"2024-04-17T15:41:46.260046+0000","last_undegraded":"2024-04-17T15:41:46.260046+0000","last_fullsized":"2024-04-17T15:41:46.260046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:46.259693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:46.259693+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.259693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:25.604303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"130'28","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.654691+0000","last_change":"2024-04-17T15:41:18.654793+0000","last_active":"2024-04-17T15:41:18.654691+0000","last_peered":"2024-04-17T15:41:18.654691+0000","last_clean":"2024-04-17T15:41:18.654691+0000","last_became_active":"2024-04-17T15:37:00.455699+0000","last_became_peered":"2024-04-17T15:37:00.455699+0000","last_unstale":"2024-04-17T15:41:18.654691+0000","last_undegraded":"2024-04-17T15:41:18.654691+0000","last_fullsized":"2024-04-17T15:41:18.654691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-17T15:41:18.654502+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-17T15:41:18.654502+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.654502+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:42:37.262801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.542483+0000","last_change":"2024-04-17T15:41:39.542546+0000","last_active":"2024-04-17T15:41:39.542483+0000","last_peered":"2024-04-17T15:41:39.542483+0000","last_clean":"2024-04-17T15:41:39.542483+0000","last_became_active":"2024-04-17T15:37:02.283571+0000","last_became_peered":"2024-04-17T15:37:02.283571+0000","last_unstale":"2024-04-17T15:41:39.542483+0000","last_undegraded":"2024-04-17T15:41:39.542483+0000","last_fullsized":"2024-04-17T15:41:39.542483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:39.542288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:39.542288+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.542288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:18:36.212641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":222,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.133932+0000","last_change":"2024-04-17T15:41:50.134056+0000","last_active":"2024-04-17T15:41:50.133932+0000","last_peered":"2024-04-17T15:41:50.133932+0000","last_clean":"2024-04-17T15:41:50.133932+0000","last_became_active":"2024-04-17T15:37:04.288223+0000","last_became_peered":"2024-04-17T15:37:04.288223+0000","last_unstale":"2024-04-17T15:41:50.133932+0000","last_undegraded":"2024-04-17T15:41:50.133932+0000","last_fullsized":"2024-04-17T15:41:50.133932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:50.133680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:50.133680+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.133680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:05:33.250661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"73'6","reported_seq":262,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.873386+0000","last_change":"2024-04-17T15:41:23.873386+0000","last_active":"2024-04-17T15:41:23.873386+0000","last_peered":"2024-04-17T15:41:23.873386+0000","last_clean":"2024-04-17T15:41:23.873386+0000","last_became_active":"2024-04-17T15:36:56.189324+0000","last_became_peered":"2024-04-17T15:36:56.189324+0000","last_unstale":"2024-04-17T15:41:23.873386+0000","last_undegraded":"2024-04-17T15:41:23.873386+0000","last_fullsized":"2024-04-17T15:41:23.873386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:23.873020+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.873020+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.873020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:48:45.277191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"130'54","reported_seq":297,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.633370+0000","last_change":"2024-04-17T15:41:45.633370+0000","last_active":"2024-04-17T15:41:45.633370+0000","last_peered":"2024-04-17T15:41:45.633370+0000","last_clean":"2024-04-17T15:41:45.633370+0000","last_became_active":"2024-04-17T15:36:54.199870+0000","last_became_peered":"2024-04-17T15:36:54.199870+0000","last_unstale":"2024-04-17T15:41:45.633370+0000","last_undegraded":"2024-04-17T15:41:45.633370+0000","last_fullsized":"2024-04-17T15:41:45.633370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'54","last_scrub_stamp":"2024-04-17T15:41:45.633107+0000","last_deep_scrub":"130'54","last_deep_scrub_stamp":"2024-04-17T15:41:45.633107+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.633107+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:05.064501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":235,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.444024+0000","last_change":"2024-04-17T15:41:22.444024+0000","last_active":"2024-04-17T15:41:22.444024+0000","last_peered":"2024-04-17T15:41:22.444024+0000","last_clean":"2024-04-17T15:41:22.444024+0000","last_became_active":"2024-04-17T15:36:58.227252+0000","last_became_peered":"2024-04-17T15:36:58.227252+0000","last_unstale":"2024-04-17T15:41:22.444024+0000","last_undegraded":"2024-04-17T15:41:22.444024+0000","last_fullsized":"2024-04-17T15:41:22.444024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:22.443742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:22.443742+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.443742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:05.643225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"130'17","reported_seq":250,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:19.942474+0000","last_change":"2024-04-17T15:41:19.942554+0000","last_active":"2024-04-17T15:41:19.942474+0000","last_peered":"2024-04-17T15:41:19.942474+0000","last_clean":"2024-04-17T15:41:19.942474+0000","last_became_active":"2024-04-17T15:37:00.457756+0000","last_became_peered":"2024-04-17T15:37:00.457756+0000","last_unstale":"2024-04-17T15:41:19.942474+0000","last_undegraded":"2024-04-17T15:41:19.942474+0000","last_fullsized":"2024-04-17T15:41:19.942474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'17","last_scrub_stamp":"2024-04-17T15:41:19.942239+0000","last_deep_scrub":"130'17","last_deep_scrub_stamp":"2024-04-17T15:41:19.942239+0000","last_clean_scrub_stamp":"2024-04-17T15:41:19.942239+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:27:11.048555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"130'138","reported_seq":413,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:36.426953+0000","last_change":"2024-04-17T15:41:36.427021+0000","last_active":"2024-04-17T15:41:36.426953+0000","last_peered":"2024-04-17T15:41:36.426953+0000","last_clean":"2024-04-17T15:41:36.426953+0000","last_became_active":"2024-04-17T15:37:02.267687+0000","last_became_peered":"2024-04-17T15:37:02.267687+0000","last_unstale":"2024-04-17T15:41:36.426953+0000","last_undegraded":"2024-04-17T15:41:36.426953+0000","last_fullsized":"2024-04-17T15:41:36.426953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'138","last_scrub_stamp":"2024-04-17T15:41:36.426750+0000","last_deep_scrub":"130'138","last_deep_scrub_stamp":"2024-04-17T15:41:36.426750+0000","last_clean_scrub_stamp":"2024-04-17T15:41:36.426750+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:06:06.422194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:49.614129+0000","last_change":"2024-04-17T15:41:49.614186+0000","last_active":"2024-04-17T15:41:49.614129+0000","last_peered":"2024-04-17T15:41:49.614129+0000","last_clean":"2024-04-17T15:41:49.614129+0000","last_became_active":"2024-04-17T15:37:04.284667+0000","last_became_peered":"2024-04-17T15:37:04.284667+0000","last_unstale":"2024-04-17T15:41:49.614129+0000","last_undegraded":"2024-04-17T15:41:49.614129+0000","last_fullsized":"2024-04-17T15:41:49.614129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:49.613923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:49.613923+0000","last_clean_scrub_stamp":"2024-04-17T15:41:49.613923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.115004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"112'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.219567+0000","last_change":"2024-04-17T15:41:45.219567+0000","last_active":"2024-04-17T15:41:45.219567+0000","last_peered":"2024-04-17T15:41:45.219567+0000","last_clean":"2024-04-17T15:41:45.219567+0000","last_became_active":"2024-04-17T15:36:56.180680+0000","last_became_peered":"2024-04-17T15:36:56.180680+0000","last_unstale":"2024-04-17T15:41:45.219567+0000","last_undegraded":"2024-04-17T15:41:45.219567+0000","last_fullsized":"2024-04-17T15:41:45.219567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'2","last_scrub_stamp":"2024-04-17T15:41:45.219183+0000","last_deep_scrub":"112'2","last_deep_scrub_stamp":"2024-04-17T15:41:45.219183+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.219183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:59.186120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"130'42","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:42.172583+0000","last_change":"2024-04-17T15:41:42.172583+0000","last_active":"2024-04-17T15:41:42.172583+0000","last_peered":"2024-04-17T15:41:42.172583+0000","last_clean":"2024-04-17T15:41:42.172583+0000","last_became_active":"2024-04-17T15:36:54.167064+0000","last_became_peered":"2024-04-17T15:36:54.167064+0000","last_unstale":"2024-04-17T15:41:42.172583+0000","last_undegraded":"2024-04-17T15:41:42.172583+0000","last_fullsized":"2024-04-17T15:41:42.172583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:42.172287+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:42.172287+0000","last_clean_scrub_stamp":"2024-04-17T15:41:42.172287+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:37.181887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.534535+0000","last_change":"2024-04-17T15:41:29.534535+0000","last_active":"2024-04-17T15:41:29.534535+0000","last_peered":"2024-04-17T15:41:29.534535+0000","last_clean":"2024-04-17T15:41:29.534535+0000","last_became_active":"2024-04-17T15:36:58.238093+0000","last_became_peered":"2024-04-17T15:36:58.238093+0000","last_unstale":"2024-04-17T15:41:29.534535+0000","last_undegraded":"2024-04-17T15:41:29.534535+0000","last_fullsized":"2024-04-17T15:41:29.534535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:29.534228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:29.534228+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.534228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:39:01.237291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"130'32","reported_seq":276,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.740980+0000","last_change":"2024-04-17T15:41:21.740980+0000","last_active":"2024-04-17T15:41:21.740980+0000","last_peered":"2024-04-17T15:41:21.740980+0000","last_clean":"2024-04-17T15:41:21.740980+0000","last_became_active":"2024-04-17T15:37:00.249411+0000","last_became_peered":"2024-04-17T15:37:00.249411+0000","last_unstale":"2024-04-17T15:41:21.740980+0000","last_undegraded":"2024-04-17T15:41:21.740980+0000","last_fullsized":"2024-04-17T15:41:21.740980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:21.740710+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:21.740710+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.740710+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:34:57.749235+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:18.614223+0000","last_change":"2024-04-17T15:41:18.614223+0000","last_active":"2024-04-17T15:41:18.614223+0000","last_peered":"2024-04-17T15:41:18.614223+0000","last_clean":"2024-04-17T15:41:18.614223+0000","last_became_active":"2024-04-17T15:37:02.265937+0000","last_became_peered":"2024-04-17T15:37:02.265937+0000","last_unstale":"2024-04-17T15:41:18.614223+0000","last_undegraded":"2024-04-17T15:41:18.614223+0000","last_fullsized":"2024-04-17T15:41:18.614223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:18.613953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:18.613953+0000","last_clean_scrub_stamp":"2024-04-17T15:41:18.613953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:21:05.749502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"72'3","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.640401+0000","last_change":"2024-04-17T15:41:51.640401+0000","last_active":"2024-04-17T15:41:51.640401+0000","last_peered":"2024-04-17T15:41:51.640401+0000","last_clean":"2024-04-17T15:41:51.640401+0000","last_became_active":"2024-04-17T15:37:04.296041+0000","last_became_peered":"2024-04-17T15:37:04.296041+0000","last_unstale":"2024-04-17T15:41:51.640401+0000","last_undegraded":"2024-04-17T15:41:51.640401+0000","last_fullsized":"2024-04-17T15:41:51.640401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-04-17T15:41:51.639968+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-04-17T15:41:51.639968+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.639968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:49:37.755597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"90'2","reported_seq":245,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.181355+0000","last_change":"2024-04-17T15:41:43.181355+0000","last_active":"2024-04-17T15:41:43.181355+0000","last_peered":"2024-04-17T15:41:43.181355+0000","last_clean":"2024-04-17T15:41:43.181355+0000","last_became_active":"2024-04-17T15:36:56.179696+0000","last_became_peered":"2024-04-17T15:36:56.179696+0000","last_unstale":"2024-04-17T15:41:43.181355+0000","last_undegraded":"2024-04-17T15:41:43.181355+0000","last_fullsized":"2024-04-17T15:41:43.181355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-04-17T15:41:43.181098+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-04-17T15:41:43.181098+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.181098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:44:34.260039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"130'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.139796+0000","last_change":"2024-04-17T15:41:41.139796+0000","last_active":"2024-04-17T15:41:41.139796+0000","last_peered":"2024-04-17T15:41:41.139796+0000","last_clean":"2024-04-17T15:41:41.139796+0000","last_became_active":"2024-04-17T15:36:54.165192+0000","last_became_peered":"2024-04-17T15:36:54.165192+0000","last_unstale":"2024-04-17T15:41:41.139796+0000","last_undegraded":"2024-04-17T15:41:41.139796+0000","last_fullsized":"2024-04-17T15:41:41.139796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:41.139537+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:41.139537+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.139537+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:22:27.789564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:37.018422+0000","last_change":"2024-04-17T15:41:37.018422+0000","last_active":"2024-04-17T15:41:37.018422+0000","last_peered":"2024-04-17T15:41:37.018422+0000","last_clean":"2024-04-17T15:41:37.018422+0000","last_became_active":"2024-04-17T15:36:58.229456+0000","last_became_peered":"2024-04-17T15:36:58.229456+0000","last_unstale":"2024-04-17T15:41:37.018422+0000","last_undegraded":"2024-04-17T15:41:37.018422+0000","last_fullsized":"2024-04-17T15:41:37.018422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:37.018026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:37.018026+0000","last_clean_scrub_stamp":"2024-04-17T15:41:37.018026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:57:34.310856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"130'25","reported_seq":267,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.603444+0000","last_change":"2024-04-17T15:41:46.603444+0000","last_active":"2024-04-17T15:41:46.603444+0000","last_peered":"2024-04-17T15:41:46.603444+0000","last_clean":"2024-04-17T15:41:46.603444+0000","last_became_active":"2024-04-17T15:37:00.260809+0000","last_became_peered":"2024-04-17T15:37:00.260809+0000","last_unstale":"2024-04-17T15:41:46.603444+0000","last_undegraded":"2024-04-17T15:41:46.603444+0000","last_fullsized":"2024-04-17T15:41:46.603444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'25","last_scrub_stamp":"2024-04-17T15:41:46.603166+0000","last_deep_scrub":"130'25","last_deep_scrub_stamp":"2024-04-17T15:41:46.603166+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.603166+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:59:20.981525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.357478+0000","last_change":"2024-04-17T15:41:24.357478+0000","last_active":"2024-04-17T15:41:24.357478+0000","last_peered":"2024-04-17T15:41:24.357478+0000","last_clean":"2024-04-17T15:41:24.357478+0000","last_became_active":"2024-04-17T15:37:02.265905+0000","last_became_peered":"2024-04-17T15:37:02.265905+0000","last_unstale":"2024-04-17T15:41:24.357478+0000","last_undegraded":"2024-04-17T15:41:24.357478+0000","last_fullsized":"2024-04-17T15:41:24.357478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:24.357216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:24.357216+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.357216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:19:42.020463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"90'2","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:51.685016+0000","last_change":"2024-04-17T15:41:51.685016+0000","last_active":"2024-04-17T15:41:51.685016+0000","last_peered":"2024-04-17T15:41:51.685016+0000","last_clean":"2024-04-17T15:41:51.685016+0000","last_became_active":"2024-04-17T15:37:04.296016+0000","last_became_peered":"2024-04-17T15:37:04.296016+0000","last_unstale":"2024-04-17T15:41:51.685016+0000","last_undegraded":"2024-04-17T15:41:51.685016+0000","last_fullsized":"2024-04-17T15:41:51.685016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-04-17T15:41:51.684760+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-04-17T15:41:51.684760+0000","last_clean_scrub_stamp":"2024-04-17T15:41:51.684760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:54:02.019064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"72'4","reported_seq":254,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.682834+0000","last_change":"2024-04-17T15:41:25.682834+0000","last_active":"2024-04-17T15:41:25.682834+0000","last_peered":"2024-04-17T15:41:25.682834+0000","last_clean":"2024-04-17T15:41:25.682834+0000","last_became_active":"2024-04-17T15:36:56.188167+0000","last_became_peered":"2024-04-17T15:36:56.188167+0000","last_unstale":"2024-04-17T15:41:25.682834+0000","last_undegraded":"2024-04-17T15:41:25.682834+0000","last_fullsized":"2024-04-17T15:41:25.682834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:25.682410+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:25.682410+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.682410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:56:14.881844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:48.700567+0000","last_change":"2024-04-17T15:41:48.700626+0000","last_active":"2024-04-17T15:41:48.700567+0000","last_peered":"2024-04-17T15:41:48.700567+0000","last_clean":"2024-04-17T15:41:48.700567+0000","last_became_active":"2024-04-17T15:36:54.188374+0000","last_became_peered":"2024-04-17T15:36:54.188374+0000","last_unstale":"2024-04-17T15:41:48.700567+0000","last_undegraded":"2024-04-17T15:41:48.700567+0000","last_fullsized":"2024-04-17T15:41:48.700567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:48.700365+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:48.700365+0000","last_clean_scrub_stamp":"2024-04-17T15:41:48.700365+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:12:10.148004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":232,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.983417+0000","last_change":"2024-04-17T15:41:31.983417+0000","last_active":"2024-04-17T15:41:31.983417+0000","last_peered":"2024-04-17T15:41:31.983417+0000","last_clean":"2024-04-17T15:41:31.983417+0000","last_became_active":"2024-04-17T15:36:58.220057+0000","last_became_peered":"2024-04-17T15:36:58.220057+0000","last_unstale":"2024-04-17T15:41:31.983417+0000","last_undegraded":"2024-04-17T15:41:31.983417+0000","last_fullsized":"2024-04-17T15:41:31.983417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:31.983157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:31.983157+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.983157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:51:17.175990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"130'17","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.715584+0000","last_change":"2024-04-17T15:41:24.715584+0000","last_active":"2024-04-17T15:41:24.715584+0000","last_peered":"2024-04-17T15:41:24.715584+0000","last_clean":"2024-04-17T15:41:24.715584+0000","last_became_active":"2024-04-17T15:37:00.258222+0000","last_became_peered":"2024-04-17T15:37:00.258222+0000","last_unstale":"2024-04-17T15:41:24.715584+0000","last_undegraded":"2024-04-17T15:41:24.715584+0000","last_fullsized":"2024-04-17T15:41:24.715584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'17","last_scrub_stamp":"2024-04-17T15:41:24.715319+0000","last_deep_scrub":"130'17","last_deep_scrub_stamp":"2024-04-17T15:41:24.715319+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.715319+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:41.283821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:47.265403+0000","last_change":"2024-04-17T15:41:47.265403+0000","last_active":"2024-04-17T15:41:47.265403+0000","last_peered":"2024-04-17T15:41:47.265403+0000","last_clean":"2024-04-17T15:41:47.265403+0000","last_became_active":"2024-04-17T15:37:02.265261+0000","last_became_peered":"2024-04-17T15:37:02.265261+0000","last_unstale":"2024-04-17T15:41:47.265403+0000","last_undegraded":"2024-04-17T15:41:47.265403+0000","last_fullsized":"2024-04-17T15:41:47.265403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:47.265026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:47.265026+0000","last_clean_scrub_stamp":"2024-04-17T15:41:47.265026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:12.766107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:50.639649+0000","last_change":"2024-04-17T15:41:50.639649+0000","last_active":"2024-04-17T15:41:50.639649+0000","last_peered":"2024-04-17T15:41:50.639649+0000","last_clean":"2024-04-17T15:41:50.639649+0000","last_became_active":"2024-04-17T15:37:04.291280+0000","last_became_peered":"2024-04-17T15:37:04.291280+0000","last_unstale":"2024-04-17T15:41:50.639649+0000","last_undegraded":"2024-04-17T15:41:50.639649+0000","last_fullsized":"2024-04-17T15:41:50.639649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:50.639390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:50.639390+0000","last_clean_scrub_stamp":"2024-04-17T15:41:50.639390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:47:45.886791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"112'4","reported_seq":252,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.940965+0000","last_change":"2024-04-17T15:41:22.940965+0000","last_active":"2024-04-17T15:41:22.940965+0000","last_peered":"2024-04-17T15:41:22.940965+0000","last_clean":"2024-04-17T15:41:22.940965+0000","last_became_active":"2024-04-17T15:36:56.198542+0000","last_became_peered":"2024-04-17T15:36:56.198542+0000","last_unstale":"2024-04-17T15:41:22.940965+0000","last_undegraded":"2024-04-17T15:41:22.940965+0000","last_fullsized":"2024-04-17T15:41:22.940965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:22.940691+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:22.940691+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.940691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:32:42.716910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"130'44","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:39.659974+0000","last_change":"2024-04-17T15:41:39.660037+0000","last_active":"2024-04-17T15:41:39.659974+0000","last_peered":"2024-04-17T15:41:39.659974+0000","last_clean":"2024-04-17T15:41:39.659974+0000","last_became_active":"2024-04-17T15:36:54.174139+0000","last_became_peered":"2024-04-17T15:36:54.174139+0000","last_unstale":"2024-04-17T15:41:39.659974+0000","last_undegraded":"2024-04-17T15:41:39.659974+0000","last_fullsized":"2024-04-17T15:41:39.659974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:39.659785+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:39.659785+0000","last_clean_scrub_stamp":"2024-04-17T15:41:39.659785+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:19.004395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"130'2","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:20.438667+0000","last_change":"2024-04-17T15:41:20.438667+0000","last_active":"2024-04-17T15:41:20.438667+0000","last_peered":"2024-04-17T15:41:20.438667+0000","last_clean":"2024-04-17T15:41:20.438667+0000","last_became_active":"2024-04-17T15:36:58.219888+0000","last_became_peered":"2024-04-17T15:36:58.219888+0000","last_unstale":"2024-04-17T15:41:20.438667+0000","last_undegraded":"2024-04-17T15:41:20.438667+0000","last_fullsized":"2024-04-17T15:41:20.438667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-04-17T15:41:20.438401+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-04-17T15:41:20.438401+0000","last_clean_scrub_stamp":"2024-04-17T15:41:20.438401+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:50:50.631393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"130'24","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:16.893715+0000","last_change":"2024-04-17T15:41:16.893715+0000","last_active":"2024-04-17T15:41:16.893715+0000","last_peered":"2024-04-17T15:41:16.893715+0000","last_clean":"2024-04-17T15:41:16.893715+0000","last_became_active":"2024-04-17T15:37:00.251543+0000","last_became_peered":"2024-04-17T15:37:00.251543+0000","last_unstale":"2024-04-17T15:41:16.893715+0000","last_undegraded":"2024-04-17T15:41:16.893715+0000","last_fullsized":"2024-04-17T15:41:16.893715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'24","last_scrub_stamp":"2024-04-17T15:41:16.893413+0000","last_deep_scrub":"130'24","last_deep_scrub_stamp":"2024-04-17T15:41:16.893413+0000","last_clean_scrub_stamp":"2024-04-17T15:41:16.893413+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:29:00.092896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":227,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:14.683319+0000","last_change":"2024-04-17T15:41:14.683319+0000","last_active":"2024-04-17T15:41:14.683319+0000","last_peered":"2024-04-17T15:41:14.683319+0000","last_clean":"2024-04-17T15:41:14.683319+0000","last_became_active":"2024-04-17T15:37:02.270387+0000","last_became_peered":"2024-04-17T15:37:02.270387+0000","last_unstale":"2024-04-17T15:41:14.683319+0000","last_undegraded":"2024-04-17T15:41:14.683319+0000","last_fullsized":"2024-04-17T15:41:14.683319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:14.683062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:14.683062+0000","last_clean_scrub_stamp":"2024-04-17T15:41:14.683062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:57:18.851274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:52.354719+0000","last_change":"2024-04-17T15:41:52.354776+0000","last_active":"2024-04-17T15:41:52.354719+0000","last_peered":"2024-04-17T15:41:52.354719+0000","last_clean":"2024-04-17T15:41:52.354719+0000","last_became_active":"2024-04-17T15:37:04.284588+0000","last_became_peered":"2024-04-17T15:37:04.284588+0000","last_unstale":"2024-04-17T15:41:52.354719+0000","last_undegraded":"2024-04-17T15:41:52.354719+0000","last_fullsized":"2024-04-17T15:41:52.354719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:52.354509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:52.354509+0000","last_clean_scrub_stamp":"2024-04-17T15:41:52.354509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:11.785903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"72'4","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.441031+0000","last_change":"2024-04-17T15:41:21.441094+0000","last_active":"2024-04-17T15:41:21.441031+0000","last_peered":"2024-04-17T15:41:21.441031+0000","last_clean":"2024-04-17T15:41:21.441031+0000","last_became_active":"2024-04-17T15:36:56.193939+0000","last_became_peered":"2024-04-17T15:36:56.193939+0000","last_unstale":"2024-04-17T15:41:21.441031+0000","last_undegraded":"2024-04-17T15:41:21.441031+0000","last_fullsized":"2024-04-17T15:41:21.441031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-04-17T15:41:21.440828+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-04-17T15:41:21.440828+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.440828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:38:17.792880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'56","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.375213+0000","last_change":"2024-04-17T15:41:29.375275+0000","last_active":"2024-04-17T15:41:29.375213+0000","last_peered":"2024-04-17T15:41:29.375213+0000","last_clean":"2024-04-17T15:41:29.375213+0000","last_became_active":"2024-04-17T15:36:54.185632+0000","last_became_peered":"2024-04-17T15:36:54.185632+0000","last_unstale":"2024-04-17T15:41:29.375213+0000","last_undegraded":"2024-04-17T15:41:29.375213+0000","last_fullsized":"2024-04-17T15:41:29.375213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'56","last_scrub_stamp":"2024-04-17T15:41:29.374989+0000","last_deep_scrub":"130'56","last_deep_scrub_stamp":"2024-04-17T15:41:29.374989+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.374989+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:21:40.803319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"90'8","reported_seq":275,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.526174+0000","last_change":"2024-04-17T15:41:25.526241+0000","last_active":"2024-04-17T15:41:25.526174+0000","last_peered":"2024-04-17T15:41:25.526174+0000","last_clean":"2024-04-17T15:41:25.526174+0000","last_became_active":"2024-04-17T15:36:56.186017+0000","last_became_peered":"2024-04-17T15:36:56.186017+0000","last_unstale":"2024-04-17T15:41:25.526174+0000","last_undegraded":"2024-04-17T15:41:25.526174+0000","last_fullsized":"2024-04-17T15:41:25.526174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-17T15:41:25.525964+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-17T15:41:25.525964+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.525964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:45.166198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"130'44","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:21.930689+0000","last_change":"2024-04-17T15:41:21.930755+0000","last_active":"2024-04-17T15:41:21.930689+0000","last_peered":"2024-04-17T15:41:21.930689+0000","last_clean":"2024-04-17T15:41:21.930689+0000","last_became_active":"2024-04-17T15:36:54.177159+0000","last_became_peered":"2024-04-17T15:36:54.177159+0000","last_unstale":"2024-04-17T15:41:21.930689+0000","last_undegraded":"2024-04-17T15:41:21.930689+0000","last_fullsized":"2024-04-17T15:41:21.930689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:21.930494+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:21.930494+0000","last_clean_scrub_stamp":"2024-04-17T15:41:21.930494+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:50:07.291135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'2","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.781887+0000","last_change":"2024-04-17T15:41:22.781960+0000","last_active":"2024-04-17T15:41:22.781887+0000","last_peered":"2024-04-17T15:41:22.781887+0000","last_clean":"2024-04-17T15:41:22.781887+0000","last_became_active":"2024-04-17T15:36:56.214689+0000","last_became_peered":"2024-04-17T15:36:56.214689+0000","last_unstale":"2024-04-17T15:41:22.781887+0000","last_undegraded":"2024-04-17T15:41:22.781887+0000","last_fullsized":"2024-04-17T15:41:22.781887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:22.781678+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:22.781678+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.781678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:43:23.342470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"130'42","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.088955+0000","last_change":"2024-04-17T15:41:46.089116+0000","last_active":"2024-04-17T15:41:46.088955+0000","last_peered":"2024-04-17T15:41:46.088955+0000","last_clean":"2024-04-17T15:41:46.088955+0000","last_became_active":"2024-04-17T15:36:54.180202+0000","last_became_peered":"2024-04-17T15:36:54.180202+0000","last_unstale":"2024-04-17T15:41:46.088955+0000","last_undegraded":"2024-04-17T15:41:46.088955+0000","last_fullsized":"2024-04-17T15:41:46.088955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:46.088713+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:46.088713+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.088713+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:59:25.433323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:17.409238+0000","last_change":"2024-04-17T15:41:17.409259+0000","last_active":"2024-04-17T15:41:17.409238+0000","last_peered":"2024-04-17T15:41:17.409238+0000","last_clean":"2024-04-17T15:41:17.409238+0000","last_became_active":"2024-04-17T15:36:56.198101+0000","last_became_peered":"2024-04-17T15:36:56.198101+0000","last_unstale":"2024-04-17T15:41:17.409238+0000","last_undegraded":"2024-04-17T15:41:17.409238+0000","last_fullsized":"2024-04-17T15:41:17.409238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:17.409156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:17.409156+0000","last_clean_scrub_stamp":"2024-04-17T15:41:17.409156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:58:50.849523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"130'42","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:41.571208+0000","last_change":"2024-04-17T15:41:41.571297+0000","last_active":"2024-04-17T15:41:41.571208+0000","last_peered":"2024-04-17T15:41:41.571208+0000","last_clean":"2024-04-17T15:41:41.571208+0000","last_became_active":"2024-04-17T15:36:54.178894+0000","last_became_peered":"2024-04-17T15:36:54.178894+0000","last_unstale":"2024-04-17T15:41:41.571208+0000","last_undegraded":"2024-04-17T15:41:41.571208+0000","last_fullsized":"2024-04-17T15:41:41.571208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:41.570944+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:41.570944+0000","last_clean_scrub_stamp":"2024-04-17T15:41:41.570944+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:47:36.818345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.645917+0000","last_change":"2024-04-17T15:41:26.645981+0000","last_active":"2024-04-17T15:41:26.645917+0000","last_peered":"2024-04-17T15:41:26.645917+0000","last_clean":"2024-04-17T15:41:26.645917+0000","last_became_active":"2024-04-17T15:36:56.189185+0000","last_became_peered":"2024-04-17T15:36:56.189185+0000","last_unstale":"2024-04-17T15:41:26.645917+0000","last_undegraded":"2024-04-17T15:41:26.645917+0000","last_fullsized":"2024-04-17T15:41:26.645917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-17T15:41:26.645717+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-17T15:41:26.645717+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.645717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:28:00.142871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"130'50","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.790441+0000","last_change":"2024-04-17T15:41:32.790441+0000","last_active":"2024-04-17T15:41:32.790441+0000","last_peered":"2024-04-17T15:41:32.790441+0000","last_clean":"2024-04-17T15:41:32.790441+0000","last_became_active":"2024-04-17T15:37:41.344377+0000","last_became_peered":"2024-04-17T15:37:41.344377+0000","last_unstale":"2024-04-17T15:41:32.790441+0000","last_undegraded":"2024-04-17T15:41:32.790441+0000","last_fullsized":"2024-04-17T15:41:32.790441+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:32.790174+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:32.790174+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.790174+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:31:27.935480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"98'2","reported_seq":244,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:29.993934+0000","last_change":"2024-04-17T15:41:29.993997+0000","last_active":"2024-04-17T15:41:29.993934+0000","last_peered":"2024-04-17T15:41:29.993934+0000","last_clean":"2024-04-17T15:41:29.993934+0000","last_became_active":"2024-04-17T15:36:56.217725+0000","last_became_peered":"2024-04-17T15:36:56.217725+0000","last_unstale":"2024-04-17T15:41:29.993934+0000","last_undegraded":"2024-04-17T15:41:29.993934+0000","last_fullsized":"2024-04-17T15:41:29.993934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-17T15:41:29.993733+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-17T15:41:29.993733+0000","last_clean_scrub_stamp":"2024-04-17T15:41:29.993733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:50:02.192795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"130'64","reported_seq":307,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.519997+0000","last_change":"2024-04-17T15:41:35.520062+0000","last_active":"2024-04-17T15:41:35.519997+0000","last_peered":"2024-04-17T15:41:35.519997+0000","last_clean":"2024-04-17T15:41:35.519997+0000","last_became_active":"2024-04-17T15:36:54.172707+0000","last_became_peered":"2024-04-17T15:36:54.172707+0000","last_unstale":"2024-04-17T15:41:35.519997+0000","last_undegraded":"2024-04-17T15:41:35.519997+0000","last_fullsized":"2024-04-17T15:41:35.519997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'64","last_scrub_stamp":"2024-04-17T15:41:35.519801+0000","last_deep_scrub":"130'64","last_deep_scrub_stamp":"2024-04-17T15:41:35.519801+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.519801+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:48.282272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:28.587736+0000","last_change":"2024-04-17T15:41:28.587804+0000","last_active":"2024-04-17T15:41:28.587736+0000","last_peered":"2024-04-17T15:41:28.587736+0000","last_clean":"2024-04-17T15:41:28.587736+0000","last_became_active":"2024-04-17T15:36:56.188594+0000","last_became_peered":"2024-04-17T15:36:56.188594+0000","last_unstale":"2024-04-17T15:41:28.587736+0000","last_undegraded":"2024-04-17T15:41:28.587736+0000","last_fullsized":"2024-04-17T15:41:28.587736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:28.587204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:28.587204+0000","last_clean_scrub_stamp":"2024-04-17T15:41:28.587204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:23.366632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"130'50","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.370927+0000","last_change":"2024-04-17T15:41:30.371062+0000","last_active":"2024-04-17T15:41:30.370927+0000","last_peered":"2024-04-17T15:41:30.370927+0000","last_clean":"2024-04-17T15:41:30.370927+0000","last_became_active":"2024-04-17T15:36:54.194918+0000","last_became_peered":"2024-04-17T15:36:54.194918+0000","last_unstale":"2024-04-17T15:41:30.370927+0000","last_undegraded":"2024-04-17T15:41:30.370927+0000","last_fullsized":"2024-04-17T15:41:30.370927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:30.370687+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:30.370687+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.370687+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:41:10.555528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"73'6","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.387185+0000","last_change":"2024-04-17T15:41:23.387250+0000","last_active":"2024-04-17T15:41:23.387185+0000","last_peered":"2024-04-17T15:41:23.387185+0000","last_clean":"2024-04-17T15:41:23.387185+0000","last_became_active":"2024-04-17T15:36:56.192033+0000","last_became_peered":"2024-04-17T15:36:56.192033+0000","last_unstale":"2024-04-17T15:41:23.387185+0000","last_undegraded":"2024-04-17T15:41:23.387185+0000","last_fullsized":"2024-04-17T15:41:23.387185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'6","last_scrub_stamp":"2024-04-17T15:41:23.386978+0000","last_deep_scrub":"73'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.386978+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.386978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:00:28.652613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"130'42","reported_seq":284,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:45.728250+0000","last_change":"2024-04-17T15:41:45.728311+0000","last_active":"2024-04-17T15:41:45.728250+0000","last_peered":"2024-04-17T15:41:45.728250+0000","last_clean":"2024-04-17T15:41:45.728250+0000","last_became_active":"2024-04-17T15:36:54.181138+0000","last_became_peered":"2024-04-17T15:36:54.181138+0000","last_unstale":"2024-04-17T15:41:45.728250+0000","last_undegraded":"2024-04-17T15:41:45.728250+0000","last_fullsized":"2024-04-17T15:41:45.728250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'42","last_scrub_stamp":"2024-04-17T15:41:45.728032+0000","last_deep_scrub":"130'42","last_deep_scrub_stamp":"2024-04-17T15:41:45.728032+0000","last_clean_scrub_stamp":"2024-04-17T15:41:45.728032+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:29:26.628351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"90'6","reported_seq":264,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:23.601066+0000","last_change":"2024-04-17T15:41:23.601066+0000","last_active":"2024-04-17T15:41:23.601066+0000","last_peered":"2024-04-17T15:41:23.601066+0000","last_clean":"2024-04-17T15:41:23.601066+0000","last_became_active":"2024-04-17T15:36:56.198444+0000","last_became_peered":"2024-04-17T15:36:56.198444+0000","last_unstale":"2024-04-17T15:41:23.601066+0000","last_undegraded":"2024-04-17T15:41:23.601066+0000","last_fullsized":"2024-04-17T15:41:23.601066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-17T15:41:23.600781+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-17T15:41:23.600781+0000","last_clean_scrub_stamp":"2024-04-17T15:41:23.600781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:49:55.799844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"130'50","reported_seq":293,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:43.168205+0000","last_change":"2024-04-17T15:41:43.168269+0000","last_active":"2024-04-17T15:41:43.168205+0000","last_peered":"2024-04-17T15:41:43.168205+0000","last_clean":"2024-04-17T15:41:43.168205+0000","last_became_active":"2024-04-17T15:36:54.173340+0000","last_became_peered":"2024-04-17T15:36:54.173340+0000","last_unstale":"2024-04-17T15:41:43.168205+0000","last_undegraded":"2024-04-17T15:41:43.168205+0000","last_fullsized":"2024-04-17T15:41:43.168205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'50","last_scrub_stamp":"2024-04-17T15:41:43.167980+0000","last_deep_scrub":"130'50","last_deep_scrub_stamp":"2024-04-17T15:41:43.167980+0000","last_clean_scrub_stamp":"2024-04-17T15:41:43.167980+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:44:34.246920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"90'16","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:32.979375+0000","last_change":"2024-04-17T15:41:32.979375+0000","last_active":"2024-04-17T15:41:32.979375+0000","last_peered":"2024-04-17T15:41:32.979375+0000","last_clean":"2024-04-17T15:41:32.979375+0000","last_became_active":"2024-04-17T15:36:56.187963+0000","last_became_peered":"2024-04-17T15:36:56.187963+0000","last_unstale":"2024-04-17T15:41:32.979375+0000","last_undegraded":"2024-04-17T15:41:32.979375+0000","last_fullsized":"2024-04-17T15:41:32.979375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'16","last_scrub_stamp":"2024-04-17T15:41:32.979109+0000","last_deep_scrub":"90'16","last_deep_scrub_stamp":"2024-04-17T15:41:32.979109+0000","last_clean_scrub_stamp":"2024-04-17T15:41:32.979109+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:34:16.937759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"130'44","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:46.709359+0000","last_change":"2024-04-17T15:41:46.709523+0000","last_active":"2024-04-17T15:41:46.709359+0000","last_peered":"2024-04-17T15:41:46.709359+0000","last_clean":"2024-04-17T15:41:46.709359+0000","last_became_active":"2024-04-17T15:36:54.185783+0000","last_became_peered":"2024-04-17T15:36:54.185783+0000","last_unstale":"2024-04-17T15:41:46.709359+0000","last_undegraded":"2024-04-17T15:41:46.709359+0000","last_fullsized":"2024-04-17T15:41:46.709359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'44","last_scrub_stamp":"2024-04-17T15:41:46.709131+0000","last_deep_scrub":"130'44","last_deep_scrub_stamp":"2024-04-17T15:41:46.709131+0000","last_clean_scrub_stamp":"2024-04-17T15:41:46.709131+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:29:48.915395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:25.852878+0000","last_change":"2024-04-17T15:41:25.852878+0000","last_active":"2024-04-17T15:41:25.852878+0000","last_peered":"2024-04-17T15:41:25.852878+0000","last_clean":"2024-04-17T15:41:25.852878+0000","last_became_active":"2024-04-17T15:36:56.192883+0000","last_became_peered":"2024-04-17T15:36:56.192883+0000","last_unstale":"2024-04-17T15:41:25.852878+0000","last_undegraded":"2024-04-17T15:41:25.852878+0000","last_fullsized":"2024-04-17T15:41:25.852878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:25.852499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:25.852499+0000","last_clean_scrub_stamp":"2024-04-17T15:41:25.852499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:36:40.255637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"130'48","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:31.892041+0000","last_change":"2024-04-17T15:41:31.892222+0000","last_active":"2024-04-17T15:41:31.892041+0000","last_peered":"2024-04-17T15:41:31.892041+0000","last_clean":"2024-04-17T15:41:31.892041+0000","last_became_active":"2024-04-17T15:36:54.199941+0000","last_became_peered":"2024-04-17T15:36:54.199941+0000","last_unstale":"2024-04-17T15:41:31.892041+0000","last_undegraded":"2024-04-17T15:41:31.892041+0000","last_fullsized":"2024-04-17T15:41:31.892041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'48","last_scrub_stamp":"2024-04-17T15:41:31.891738+0000","last_deep_scrub":"130'48","last_deep_scrub_stamp":"2024-04-17T15:41:31.891738+0000","last_clean_scrub_stamp":"2024-04-17T15:41:31.891738+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:50:57.269411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"112'4","reported_seq":253,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.005508+0000","last_change":"2024-04-17T15:41:27.005573+0000","last_active":"2024-04-17T15:41:27.005508+0000","last_peered":"2024-04-17T15:41:27.005508+0000","last_clean":"2024-04-17T15:41:27.005508+0000","last_became_active":"2024-04-17T15:36:56.198493+0000","last_became_peered":"2024-04-17T15:36:56.198493+0000","last_unstale":"2024-04-17T15:41:27.005508+0000","last_undegraded":"2024-04-17T15:41:27.005508+0000","last_fullsized":"2024-04-17T15:41:27.005508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'4","last_scrub_stamp":"2024-04-17T15:41:27.005304+0000","last_deep_scrub":"112'4","last_deep_scrub_stamp":"2024-04-17T15:41:27.005304+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.005304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:44:14.664016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"130'52","reported_seq":295,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.651677+0000","last_change":"2024-04-17T15:41:44.651820+0000","last_active":"2024-04-17T15:41:44.651677+0000","last_peered":"2024-04-17T15:41:44.651677+0000","last_clean":"2024-04-17T15:41:44.651677+0000","last_became_active":"2024-04-17T15:36:54.193676+0000","last_became_peered":"2024-04-17T15:36:54.193676+0000","last_unstale":"2024-04-17T15:41:44.651677+0000","last_undegraded":"2024-04-17T15:41:44.651677+0000","last_fullsized":"2024-04-17T15:41:44.651677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'52","last_scrub_stamp":"2024-04-17T15:41:44.651437+0000","last_deep_scrub":"130'52","last_deep_scrub_stamp":"2024-04-17T15:41:44.651437+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.651437+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:35:36.794558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":236,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:26.541354+0000","last_change":"2024-04-17T15:41:26.541416+0000","last_active":"2024-04-17T15:41:26.541354+0000","last_peered":"2024-04-17T15:41:26.541354+0000","last_clean":"2024-04-17T15:41:26.541354+0000","last_became_active":"2024-04-17T15:36:56.196819+0000","last_became_peered":"2024-04-17T15:36:56.196819+0000","last_unstale":"2024-04-17T15:41:26.541354+0000","last_undegraded":"2024-04-17T15:41:26.541354+0000","last_fullsized":"2024-04-17T15:41:26.541354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:26.541147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:26.541147+0000","last_clean_scrub_stamp":"2024-04-17T15:41:26.541147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:29.507403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"130'58","reported_seq":300,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.384677+0000","last_change":"2024-04-17T15:41:33.384740+0000","last_active":"2024-04-17T15:41:33.384677+0000","last_peered":"2024-04-17T15:41:33.384677+0000","last_clean":"2024-04-17T15:41:33.384677+0000","last_became_active":"2024-04-17T15:36:54.209521+0000","last_became_peered":"2024-04-17T15:36:54.209521+0000","last_unstale":"2024-04-17T15:41:33.384677+0000","last_undegraded":"2024-04-17T15:41:33.384677+0000","last_fullsized":"2024-04-17T15:41:33.384677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'58","last_scrub_stamp":"2024-04-17T15:41:33.384469+0000","last_deep_scrub":"130'58","last_deep_scrub_stamp":"2024-04-17T15:41:33.384469+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.384469+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:09.392994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.691041+0000","last_change":"2024-04-17T15:41:33.691101+0000","last_active":"2024-04-17T15:41:33.691041+0000","last_peered":"2024-04-17T15:41:33.691041+0000","last_clean":"2024-04-17T15:41:33.691041+0000","last_became_active":"2024-04-17T15:36:56.191165+0000","last_became_peered":"2024-04-17T15:36:56.191165+0000","last_unstale":"2024-04-17T15:41:33.691041+0000","last_undegraded":"2024-04-17T15:41:33.691041+0000","last_fullsized":"2024-04-17T15:41:33.691041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T15:41:33.690823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T15:41:33.690823+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.690823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:24:48.637788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"130'40","reported_seq":280,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:44.592949+0000","last_change":"2024-04-17T15:41:44.593121+0000","last_active":"2024-04-17T15:41:44.592949+0000","last_peered":"2024-04-17T15:41:44.592949+0000","last_clean":"2024-04-17T15:41:44.592949+0000","last_became_active":"2024-04-17T15:36:54.206148+0000","last_became_peered":"2024-04-17T15:36:54.206148+0000","last_unstale":"2024-04-17T15:41:44.592949+0000","last_undegraded":"2024-04-17T15:41:44.592949+0000","last_fullsized":"2024-04-17T15:41:44.592949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'40","last_scrub_stamp":"2024-04-17T15:41:44.592710+0000","last_deep_scrub":"130'40","last_deep_scrub_stamp":"2024-04-17T15:41:44.592710+0000","last_clean_scrub_stamp":"2024-04-17T15:41:44.592710+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:10:39.602310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"71'2","reported_seq":197,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:35.877036+0000","last_change":"2024-04-17T15:41:35.877036+0000","last_active":"2024-04-17T15:41:35.877036+0000","last_peered":"2024-04-17T15:41:35.877036+0000","last_clean":"2024-04-17T15:41:35.877036+0000","last_became_active":"2024-04-17T15:37:41.530941+0000","last_became_peered":"2024-04-17T15:37:41.530941+0000","last_unstale":"2024-04-17T15:41:35.877036+0000","last_undegraded":"2024-04-17T15:41:35.877036+0000","last_fullsized":"2024-04-17T15:41:35.877036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-17T15:41:35.876770+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-17T15:41:35.876770+0000","last_clean_scrub_stamp":"2024-04-17T15:41:35.876770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:04.436894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"130'32","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.890286+0000","last_change":"2024-04-17T15:41:22.890286+0000","last_active":"2024-04-17T15:41:22.890286+0000","last_peered":"2024-04-17T15:41:22.890286+0000","last_clean":"2024-04-17T15:41:22.890286+0000","last_became_active":"2024-04-17T15:36:54.188709+0000","last_became_peered":"2024-04-17T15:36:54.188709+0000","last_unstale":"2024-04-17T15:41:22.890286+0000","last_undegraded":"2024-04-17T15:41:22.890286+0000","last_fullsized":"2024-04-17T15:41:22.890286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'32","last_scrub_stamp":"2024-04-17T15:41:22.890024+0000","last_deep_scrub":"130'32","last_deep_scrub_stamp":"2024-04-17T15:41:22.890024+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.890024+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:00:49.597161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:24.502757+0000","last_change":"2024-04-17T15:41:24.502823+0000","last_active":"2024-04-17T15:41:24.502757+0000","last_peered":"2024-04-17T15:41:24.502757+0000","last_clean":"2024-04-17T15:41:24.502757+0000","last_became_active":"2024-04-17T15:36:56.195657+0000","last_became_peered":"2024-04-17T15:36:56.195657+0000","last_unstale":"2024-04-17T15:41:24.502757+0000","last_undegraded":"2024-04-17T15:41:24.502757+0000","last_fullsized":"2024-04-17T15:41:24.502757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-17T15:41:24.502560+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-17T15:41:24.502560+0000","last_clean_scrub_stamp":"2024-04-17T15:41:24.502560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:35:00.511085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"130'46","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:33.837117+0000","last_change":"2024-04-17T15:41:33.837182+0000","last_active":"2024-04-17T15:41:33.837117+0000","last_peered":"2024-04-17T15:41:33.837117+0000","last_clean":"2024-04-17T15:41:33.837117+0000","last_became_active":"2024-04-17T15:37:41.352702+0000","last_became_peered":"2024-04-17T15:37:41.352702+0000","last_unstale":"2024-04-17T15:41:33.837117+0000","last_undegraded":"2024-04-17T15:41:33.837117+0000","last_fullsized":"2024-04-17T15:41:33.837117+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'46","last_scrub_stamp":"2024-04-17T15:41:33.836927+0000","last_deep_scrub":"130'46","last_deep_scrub_stamp":"2024-04-17T15:41:33.836927+0000","last_clean_scrub_stamp":"2024-04-17T15:41:33.836927+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:19.751050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"130'66","reported_seq":308,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:38.048431+0000","last_change":"2024-04-17T15:41:38.048494+0000","last_active":"2024-04-17T15:41:38.048431+0000","last_peered":"2024-04-17T15:41:38.048431+0000","last_clean":"2024-04-17T15:41:38.048431+0000","last_became_active":"2024-04-17T15:36:54.176264+0000","last_became_peered":"2024-04-17T15:36:54.176264+0000","last_unstale":"2024-04-17T15:41:38.048431+0000","last_undegraded":"2024-04-17T15:41:38.048431+0000","last_fullsized":"2024-04-17T15:41:38.048431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'66","last_scrub_stamp":"2024-04-17T15:41:38.048232+0000","last_deep_scrub":"130'66","last_deep_scrub_stamp":"2024-04-17T15:41:38.048232+0000","last_clean_scrub_stamp":"2024-04-17T15:41:38.048232+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:17:27.850025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"72'2","reported_seq":247,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:22.601697+0000","last_change":"2024-04-17T15:41:22.601697+0000","last_active":"2024-04-17T15:41:22.601697+0000","last_peered":"2024-04-17T15:41:22.601697+0000","last_clean":"2024-04-17T15:41:22.601697+0000","last_became_active":"2024-04-17T15:36:56.198491+0000","last_became_peered":"2024-04-17T15:36:56.198491+0000","last_unstale":"2024-04-17T15:41:22.601697+0000","last_undegraded":"2024-04-17T15:41:22.601697+0000","last_fullsized":"2024-04-17T15:41:22.601697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-17T15:41:22.601419+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-17T15:41:22.601419+0000","last_clean_scrub_stamp":"2024-04-17T15:41:22.601419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:00.013870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"130'28","reported_seq":271,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:30.529620+0000","last_change":"2024-04-17T15:41:30.529620+0000","last_active":"2024-04-17T15:41:30.529620+0000","last_peered":"2024-04-17T15:41:30.529620+0000","last_clean":"2024-04-17T15:41:30.529620+0000","last_became_active":"2024-04-17T15:36:54.162702+0000","last_became_peered":"2024-04-17T15:36:54.162702+0000","last_unstale":"2024-04-17T15:41:30.529620+0000","last_undegraded":"2024-04-17T15:41:30.529620+0000","last_fullsized":"2024-04-17T15:41:30.529620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'28","last_scrub_stamp":"2024-04-17T15:41:30.529343+0000","last_deep_scrub":"130'28","last_deep_scrub_stamp":"2024-04-17T15:41:30.529343+0000","last_clean_scrub_stamp":"2024-04-17T15:41:30.529343+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:06:00.524787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'4","reported_seq":256,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-17T15:41:27.858404+0000","last_change":"2024-04-17T15:41:27.858404+0000","last_active":"2024-04-17T15:41:27.858404+0000","last_peered":"2024-04-17T15:41:27.858404+0000","last_clean":"2024-04-17T15:41:27.858404+0000","last_became_active":"2024-04-17T15:36:56.205417+0000","last_became_peered":"2024-04-17T15:36:56.205417+0000","last_unstale":"2024-04-17T15:41:27.858404+0000","last_undegraded":"2024-04-17T15:41:27.858404+0000","last_fullsized":"2024-04-17T15:41:27.858404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-17T15:41:27.858121+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-17T15:41:27.858121+0000","last_clean_scrub_stamp":"2024-04-17T15:41:27.858121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:14:05.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1107,"ondisk_log_size":1107,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1539,"num_write":537,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1498,"num_read_kb":1466,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542216,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37484,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334356,"statfs":{"total":96636764160,"available":96598380544,"internally_reserved":0,"allocated":2199552,"data_stored":1519562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542215,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1581056,"data_stored":928534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542215,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":929809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542215,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1568768,"data_stored":928032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542214,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36908,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334932,"statfs":{"total":96636764160,"available":96598970368,"internally_reserved":0,"allocated":1609728,"data_stored":930326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542215,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1568768,"data_stored":928096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36904,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334936,"statfs":{"total":96636764160,"available":96598974464,"internally_reserved":0,"allocated":1605632,"data_stored":929612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542214,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37468,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334372,"statfs":{"total":96636764160,"available":96598396928,"internally_reserved":0,"allocated":2183168,"data_stored":1519961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T15:42:19.224 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-17T15:42:19.579 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-17T15:42:19.579 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-17T15:42:19.579 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-17T15:42:19.579 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:19.647 INFO:tasks.ceph.osd.0:Stopped 2024-04-17T15:42:19.647 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-17T15:42:19.647 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:19.738 INFO:tasks.ceph.osd.1:Stopped 2024-04-17T15:42:19.738 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-17T15:42:19.738 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:19.819 INFO:tasks.ceph.osd.2:Stopped 2024-04-17T15:42:19.820 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-17T15:42:19.820 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:19.910 INFO:tasks.ceph.osd.3:Stopped 2024-04-17T15:42:19.910 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-17T15:42:19.910 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:19.978 INFO:tasks.ceph.osd.4:Stopped 2024-04-17T15:42:19.979 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-17T15:42:19.979 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:20.059 INFO:tasks.ceph.osd.5:Stopped 2024-04-17T15:42:20.059 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-17T15:42:20.059 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:20.138 INFO:tasks.ceph.osd.6:Stopped 2024-04-17T15:42:20.139 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-17T15:42:20.139 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:23.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-17T15:42:26.241 INFO:tasks.ceph.osd.7:Stopped 2024-04-17T15:42:26.241 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-17T15:42:26.241 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-17T15:42:26.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:26.271 INFO:tasks.ceph.mgr.y:Stopped 2024-04-17T15:42:26.271 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-17T15:42:26.272 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:26.301 INFO:tasks.ceph.mgr.x:Stopped 2024-04-17T15:42:26.301 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-17T15:42:26.301 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-17T15:42:26.301 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:26.334 INFO:tasks.ceph.mon.a:Stopped 2024-04-17T15:42:26.335 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-17T15:42:26.335 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:26.394 INFO:tasks.ceph.mon.c:Stopped 2024-04-17T15:42:26.395 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-17T15:42:26.395 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T15:42:26.420 INFO:tasks.ceph.mon.b:Stopped 2024-04-17T15:42:26.420 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-17T15:42:26.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-17T15:42:26.456 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:42:26.456 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-17T15:42:26.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:42:26.756 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-17T15:42:27.085 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:42:27.085 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-17T15:42:27.259 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:42:27.259 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-17T15:42:27.435 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:42:27.435 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-17T15:42:27.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:42:27.615 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-17T15:42:27.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:42:27.835 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-17T15:42:28.035 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:42:28.035 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-17T15:42:28.220 INFO:tasks.ceph:Archiving mon data... 2024-04-17T15:42:28.221 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/data/mon.a.tgz 2024-04-17T15:42:28.221 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-04-17T15:42:28.228 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.OiN8SXfkbn 2024-04-17T15:42:28.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OiN8SXfkbn 2024-04-17T15:42:28.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-17T15:42:28.414 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.OiN8SXfkbn 2024-04-17T15:42:28.474 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.OiN8SXfkbn is 618KB 2024-04-17T15:42:28.537 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.OiN8SXfkbn 2024-04-17T15:42:28.542 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/data/mon.c.tgz 2024-04-17T15:42:28.542 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-04-17T15:42:28.591 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.eh5F7QTaN7 2024-04-17T15:42:28.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.eh5F7QTaN7 2024-04-17T15:42:28.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.eh5F7QTaN7 2024-04-17T15:42:28.882 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.eh5F7QTaN7 is 788KB 2024-04-17T15:42:28.949 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.eh5F7QTaN7 2024-04-17T15:42:28.954 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/data/mon.b.tgz 2024-04-17T15:42:28.954 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-04-17T15:42:28.962 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.HYyL6NoO95 2024-04-17T15:42:28.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HYyL6NoO95 2024-04-17T15:42:29.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.HYyL6NoO95 2024-04-17T15:42:29.257 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.HYyL6NoO95 is 788KB 2024-04-17T15:42:29.362 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.HYyL6NoO95 2024-04-17T15:42:29.370 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-17T15:42:29.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T15:42:29.372 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T15:42:29.431 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T15:42:29.472 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T15:42:29.472 INFO:tasks.ceph:Archiving crash dumps... 2024-04-17T15:42:29.473 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/remote/smithi044/crash 2024-04-17T15:42:29.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T15:42:29.491 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/remote/smithi063/crash 2024-04-17T15:42:29.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T15:42:29.528 INFO:tasks.ceph:Compressing logs... 2024-04-17T15:42:29.528 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T15:42:29.536 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T15:42:29.557 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58473.log 2024-04-17T15:42:29.557 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62197.log 2024-04-17T15:42:29.557 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58473.log.gz 2024-04-17T15:42:29.558 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64224.log 2024-04-17T15:42:29.559 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58432.log 2024-04-17T15:42:29.559 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62197.log: /var/log/ceph/ceph-client.admin.64224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62197.log.gz 2024-04-17T15:42:29.559 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66017.log 2024-04-17T15:42:29.559 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64224.log.gz 2024-04-17T15:42:29.559 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-17T15:42:29.560 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58432.log.gz 2024-04-17T15:42:29.560 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66017.log.gz 2024-04-17T15:42:29.560 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53277.log 2024-04-17T15:42:29.560 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68016.log 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66381.log 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53277.log.gz 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57118.log 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68016.log.gz 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34747.log 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66381.log.gz 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34014.log 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57118.log.gz 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65088.log 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34747.log.gz 2024-04-17T15:42:29.566 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34014.log.gz 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66680.log 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43943.log 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65088.log.gz 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66680.log.gz 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43943.log.gz 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62078.log 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54563.log 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62078.log.gz 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54563.log.gz 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2024-04-17T15:42:29.567 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29969.log 2024-04-17T15:42:29.568 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65960.log 2024-04-17T15:42:29.568 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67083.log 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29969.log.gz 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.65960.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39145.log 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65960.log.gz 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67083.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67083.log.gz -5 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66043.log 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33013.log 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39145.log.gz 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68120.log 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66043.log.gz 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59948.log 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-04-17T15:42:29.573 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62352.log 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68120.log.gz 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59948.log.gz 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62285.log 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62352.log.gz 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58514.log 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30583.log 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62285.log.gz 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53097.log 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58514.log.gz 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66481.log 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30583.log.gz 2024-04-17T15:42:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67964.log 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53097.log.gz 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30176.log 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66481.log.gz 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30364.log 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67964.log.gz 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30176.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30176.log.gz 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30364.log.gzgzip 2024-04-17T15:42:29.575 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67808.log 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62103.log 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66484.log 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67808.log.gz 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62103.log.gz 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61575.log 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68328.log 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66484.log.gz 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61575.log.gz 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33599.log 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34249.log 0.0% 2024-04-17T15:42:29.597 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68328.log.gz 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33599.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.60540.log -- replaced with /var/log/ceph/ceph-client.admin.33599.log.gz 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61708.log 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34249.log.gz 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60540.log.gz 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64842.log 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61708.log.gz 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66683.log 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.64842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34040.log 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64842.log.gz 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66683.log.gz 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47492.log 2024-04-17T15:42:29.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34040.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34040.log.gz 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30110.log 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47492.log.gz 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32366.log 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33062.log 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30110.log.gz 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32366.log.gz 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33939.log 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54134.log 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33062.log.gz 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33939.log.gz 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61885.log 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66897.log 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54134.log.gz 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61885.log.gz 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30578.log 2024-04-17T15:42:29.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66487.log 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66897.log.gz 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30578.log.gz 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66173.log 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68302.log 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66487.log.gz 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66173.log.gz 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33461.log 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68068.log 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68302.log.gz 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33461.log.gz 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32716.log 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68068.log.gz 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65236.log 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68380.log 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32716.log.gz 2024-04-17T15:42:29.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37313.log 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65236.log.gz 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68380.log.gz 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33884.log 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66673.log 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37313.log.gz 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33884.log.gz 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62032.log 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30060.log 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66673.log.gz 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62032.log.gz 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66407.log 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30165.log 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30060.log.gz 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60634.log 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66407.log.gz 2024-04-17T15:42:29.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30165.log.gz 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66251.log 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60634.log.gz 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54052.log 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66251.log.gz 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60581.log 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54052.log.gz 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34773.log 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60581.log.gz 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62291.log 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34773.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34773.log.gz 2024-04-17T15:42:29.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62291.log.gz 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30772.log 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34215.log 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30772.log.gz 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62257.log 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32233.log 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34215.log: /var/log/ceph/ceph-client.admin.62257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62257.log.gz 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34215.log.gz 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29944.log 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54415.log 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32233.log.gz 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29944.log.gz 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67782.log 2024-04-17T15:42:29.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57574.log 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54415.log: /var/log/ceph/ceph-client.admin.67782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54415.log.gz 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67782.log.gz 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68250.log 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61915.log 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57574.log.gz 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68250.log.gz 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40951.log 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33169.log 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61915.log: /var/log/ceph/ceph-client.admin.40951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61915.log.gz 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.40951.log.gz --verbose 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.admin.57049.log 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33169.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.34429.log -- replaced with /var/log/ceph/ceph-client.admin.33169.log.gz 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58675.log 2024-04-17T15:42:29.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57049.log.gz 2024-04-17T15:42:29.605 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-04-17T15:42:29.605 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34504.log 2024-04-17T15:42:29.605 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48108.log 2024-04-17T15:42:29.605 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58675.log.gz 2024-04-17T15:42:29.605 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34504.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-17T15:42:29.605 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34504.log.gz 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25153.log 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25153.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25153.log.gz 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25177.log 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25201.log 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25177.log.gz 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25057.log 2024-04-17T15:42:29.618 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25201.log.gz 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.25057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25033.log 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25057.log.gz 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25081.log 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25033.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25033.log.gz 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25129.log 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25081.log.gz 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25105.log 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.25129.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25129.log.gz 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25105.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25105.log.gz 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-17T15:42:29.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T15:42:29.620 INFO:teuthology.orchestra.run.smithi063.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-17T15:42:29.654 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48108.log.gz 2024-04-17T15:42:29.654 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33376.log 2024-04-17T15:42:29.654 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31857.log 2024-04-17T15:42:29.654 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.33376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68094.log 2024-04-17T15:42:29.654 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33376.log.gz 2024-04-17T15:42:29.654 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31857.log.gz 2024-04-17T15:42:29.654 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58320.log 2024-04-17T15:42:29.654 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53199.log 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68094.log.gz 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58320.log.gz 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41541.log 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53199.log.gz 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33264.log 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41541.log.gz 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66905.log 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34107.log 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33264.log.gz 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66905.log.gz 2024-04-17T15:42:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66898.log 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30166.log 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34107.log.gz 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66898.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.66898.log.gz 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30171.log 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34046.log 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30166.log.gz 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30171.log.gz 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46896.log 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66121.log 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34046.log.gz 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46896.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46896.log.gz -- 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.53030.log 2024-04-17T15:42:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30824.log 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66121.log.gz 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53030.log.gz 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61822.log 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58613.log 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30824.log.gz 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61822.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.61822.log.gz 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60940.log 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55251.log 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58613.log.gz 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68042.log 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60940.log.gz 2024-04-17T15:42:29.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55251.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.55251.log.gz 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66899.log 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62394.log 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68042.log.gz 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66899.log.gz 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33302.log 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30874.log 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62394.log.gz 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30611.log 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33302.log.gz 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34343.log 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30874.log.gz 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65267.log 2024-04-17T15:42:29.658 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30611.log.gz 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65175.log 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34343.log.gz 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32766.log 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65267.log.gz 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68146.log 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65175.log.gz 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32766.log.gz 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24914.log 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30924.log 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68146.log.gz 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24914.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.24914.log.gz 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34632.log 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32576.log 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30924.log.gz 2024-04-17T15:42:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34632.log.gz 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33796.log 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35431.log 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32576.log.gz 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51732.log 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33796.log.gz 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33659.log 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35431.log.gz 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43327.log 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51732.log.gz 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61972.log 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33659.log.gz 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43327.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43327.log.gz 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53976.log 2024-04-17T15:42:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61972.log.gz 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32098.log 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68276.log 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53976.log.gz 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68172.log 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32098.log.gz 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68276.log: /var/log/ceph/ceph-client.admin.68172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68276.log.gz 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67912.log 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68172.log.gz 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36717.log 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35308.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35230.log 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67912.log: /var/log/ceph/ceph-client.admin.36717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67912.log.gz 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36717.log.gz 2024-04-17T15:42:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31603.log 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67161.log 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35230.log.gz 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57206.log 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31603.log.gz 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67161.log.gz 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30374.log 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32258.log 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57206.log.gz 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30374.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.30612.log 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30374.log.gz 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38549.log 2024-04-17T15:42:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32258.log.gz 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30354.log 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30612.log.gz 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38549.log.gz 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61754.log 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30354.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30354.log.gz 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63006.log 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61754.log.gz 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32419.log 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.63006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63006.log.gz 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66693.log 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68198.log 2024-04-17T15:42:29.663 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32419.log.gz 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66693.log.gz 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66480.log 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66329.log 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68198.log.gz 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66480.log.gz 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57155.log 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66695.log 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66329.log.gz 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57155.log.gz 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30572.log 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57362.log 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66695.log.gz 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30572.log.gz 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40356.log 2024-04-17T15:42:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54213.log 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57362.log.gz 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40356.log.gz 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35111.log 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60815.log 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54213.log.gz 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35111.log.gz 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32300.log 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58588.log 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60815.log.gz 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32300.log.gz 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30564.log 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34154.log 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58588.log.gz 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30564.log.gz 2024-04-17T15:42:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39761.log 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66485.log 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34154.log.gz 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39761.log.gz 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54026.log 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35176.log 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66485.log.gz 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54026.log.gz 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61625.log 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65934.log 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35176.log.gz 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61625.log.gz 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52938.log 2024-04-17T15:42:29.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54480.log 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65934.log.gz 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52938.log.gz 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54605.log 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57321.log 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54480.log.gz 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54605.log.gz 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66479.log 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53926.log 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57321.log: /var/log/ceph/ceph-client.admin.66479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57321.log.gz 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66479.log.gz 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64985.log 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25089.log 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53926.log: /var/log/ceph/ceph-client.admin.64985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53926.log.gz 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64985.log.gz 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65867.log 2024-04-17T15:42:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66199.log 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25089.log.gz 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65867.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66355.log 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66199.log.gz 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66095.log 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30164.log 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66355.log: /var/log/ceph/ceph-client.admin.66095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66355.log.gz 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66095.log.gz 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54168.log 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66147.log 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30164.log: /var/log/ceph/ceph-client.admin.54168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30164.log.gz 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54168.log.gz 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65991.log 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30163.log 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66147.log.gz 2024-04-17T15:42:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65991.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.65991.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.58245.log 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30163.log.gz 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66303.log 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58245.log: /var/log/ceph/ceph-client.admin.66303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58245.log.gz 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66303.log.gz 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32068.log 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32831.log 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.32068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32068.log.gz 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T15:42:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68404.log 2024-04-17T15:42:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59358.log 2024-04-17T15:42:29.703 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32831.log.gz 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64876.log 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68404.log.gz 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59358.log.gz 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60787.log 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53249.log 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.64876.log: /var/log/ceph/ceph-client.admin.60787.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64876.log.gz 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60787.log.gz 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67860.log 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33536.log 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53249.log: /var/log/ceph/ceph-client.admin.67860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53249.log.gz 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67860.log.gz 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55841.log 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32517.log 2024-04-17T15:42:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33536.log.gz 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55841.log.gz 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30361.log 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65022.log 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32517.log: /var/log/ceph/ceph-client.admin.30361.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32517.log.gz 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30361.log.gz 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32856.log 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60878.log 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65022.log: /var/log/ceph/ceph-client.admin.32856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65022.log.gz 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32856.log.gz 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34875.log 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60878.log: /var/log/ceph/ceph-client.admin.34875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60878.log.gz 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34875.log.gz 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49891.log 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33112.log 2024-04-17T15:42:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49891.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33660.log 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33112.log.gz 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66670.log 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54661.log 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33660.log: /var/log/ceph/ceph-client.admin.66670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33660.log.gz 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66670.log.gz 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57503.log 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34932.log 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54661.log.gz 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57503.log.gz 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33729.log 2024-04-17T15:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34932.log.gz 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54324.log 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33729.log.gz 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54324.log.gz 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48703.log 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.c.log: 92.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67886.log 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30384.log 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48703.log.gz/var/log/ceph/ceph-client.admin.67886.log: 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67886.log.gz 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33826.log 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44535.log 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30384.log.gz 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33826.log.gz 2024-04-17T15:42:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66482.log 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32926.log 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44535.log.gz 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66482.log.gz 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30375.log 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64222.log 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32926.log.gz 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30375.log.gz 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54365.log 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.64222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64222.log.gz 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35427.log 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53005.log 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54365.log.gz 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35427.log.gz 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42132.log 2024-04-17T15:42:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34298.log 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53005.log.gz 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42132.log.gz 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66875.log 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67834.log 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34298.log.gz 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66875.log.gz 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31751.log 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67834.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20135.log 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67834.log.gz 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31751.log.gz 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61655.log 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.tmp-client.admin.20135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31629.log 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20135.log.gz 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61655.log.gz 2024-04-17T15:42:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34836.log 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31909.log 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31629.log.gz 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34836.log.gz 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66069.log 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61750.log 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31909.log.gz 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66069.log.gz 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53870.log 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30898.log 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61750.log.gz 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53870.log.gz 2024-04-17T15:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57247.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57544.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30898.log.gz 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57247.log.gz 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33822.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68354.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57544.log.gz 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33822.log.gz 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35533.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68354.log.gz 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32326.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr: 92.0% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35533.log.gz 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30798.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32975.log 2024-04-17T15:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32326.log.gz 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30798.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49297.log 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30798.log.gz 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32975.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64932.log 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68224.log 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.64932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64932.log.gz 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60902.log 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.68224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68224.log.gz 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57023.log 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.60902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60902.log.gz 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30175.log 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57023.log.gz 2024-04-17T15:42:29.712 INFO:teuthology.orchestra.run.smithi044.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39133.log 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34682.log 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30175.log: /var/log/ceph/ceph-client.admin.39133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30175.log.gz 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39133.log.gz 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62145.log 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53121.log 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34682.log.gz 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62145.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63604.log 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53121.log.gz 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58768.log 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63594.log 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.63604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63604.log.gz 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58768.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.58768.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.33985.log 2024-04-17T15:42:29.713 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.63594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63594.log.gz 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32165.log 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33564.log 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33985.log.gz 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32165.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43315.log 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33564.log.gz 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30376.log 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32675.log 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43315.log.gz 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30376.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62223.log 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30376.log.gz 2024-04-17T15:42:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32675.log.gz 2024-04-17T15:42:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34508.log 2024-04-17T15:42:29.751 INFO:teuthology.orchestra.run.smithi063.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-17T15:42:29.757 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62392.log 2024-04-17T15:42:29.757 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62223.log: /var/log/ceph/ceph-client.admin.34508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62223.log.gz 2024-04-17T15:42:29.757 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34508.log.gz 2024-04-17T15:42:29.757 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61919.log 2024-04-17T15:42:29.757 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30383.log 2024-04-17T15:42:29.757 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62392.log.gz 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61919.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.61919.log.gz 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46306.log 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30383.log.gz 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65908.log 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66277.log 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46306.log: /var/log/ceph/ceph-client.admin.65908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46306.log.gz 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65908.log.gz 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32040.log 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45125.log 2024-04-17T15:42:29.758 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66277.log.gz 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32040.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66883.log 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45125.log.gz 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33753.log 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34933.log 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66883.log: /var/log/ceph/ceph-client.admin.33753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66883.log.gz 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33753.log.gz 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65125.log 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25171.log 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34933.log.gz 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.65125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65125.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66225.log 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25171.log.gz 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35085.log 2024-04-17T15:42:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30571.log 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66225.log: /var/log/ceph/ceph-client.admin.35085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66225.log.gz 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35085.log.gz 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66486.log 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67109.log 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30571.log: /var/log/ceph/ceph-client.admin.66486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30571.log.gz 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66486.log.gz 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60696.log 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31951.log 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67109.log: /var/log/ceph/ceph-client.admin.60696.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67109.log.gz 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60696.log.gz 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60722.log 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32157.log 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31951.log: /var/log/ceph/ceph-client.admin.60722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31951.log.gz 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60722.log.gz 2024-04-17T15:42:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31749.log 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32157.log: /var/log/ceph/ceph-client.admin.33352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32157.log.gz 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42723.log 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31749.log.gz 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42723.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58275.log 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42723.log.gz 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37955.log 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66694.log 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58275.log.gz 2024-04-17T15:42:29.761 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37955.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30023.log 2024-04-17T15:42:29.762 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37955.log.gz 2024-04-17T15:42:29.762 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66694.log.gz 2024-04-17T15:42:29.762 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51142.log 2024-04-17T15:42:29.762 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66433.log 2024-04-17T15:42:29.762 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30023.log.gz 2024-04-17T15:42:29.762 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51142.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31655.log 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51142.log.gz 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66433.log.gz 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34405.log 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66882.log 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31655.log.gz 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34405.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30167.log 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66882.log.gz 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62149.log 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67189.log 2024-04-17T15:42:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30167.log.gz 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.62149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62149.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36127.log 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.67189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67189.log.gz 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33195.log 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32629.log 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36127.log.gz 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33195.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.33510.log -- replaced with /var/log/ceph/ceph-client.admin.33195.log.gz 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32629.log.gz 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66676.log 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57388.log 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33510.log.gz 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.66676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66676.log.gz 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50490.log 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57388.log.gz 2024-04-17T15:42:29.764 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31976.log 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58358.log 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50490.log: /var/log/ceph/ceph-client.admin.31976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50490.log.gz 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31976.log.gz 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56431.log 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64873.log 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58358.log.gz 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56431.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54506.log 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.64873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64873.log.gz 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52322.log 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35271.log 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54506.log.gz 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52322.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30848.log 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52322.log.gz 2024-04-17T15:42:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35271.log.gz 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32493.log 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67938.log 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30848.log.gz 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32493.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30584.log 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32493.log.gz 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67938.log.gz 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57469.log 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67135.log 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.30584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30584.log.gz 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57469.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54246.log 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57469.log.gz 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67135.log.gz 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31946.log 2024-04-17T15:42:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57645.log 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54246.log.gz 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.31946.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58683.log 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31946.log.gz 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57645.log.gz 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67990.log 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50487.log 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58683.log.gz 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.67990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67990.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32352.log 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50487.log.gz 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66896.log 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61821.log 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.32352.log: /var/log/ceph/ceph-client.admin.66896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32352.log.gz 2024-04-17T15:42:29.767 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66896.log.gz 2024-04-17T15:42:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29997.log 2024-04-17T15:42:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52914.log 2024-04-17T15:42:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.61821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61821.log.gz 2024-04-17T15:42:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29997.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34591.log 2024-04-17T15:42:29.768 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29997.log.gz 2024-04-17T15:42:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52914.log.gz 2024-04-17T15:42:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34591.log.gz 2024-04-17T15:42:29.896 INFO:teuthology.orchestra.run.smithi044.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-17T15:42:30.044 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-17T15:42:30.244 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-17T15:42:30.334 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-17T15:42:30.430 INFO:teuthology.orchestra.run.smithi063.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-17T15:42:30.465 INFO:teuthology.orchestra.run.smithi063.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-17T15:42:30.488 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-17T15:42:30.490 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-04-17T15:42:30.490 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m0.911s 2024-04-17T15:42:30.490 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m3.316s 2024-04-17T15:42:30.490 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m0.163s 2024-04-17T15:42:30.531 INFO:teuthology.orchestra.run.smithi044.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-17T15:42:30.562 INFO:teuthology.orchestra.run.smithi044.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-17T15:42:30.715 INFO:teuthology.orchestra.run.smithi044.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-17T15:42:30.716 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-17T15:42:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m1.178s 2024-04-17T15:42:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m4.567s 2024-04-17T15:42:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.227s 2024-04-17T15:42:30.717 INFO:tasks.ceph:Archiving logs... 2024-04-17T15:42:30.717 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/remote/smithi044/log 2024-04-17T15:42:30.718 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T15:42:31.548 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/remote/smithi063/log 2024-04-17T15:42:31.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T15:42:31.956 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-17T15:42:31.965 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-17T15:42:31.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T15:42:31.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T15:42:32.050 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-17T15:42:32.059 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-17T15:42:32.060 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T15:42:32.062 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T15:42:32.073 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T15:42:32.074 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2024-04-17T15:42:32.074 INFO:teuthology.orchestra.run.smithi063.stdout:+hv01.front.sepi 67.205.162.81 3 u 28 64 377 0.055 -2.692 0.060 2024-04-17T15:42:32.074 INFO:teuthology.orchestra.run.smithi063.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 64 377 0.092 -0.081 0.063 2024-04-17T15:42:32.074 INFO:teuthology.orchestra.run.smithi063.stdout:*hv03.front.sepi 74.6.168.72 3 u 22 64 377 0.089 -0.412 0.094 2024-04-17T15:42:32.074 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-17T15:42:32.075 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T15:42:32.076 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-04-17T15:42:32.076 INFO:teuthology.orchestra.run.smithi044.stdout:+hv01.front.sepi 67.205.162.81 3 u 25 64 377 0.060 -1.774 1.365 2024-04-17T15:42:32.076 INFO:teuthology.orchestra.run.smithi044.stdout:+hv02.front.sepi 63.231.80.2 3 u 22 64 377 0.087 -0.376 0.937 2024-04-17T15:42:32.076 INFO:teuthology.orchestra.run.smithi044.stdout:*hv03.front.sepi 74.6.168.72 3 u 30 64 377 0.080 -1.339 1.356 2024-04-17T15:42:32.076 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-17T15:42:32.076 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-17T15:42:32.085 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-17T15:42:32.085 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-17T15:42:32.094 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-17T15:42:32.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-17T15:42:32.111 INFO:teuthology.task.internal:Duration was 1140.448653 seconds 2024-04-17T15:42:32.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-17T15:42:32.120 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-17T15:42:32.120 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T15:42:32.123 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T15:42:32.162 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-17T15:42:32.162 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-04-17T15:42:32.162 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T15:42:32.212 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-04-17T15:42:32.213 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T15:42:32.223 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-17T15:42:32.223 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T15:42:32.257 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T15:42:32.298 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-17T15:42:32.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T15:42:32.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T15:42:32.407 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-17T15:42:32.418 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-17T15:42:32.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T15:42:32.429 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T15:42:32.440 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-17T15:42:32.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T15:42:32.472 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T15:42:32.482 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-04-17T15:42:32.493 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-04-17T15:42:32.519 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T15:42:32.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:42:32.542 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T15:42:32.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T15:42:32.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-17T15:42:32.578 INFO:teuthology.task.internal:Transferring archived files... 2024-04-17T15:42:32.579 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/remote/smithi044 2024-04-17T15:42:32.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T15:42:32.609 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/suriarte-2024-04-17_14:05:14-rgw-rgw-update-boost-redis-distro-default-smithi/7660437/remote/smithi063 2024-04-17T15:42:32.609 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T15:42:32.630 INFO:teuthology.task.internal:Removing archive directory... 2024-04-17T15:42:32.630 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T15:42:32.648 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T15:42:32.672 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-17T15:42:32.685 INFO:teuthology.task.internal:Not uploading archives. 2024-04-17T15:42:32.686 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-17T15:42:32.701 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-17T15:42:32.702 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T15:42:32.704 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T15:42:32.707 INFO:teuthology.orchestra.run.smithi044.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 15:42 /home/ubuntu/cephtest 2024-04-17T15:42:32.720 INFO:teuthology.orchestra.run.smithi063.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 15:42 /home/ubuntu/cephtest 2024-04-17T15:42:32.721 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-17T15:42:32.731 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-17T15:42:32.790 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 1140.4486532211304 flavor: default owner: scheduled_suriarte@teuthology success: true 2024-04-17T15:42:32.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:42:32.862 INFO:teuthology.run:pass